-- Logs begin at Tue 2022-05-24 14:30:08 UTC, end at Tue 2022-05-24 16:09:09 UTC. -- May 24 15:10:47.767284 dv-cinder-843151-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 24 15:10:47.776111 dv-cinder-843151-1-iscsi devstack@n-api.service[103278]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 24 15:10:47.778097 dv-cinder-843151-1-iscsi devstack@n-api.service[103278]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 24 15:10:47 2022] *** May 24 15:10:47.778097 dv-cinder-843151-1-iscsi devstack@n-api.service[103278]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 24 15:10:47.778097 dv-cinder-843151-1-iscsi devstack@n-api.service[103278]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 24 15:10:47.778097 dv-cinder-843151-1-iscsi devstack@n-api.service[103278]: nodename: dv-cinder-843151-1-iscsi May 24 15:10:47.778097 dv-cinder-843151-1-iscsi devstack@n-api.service[103278]: machine: x86_64 May 24 15:10:47.778097 dv-cinder-843151-1-iscsi devstack@n-api.service[103278]: clock source: unix May 24 15:10:47.778097 dv-cinder-843151-1-iscsi devstack@n-api.service[103278]: pcre jit disabled May 24 15:10:47.778097 dv-cinder-843151-1-iscsi devstack@n-api.service[103278]: detected number of CPU cores: 4 May 24 15:10:47.778097 dv-cinder-843151-1-iscsi devstack@n-api.service[103278]: current working directory: / May 24 15:10:47.778097 dv-cinder-843151-1-iscsi devstack@n-api.service[103278]: detected binary path: /usr/bin/uwsgi-core May 24 15:10:47.778097 dv-cinder-843151-1-iscsi devstack@n-api.service[103278]: your processes number limit is 47680 May 24 15:10:47.778843 dv-cinder-843151-1-iscsi devstack@n-api.service[103278]: your memory page size is 4096 bytes May 24 15:10:47.778843 dv-cinder-843151-1-iscsi devstack@n-api.service[103278]: detected max file descriptor number: 2048 May 24 15:10:47.778843 dv-cinder-843151-1-iscsi devstack@n-api.service[103278]: lock engine: pthread robust mutexes May 24 15:10:47.778843 dv-cinder-843151-1-iscsi devstack@n-api.service[103278]: thunder lock: enabled May 24 15:10:47.778843 dv-cinder-843151-1-iscsi devstack@n-api.service[103278]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 24 15:10:47.778843 dv-cinder-843151-1-iscsi devstack@n-api.service[103278]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 24 15:10:47.822916 dv-cinder-843151-1-iscsi devstack@n-api.service[103278]: Python main interpreter initialized at 0x55ce0489c9c0 May 24 15:10:47.822916 dv-cinder-843151-1-iscsi devstack@n-api.service[103278]: python threads support enabled May 24 15:10:47.822916 dv-cinder-843151-1-iscsi devstack@n-api.service[103278]: your server socket listen backlog is limited to 100 connections May 24 15:10:47.822916 dv-cinder-843151-1-iscsi devstack@n-api.service[103278]: your mercy for graceful operations on workers is 90 seconds May 24 15:10:47.823280 dv-cinder-843151-1-iscsi devstack@n-api.service[103278]: mapped 403077 bytes (393 KB) for 2 cores May 24 15:10:47.823358 dv-cinder-843151-1-iscsi devstack@n-api.service[103278]: *** Operational MODE: preforking *** May 24 15:10:47.823578 dv-cinder-843151-1-iscsi devstack@n-api.service[103278]: *** uWSGI is running in multiple interpreter mode *** May 24 15:10:47.823578 dv-cinder-843151-1-iscsi devstack@n-api.service[103278]: spawned uWSGI master process (pid: 103278) May 24 15:10:47.823765 dv-cinder-843151-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 24 15:10:47.824366 dv-cinder-843151-1-iscsi devstack@n-api.service[103278]: spawned uWSGI worker 1 (pid: 103279, cores: 1) May 24 15:10:47.827212 dv-cinder-843151-1-iscsi devstack@n-api.service[103278]: spawned uWSGI worker 2 (pid: 103280, cores: 1) May 24 15:10:47.827212 dv-cinder-843151-1-iscsi devstack@n-api.service[103278]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 24 15:10:48.987726 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 24 15:10:48.991207 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 24 15:10:49.717130 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 24 15:10:49.717130 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: from cryptography.utils import int_from_bytes May 24 15:10:49.717451 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 24 15:10:49.717451 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: from cryptography.utils import int_from_bytes May 24 15:10:49.717786 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 24 15:10:49.717786 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: from cryptography.utils import int_from_bytes May 24 15:10:49.718115 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 24 15:10:49.718115 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: from cryptography.utils import int_from_bytes May 24 15:10:52.286747 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 24 15:10:52.287298 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 24 15:10:52.287398 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 24 15:10:52.287398 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 24 15:10:52.287833 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 24 15:10:52.287833 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 24 15:10:52.287979 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 24 15:10:52.288097 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 24 15:10:52.288233 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 24 15:10:52.288466 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 24 15:10:52.288568 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.288818 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.288920 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.289139 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.289236 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.289458 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.289545 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.289777 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.289872 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.290083 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.290182 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.290401 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.290486 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.290717 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.290814 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.291036 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.291128 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.291291 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.291377 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.291605 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.291695 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.291920 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.292004 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843151-1-iscsi {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.292236 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.292353 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843151-1-iscsi {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.292566 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.292666 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.292882 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.292975 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.293185 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.293269 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.293483 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.293580 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.293801 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.293894 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.294107 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.294192 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.294411 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.294602 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.294919 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.295058 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.295230 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.295372 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.295538 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.295653 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.295856 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.295986 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.296193 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.296291 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.296531 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.296620 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.296845 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.296985 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.297153 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.297238 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.297461 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.297553 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.297770 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.297855 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.298081 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.298167 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843151-1-iscsi {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.298463 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.298548 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843151-1-iscsi {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.298774 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.298860 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.299082 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.299166 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.299395 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.299484 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.299809 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.299931 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.300119 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.300215 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.300461 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.300549 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.300782 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.300874 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.301090 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.301193 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.301399 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.301483 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.301726 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.301811 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.302035 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.302131 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.302350 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.302437 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.302651 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.302736 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.302957 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.303044 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.303262 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.303354 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.303574 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.303668 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.303873 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.303965 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.304174 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.304265 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.304447 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.304533 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.304744 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.304841 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.305056 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.305156 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.305370 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.305461 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.305690 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.305785 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.305941 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.306072 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.306179 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.306282 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.306489 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.306658 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.306791 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.306927 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.307093 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.307231 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.307398 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.307536 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.307683 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.307819 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.307995 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.308127 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.308331 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.308422 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.308623 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.308720 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.308927 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.309021 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.309230 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.309322 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.309539 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.309633 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.309846 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.309934 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.310158 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.310251 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.310458 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.310555 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.310774 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.310859 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.311096 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.311182 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.311397 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.311499 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.311703 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.311790 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.312026 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.312112 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.312370 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.312480 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.312680 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.312774 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.312988 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.313084 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.313303 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.313398 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.313607 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.313694 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.313909 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.314003 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.314212 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.314345 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.314520 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.314613 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.314835 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.314919 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.315139 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.315226 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.315899 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.315986 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.316198 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.316352 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.316525 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.316613 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.316831 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.316916 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.317133 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.317226 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.317438 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.317538 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.317744 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.317828 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.318041 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.318134 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.318340 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.318425 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.318639 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.318733 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.318941 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.319039 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.319246 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.319330 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.319545 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.319636 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.319844 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.319981 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.320149 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.320235 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.320478 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.320576 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.320782 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.320881 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.321087 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.321171 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.321400 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.321484 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.321704 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.321790 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.322005 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.322096 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.322308 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.322408 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.322612 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.322698 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.322919 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.323012 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.323218 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.323302 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.323520 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.323614 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.323829 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.323912 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.324127 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.324219 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.324454 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.324543 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.324758 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.324842 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.325057 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.325142 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.325360 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.325453 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.325661 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.325746 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.325955 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.326039 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.326264 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.326417 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.326575 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.326741 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.326891 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.327048 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.327198 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.327352 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.327507 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.327655 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.327813 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.327963 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.328118 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.328265 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.328446 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.328590 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.328755 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.328891 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.329061 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.329194 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.329367 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.329490 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.329669 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.329813 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.329988 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.330107 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.330309 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.330401 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.330619 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.330713 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.331542 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.331637 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.331852 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.331938 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.332173 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:10:52.332268 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.332531 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.332618 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.332864 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.332949 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.333173 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.333260 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.333502 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.333595 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.333831 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.333919 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.334149 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.334236 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.334459 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.334547 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.334768 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.334852 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.335085 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.335172 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.335391 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.335474 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.335700 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.335794 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.336010 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.336102 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.336334 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.336468 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.336656 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.336751 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.336971 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.337065 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.337284 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.337369 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.337599 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.337693 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.337915 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.337999 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.338223 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.338308 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.338533 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.338630 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.338851 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.338938 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.339169 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.339254 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.339478 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.339572 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.339786 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.339871 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.340128 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.340214 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.340467 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.340569 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.340792 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.340878 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.341112 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.341197 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.341425 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.341513 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.341734 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.341819 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.342096 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.342181 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.342418 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.342504 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.342743 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.342836 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.343052 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.343147 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.343371 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.343464 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.343684 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.343778 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.343994 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.344085 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.344331 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.344430 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.344635 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.344732 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.344940 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.345038 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.345249 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.345334 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.345572 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.345656 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.345886 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.346021 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.346199 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.346284 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.346541 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.346635 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.346858 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.346953 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.347171 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.347257 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.347483 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.347567 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.347784 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.347877 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.348090 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.348175 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.348413 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.348501 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.348722 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.348821 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.349027 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.349113 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.349331 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.349416 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.349655 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.349743 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.349956 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.350041 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.350274 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.350359 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.350576 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.350665 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.350886 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.350972 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.351196 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.351282 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.351503 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.351589 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.351806 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.351899 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.352108 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.352202 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.352445 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.352543 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.352750 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.352836 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.353053 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.353145 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.353366 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.353461 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.353669 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.354013 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.354236 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.354328 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.354542 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.354627 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.354845 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.354942 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.355147 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.355242 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.355451 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.355544 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.355760 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.355854 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.356068 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.356167 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.356398 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.356488 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.356711 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.356796 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.357020 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.357107 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.357324 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.357419 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.357636 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.357720 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.357975 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.358069 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.358273 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.358365 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.358592 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.358690 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.358911 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.358998 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.359221 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.359307 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.359522 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.359608 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.359881 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.360010 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.360126 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.360212 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.360451 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.360589 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.360755 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.360840 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.361058 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.361143 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.361360 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.361456 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.361662 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.361746 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.361959 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.362044 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.362285 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.362378 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.362583 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.362668 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.362884 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.362968 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.363195 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.363290 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.363496 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.363583 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.363794 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.363886 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.364095 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.364187 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.364437 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.364527 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.364754 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.364882 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.365077 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.365164 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.365411 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.365505 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.365728 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.365814 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.366046 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.366131 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.366354 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.366441 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.366669 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.366790 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.366975 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.367074 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.367285 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.367437 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.367599 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.367694 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.367910 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.367996 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.368223 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.368333 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.368570 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.368669 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.368884 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.368970 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.369192 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.369277 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.369502 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.369596 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.369812 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.369898 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.370125 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.370209 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.370427 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.370524 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.370745 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.370882 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.371075 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.371236 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.371396 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.371537 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.371712 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.371845 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.372026 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.372156 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.372356 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.372489 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.372671 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.372804 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.372981 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.373122 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.373289 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.373420 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.373595 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.373733 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.373906 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.374036 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.374214 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.374361 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.374503 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.374653 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.374822 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.374989 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.375134 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.375265 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.375432 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.375574 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.375738 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.375881 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.376053 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.376189 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.376376 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.376519 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.376686 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.376827 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.377006 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.377137 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.377333 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.377463 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.377643 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.378266 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.378470 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.378602 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.378781 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.378911 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.379087 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.379300 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.379437 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.379572 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.379708 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.379849 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.379998 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.380134 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.380266 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.380417 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.380586 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.380709 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.380898 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.381050 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.381188 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.381321 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.381493 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.381630 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.381798 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.381935 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.382099 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.382229 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.382402 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.382531 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.382706 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.382838 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.383010 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.383141 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.383309 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.383453 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.383625 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.383767 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.383936 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.384067 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.384245 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.384407 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.384588 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.384717 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.384890 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.385032 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.385198 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.385338 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.385494 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.385624 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.385801 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.385931 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.386103 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.386243 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.386405 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.386541 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.386703 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.386853 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.386989 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.387135 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.387330 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.387462 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.387629 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.387772 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.387916 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.388059 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.388236 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.388412 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.388583 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.388712 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.388875 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.389010 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.389189 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.389320 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.389494 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.389629 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.389801 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.389936 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.390109 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.390243 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.390419 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.390510 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.390725 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.390812 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.391032 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.391166 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.391340 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.391484 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.391644 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.391786 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.391951 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.392094 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.392256 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.392478 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.392617 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.392754 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.392894 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.393029 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.393163 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.393306 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.394077 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.394218 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.394397 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.394529 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.394718 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.394962 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.395284 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.395370 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.395595 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.395681 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.395916 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.396014 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.396230 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.396335 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.396572 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.396670 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.396893 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.396980 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.397217 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.397302 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.397543 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.397629 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.397847 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.397945 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.398154 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.398253 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.398464 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.398557 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.398766 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.398853 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.399069 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.399155 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.399369 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.399455 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.399670 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.399756 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.399971 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.400057 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.400274 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.400464 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.400600 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.400700 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.400901 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.400994 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.401198 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.401285 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.401499 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.401585 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.401805 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.401892 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.402103 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.402188 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.402407 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.402505 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.402705 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.402790 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.403006 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.403091 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.403318 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.403477 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.403620 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.403707 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.403921 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.404006 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.404223 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.404389 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.404550 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.404660 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.404891 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.404989 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.405191 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.405297 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.405515 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.405610 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.405839 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.405932 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.406139 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.406227 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.406440 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.406529 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.406759 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.406852 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.407056 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.407143 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.407357 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.407444 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.407656 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.407743 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.407955 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.408041 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.408258 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.408368 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.408588 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.408687 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.408889 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.408975 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.409239 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.409325 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.409547 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.409641 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.409850 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.409937 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.410151 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.410247 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.410454 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.410606 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.410749 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.410836 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.411051 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.411145 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.411353 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.411454 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.411652 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.411739 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.411951 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.412036 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.412255 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.412361 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.412587 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.412674 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.412888 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.412975 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.413189 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.413275 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.413486 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.413571 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.413786 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.413871 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.414085 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.414171 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.414386 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.414472 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.414687 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.414773 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.414989 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.415077 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.415304 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.415433 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.415596 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.415693 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.415896 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.415981 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.416210 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.416316 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.416539 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.416638 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.416842 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.416928 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.417147 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.417231 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.417449 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.417550 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.417751 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.417838 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.418056 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.418140 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.418362 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.418455 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.418680 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.418772 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.418982 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.419076 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.419282 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.419369 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.419580 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.419664 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.419881 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.419966 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.420177 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.420263 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.420502 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.420597 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.420811 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.420945 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.421114 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.421245 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.421393 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.421534 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.421669 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.421803 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.421950 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.422087 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.422253 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.422388 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.422555 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.422701 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.422841 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.422985 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.423129 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.423270 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.423412 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.423554 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.423725 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.423853 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.424038 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.424169 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.424382 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.424531 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.424761 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.424898 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.425077 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.425210 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.425394 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.425553 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.425695 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.425831 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.425994 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.426132 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.426304 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.426448 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.426604 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.426738 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.426908 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.427047 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.427212 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.427354 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.427520 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.427654 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.427817 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.427951 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.428119 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.428252 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.428445 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.428577 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.428768 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.428909 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.429054 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.429189 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.429372 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.429503 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.429689 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.429819 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.430004 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.430140 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.430305 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.430437 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.430611 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.430708 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.430914 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.431045 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.431220 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.431352 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.431527 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.431692 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.431829 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.431922 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.432135 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.432221 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.432465 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.432575 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.432775 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.432868 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.433084 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.433170 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.433391 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.433486 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.433693 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.433787 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.434000 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.434087 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.434306 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.434393 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.434607 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.434694 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.434908 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.434992 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.435218 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.435304 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.435517 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.435649 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.435817 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.435910 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.436115 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.436202 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.436447 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.436549 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.436747 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.436832 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.437048 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.437171 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.437475 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.437560 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.437781 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.437876 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.438084 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.438171 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.438385 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.438470 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.438691 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.438785 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.439000 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.439085 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.439307 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.439394 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.439609 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.439705 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.439911 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.440025 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.440864 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.441032 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.441179 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.441432 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.441520 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.441793 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.441879 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.442101 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.442196 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.442407 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.442501 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.442721 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.442807 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.443047 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.443143 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.443353 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.443439 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.443659 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.443744 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.443963 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.444057 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.444287 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.444451 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.444619 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.444726 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.444943 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.445068 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.445360 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.445515 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.445672 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.445956 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.446054 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.446283 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.446377 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.446673 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.446758 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.446985 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.447079 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.447308 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.447395 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.447629 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.447714 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.447953 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.448047 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.448258 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.448364 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.448594 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.448695 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.448907 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.449001 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.449234 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.449334 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.449559 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.449645 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.449871 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.449956 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.450189 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.450284 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.450495 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.450588 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.450815 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.450913 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.451138 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.451235 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.451452 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.451539 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.451775 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.451866 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.452132 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.452218 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.452526 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.452616 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.452847 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.452939 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.453182 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.453270 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.453510 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.453605 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.453819 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.453905 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.454125 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.454211 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.454443 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.454530 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.454750 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.454845 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.455054 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.455140 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.455376 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.455462 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.455681 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.455775 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.456553 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.456720 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.456868 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.457046 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.457180 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.457370 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.457485 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.457691 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.457777 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.458005 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.458092 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.458320 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.458408 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.458653 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.458740 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.458967 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.459067 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.459299 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.459394 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.459616 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.459707 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.459927 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.460065 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.460253 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.460419 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.460590 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.460747 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.460896 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.461042 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.461199 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.461362 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.461507 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.461677 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.461848 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.461992 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.462153 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.462296 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.462476 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.462646 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.462799 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.462958 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.463130 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.463289 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.463442 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.463626 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.463777 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.463963 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.464096 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.464282 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.464439 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.464645 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.464766 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.464986 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.465087 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.465318 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.465417 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.465643 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.465751 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.465957 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.466051 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.466262 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.466362 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.466565 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.466658 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.466872 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.466973 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.467181 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.467274 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.467476 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.467568 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.467786 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.467891 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.468082 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.468266 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.468428 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.468522 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.468727 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.468823 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.469030 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.469133 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.469346 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.469439 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.469652 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.469747 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.469957 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.470065 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.470260 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.470363 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.470568 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.470660 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.470879 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.470983 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.471267 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.471380 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.471532 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.471638 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.471835 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.471939 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.472159 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.472251 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.472497 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.472633 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.472820 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.473002 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.473135 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.473268 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.473436 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.473569 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.473750 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.473890 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.474065 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.474208 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.474382 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.474515 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.474693 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.474844 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.475081 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.475224 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.475430 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.475576 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.475719 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.475859 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.475991 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.476121 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.476262 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.476415 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.476559 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.476745 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.476892 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.477077 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.477213 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.477395 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.477693 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.477823 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.478013 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.478143 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.478329 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.478475 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.478644 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.479039 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.479225 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.479365 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.479539 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.479690 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.479852 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.479981 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.480164 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.480293 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.480534 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.480674 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.480820 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.480955 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.481089 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.481233 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.481456 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.481593 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.481728 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.481862 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.482047 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.482178 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.482365 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.482496 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.482681 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.482819 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.483030 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.483184 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.483347 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.483481 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.483658 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.483791 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.483976 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.484118 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.484534 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.484696 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.484846 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.484984 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.485170 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.485384 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.485617 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.485760 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.485895 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.486030 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.486177 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.486321 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.486457 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.486591 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.486725 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.486859 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.487003 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.487182 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.487319 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.487454 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.487596 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.487803 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.487941 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.488077 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.488077 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.488392 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.488392 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.488680 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.488815 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.488960 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.489097 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.489230 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.489370 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.489512 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.489646 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.489780 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.489914 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.490047 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.490330 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.490472 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.490656 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.490797 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.490975 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.491119 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.491294 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.491454 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.491658 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.491798 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.491932 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.492073 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.492217 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.492376 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.492517 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.492662 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.492808 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.492943 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.493086 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.493221 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.493410 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.493553 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.493723 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.493873 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.494031 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.494173 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.494358 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.494509 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.494653 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.494807 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.495054 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.495201 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.495424 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.495574 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.495801 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.495958 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.496145 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.496286 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.496502 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.496645 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.496826 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.496978 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.497125 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.497260 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.497454 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.497596 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.497765 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.497907 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.498075 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.498217 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.498395 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.498545 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.498690 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.498825 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.498999 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.499143 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.499306 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.499455 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.499622 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.499766 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.499929 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.500070 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.500233 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.500398 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.500573 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.500716 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.500879 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.501031 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.501167 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.501309 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.501484 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.501640 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.501845 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.501985 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.502127 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.502269 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.502410 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.502545 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.502679 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.503331 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.503477 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.503622 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.503782 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.503924 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.504090 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.504293 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.504460 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.504605 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.504741 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.504876 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.505018 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.505160 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.505304 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.505451 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.505670 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.505827 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.506030 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.506169 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.506313 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.506448 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.506590 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.506742 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.506878 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.507011 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.507159 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.507294 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.507438 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.507578 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.507714 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.507848 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.507995 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.508138 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.508333 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.508480 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.508639 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.508799 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.508935 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.509071 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.509283 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.509426 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.509598 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.509752 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.509916 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.510128 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.510270 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.510463 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.510611 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.510788 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.511095 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.511245 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.511436 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.511589 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.511724 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.511883 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.512087 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.512227 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.512401 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.512539 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.512683 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.512818 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.512960 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.513103 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.513238 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.513372 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.513548 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.513691 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.513859 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.514008 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.514172 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.514314 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.514484 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.514627 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.514800 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.514941 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.515112 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.515268 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.515415 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.515557 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.515708 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.515910 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.516066 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.516281 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.516482 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.516619 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.516754 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.516889 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.517024 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.517245 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.517398 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.517540 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.517675 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.517809 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.517953 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.518089 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.518223 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.518399 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.519026 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.519162 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.519306 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.519442 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.519577 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.519757 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.519907 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.520074 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.520225 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.520414 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.520559 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.520728 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.520869 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.521041 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.521194 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.521362 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.521504 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.521697 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.521841 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.522017 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.522245 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.522385 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.522532 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.522724 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.522872 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.523020 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.523154 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.523348 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.523490 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.523658 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.523822 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.523980 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.524121 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.524290 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.524472 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.524643 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.524799 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.524959 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.525100 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.525292 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.525433 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.525611 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.525771 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.525926 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.526135 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.526293 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.526494 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.526635 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.526778 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.526914 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.527056 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.527191 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.527325 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.527472 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.527635 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.527771 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.527906 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.528039 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.528172 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.528349 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.528493 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.528628 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.528772 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.528907 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.529041 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.529189 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.529324 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.529468 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.529603 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.529744 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.529904 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.530056 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.530213 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.530354 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.530521 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.530670 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.530813 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.530949 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.531132 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.531273 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.531440 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.531583 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.531749 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.531901 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.532036 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.532170 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.532430 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.532572 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.532723 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.532866 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.533001 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.533136 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.533271 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.533416 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.533559 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.533695 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.533854 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.534017 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.534192 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.534343 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.534491 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.534634 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.534798 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.534939 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.535130 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.535279 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.535428 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.535563 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.535752 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.535901 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.536076 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.536339 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.536502 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.536705 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.536845 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.536991 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.537136 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.537271 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.537417 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.537551 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.537685 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.537828 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.537972 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.538107 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.538248 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.538385 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.538526 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.538661 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.538804 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.538947 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.539123 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.539275 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.539451 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.539595 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.539760 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.539902 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.540083 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.540230 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.540429 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.540579 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.540715 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.540850 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.541026 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.541178 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.541323 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.541475 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.541651 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.541792 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.541963 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.542104 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.542273 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.542440 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.542646 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.542785 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.542919 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.543065 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.543208 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.543351 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.543485 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.543620 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.543776 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.543926 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.544102 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.544252 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.544420 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.544566 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.544740 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.544889 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.545065 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.545207 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.545386 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.545526 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.545714 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.545936 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.546074 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.546215 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.546429 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.546569 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.546722 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.546940 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.547091 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.547226 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.547366 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.547501 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.547634 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.547777 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.547913 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 24 15:10:52.548055 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.548257 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.548601 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.548919 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.549229 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:10:52.549477 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 24 15:10:52.606380 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: INFO dbcounter [None req-19945303-6db3-46db-a513-56c9ad5fd363 None None] Registered counter for database nova_api May 24 15:10:52.608276 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: INFO dbcounter [None req-98011f4b-b889-4190-8527-1575a9c3feb7 None None] Registered counter for database nova_api May 24 15:10:52.626483 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG oslo_db.sqlalchemy.engines [None req-19945303-6db3-46db-a513-56c9ad5fd363 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103279) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 15:10:52.628744 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG oslo_db.sqlalchemy.engines [None req-98011f4b-b889-4190-8527-1575a9c3feb7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103280) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 15:10:52.633776 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG dbcounter [-] [103279] Writer thread running {{(pid=103279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 15:10:52.635227 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG dbcounter [-] [103280] Writer thread running {{(pid=103280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 15:10:52.691073 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.context [None req-19945303-6db3-46db-a513-56c9ad5fd363 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4d042716-ec3d-4081-835a-0e5e9de595c8(cell1) {{(pid=103279) load_cells /opt/stack/nova/nova/context.py:464}} May 24 15:10:52.692328 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.context [None req-98011f4b-b889-4190-8527-1575a9c3feb7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4d042716-ec3d-4081-835a-0e5e9de595c8(cell1) {{(pid=103280) load_cells /opt/stack/nova/nova/context.py:464}} May 24 15:10:52.695230 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG oslo_concurrency.lockutils [None req-19945303-6db3-46db-a513-56c9ad5fd363 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:10:52.696405 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG oslo_concurrency.lockutils [None req-98011f4b-b889-4190-8527-1575a9c3feb7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:10:52.696837 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG oslo_concurrency.lockutils [None req-19945303-6db3-46db-a513-56c9ad5fd363 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:10:52.697625 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG oslo_concurrency.lockutils [None req-19945303-6db3-46db-a513-56c9ad5fd363 None None] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:10:52.697980 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG oslo_concurrency.lockutils [None req-98011f4b-b889-4190-8527-1575a9c3feb7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:10:52.698773 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG oslo_concurrency.lockutils [None req-98011f4b-b889-4190-8527-1575a9c3feb7 None None] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:10:52.699555 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG oslo_concurrency.lockutils [None req-19945303-6db3-46db-a513-56c9ad5fd363 None None] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:10:52.700748 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG oslo_concurrency.lockutils [None req-98011f4b-b889-4190-8527-1575a9c3feb7 None None] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:10:52.701568 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: INFO dbcounter [None req-19945303-6db3-46db-a513-56c9ad5fd363 None None] Registered counter for database nova_cell0 May 24 15:10:52.702726 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: INFO dbcounter [None req-98011f4b-b889-4190-8527-1575a9c3feb7 None None] Registered counter for database nova_cell0 May 24 15:10:52.705604 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: INFO dbcounter [None req-19945303-6db3-46db-a513-56c9ad5fd363 None None] Registered counter for database nova_cell1 May 24 15:10:52.706757 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: INFO dbcounter [None req-98011f4b-b889-4190-8527-1575a9c3feb7 None None] Registered counter for database nova_cell1 May 24 15:10:52.713181 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG oslo_db.sqlalchemy.engines [None req-19945303-6db3-46db-a513-56c9ad5fd363 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103279) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 15:10:52.717237 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG oslo_db.sqlalchemy.engines [None req-98011f4b-b889-4190-8527-1575a9c3feb7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103280) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 15:10:52.717902 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG dbcounter [-] [103279] Writer thread running {{(pid=103279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 15:10:52.718160 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG oslo_db.sqlalchemy.engines [None req-98011f4b-b889-4190-8527-1575a9c3feb7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103280) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 15:10:52.722314 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG oslo_db.sqlalchemy.engines [None req-19945303-6db3-46db-a513-56c9ad5fd363 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103279) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 15:10:52.724778 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG dbcounter [-] [103280] Writer thread running {{(pid=103280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 15:10:52.730285 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG dbcounter [-] [103280] Writer thread running {{(pid=103280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 15:10:52.860651 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG dbcounter [-] [103279] Writer thread running {{(pid=103279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 15:10:52.869526 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: INFO dbcounter [None req-19945303-6db3-46db-a513-56c9ad5fd363 None None] Registered counter for database nova_cell0 May 24 15:10:52.870711 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: INFO dbcounter [None req-98011f4b-b889-4190-8527-1575a9c3feb7 None None] Registered counter for database nova_cell0 May 24 15:10:52.878807 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG oslo_db.sqlalchemy.engines [None req-19945303-6db3-46db-a513-56c9ad5fd363 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103279) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 15:10:52.882367 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG oslo_db.sqlalchemy.engines [None req-98011f4b-b889-4190-8527-1575a9c3feb7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103280) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 15:10:52.883094 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG dbcounter [-] [103279] Writer thread running {{(pid=103279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 15:10:52.886640 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG dbcounter [-] [103280] Writer thread running {{(pid=103280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 15:10:53.215984 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: WARNING keystonemiddleware.auth_token [None req-98011f4b-b889-4190-8527-1575a9c3feb7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 24 15:10:53.218695 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: WARNING keystonemiddleware.auth_token [None req-19945303-6db3-46db-a513-56c9ad5fd363 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 24 15:10:53.223224 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: WARNING keystonemiddleware.auth_token [None req-98011f4b-b889-4190-8527-1575a9c3feb7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 24 15:10:53.225964 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: WARNING keystonemiddleware.auth_token [None req-19945303-6db3-46db-a513-56c9ad5fd363 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 24 15:10:53.560912 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: WARNING keystonemiddleware.auth_token [None req-98011f4b-b889-4190-8527-1575a9c3feb7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 24 15:10:53.567404 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: WARNING keystonemiddleware.auth_token [None req-98011f4b-b889-4190-8527-1575a9c3feb7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 24 15:10:53.568139 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: WARNING keystonemiddleware.auth_token [None req-19945303-6db3-46db-a513-56c9ad5fd363 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 24 15:10:53.572735 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ce0489c9c0 pid: 103280 (default app) May 24 15:10:53.574049 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: WARNING keystonemiddleware.auth_token [None req-19945303-6db3-46db-a513-56c9ad5fd363 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 24 15:10:53.574758 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi [None req-98011f4b-b889-4190-8527-1575a9c3feb7 None None] Calling method '>' {{(pid=103280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:10:53.575923 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: INFO nova.api.openstack.requestlog [None req-98011f4b-b889-4190-8527-1575a9c3feb7 None None] 10.222.0.45 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001719 May 24 15:10:53.576341 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: [pid: 103280|app: 0|req: 1/1] 10.222.0.45 () {50 vars in 788 bytes} [Tue May 24 15:10:53 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:10:53.579298 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ce0489c9c0 pid: 103279 (default app) May 24 15:12:10.918230 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi [None req-98011f4b-b889-4190-8527-1575a9c3feb7 None None] Calling method '>' {{(pid=103280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:12:10.919221 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: INFO nova.api.openstack.requestlog [None req-98011f4b-b889-4190-8527-1575a9c3feb7 None None] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 May 24 15:12:10.919626 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: [pid: 103280|app: 0|req: 2/2] 10.222.0.45 () {54 vars in 930 bytes} [Tue May 24 15:12:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:12:10.936371 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG dbcounter [-] [103279] Writing DB stats nova_api:SELECT=3 {{(pid=103279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:12:10.937549 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG dbcounter [-] [103279] Writing DB stats nova_cell0:SELECT=3 {{(pid=103279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:12:10.938713 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG dbcounter [-] [103279] Writing DB stats nova_cell1:SELECT=3 {{(pid=103279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:12:10.940182 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG dbcounter [-] [103279] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:12:11.382789 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi [None req-77f8dc62-d9a9-4489-9462-0dd2b8209e48 admin admin] Calling method '>' {{(pid=103279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:12:11.413600 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: INFO nova.api.openstack.requestlog [None req-77f8dc62-d9a9-4489-9462-0dd2b8209e48 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.486408 May 24 15:12:11.414354 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: [pid: 103279|app: 0|req: 1/3] 10.222.0.45 () {60 vars in 1291 bytes} [Tue May 24 15:12:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:12:13.674749 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi [None req-98011f4b-b889-4190-8527-1575a9c3feb7 None None] Calling method '>' {{(pid=103280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:12:13.675743 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: INFO nova.api.openstack.requestlog [None req-98011f4b-b889-4190-8527-1575a9c3feb7 None None] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 May 24 15:12:13.676135 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: [pid: 103280|app: 0|req: 3/4] 10.222.0.45 () {54 vars in 930 bytes} [Tue May 24 15:12:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:12:13.737797 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi [None req-54aedc48-b35e-4ef4-9166-0cd90b8c7395 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "disk": 1, "rxtx_factor": 1.0, "swap": 0, "ram": 256, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256"}} {{(pid=103279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:12:13.756699 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 15:12:13.756699 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: warnings.warn(msg) May 24 15:12:13.788090 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: INFO nova.api.openstack.requestlog [None req-54aedc48-b35e-4ef4-9166-0cd90b8c7395 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.105897 May 24 15:12:13.788858 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: [pid: 103279|app: 0|req: 2/5] 10.222.0.45 () {64 vars in 1282 bytes} [Tue May 24 15:12:13 2022] POST /compute/v2.1/flavors => generated 407 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:12:13.802268 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG dbcounter [-] [103280] Writing DB stats nova_api:SELECT=3 {{(pid=103280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:12:13.803653 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG dbcounter [-] [103280] Writing DB stats nova_cell1:SELECT=3 {{(pid=103280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:12:13.804958 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG dbcounter [-] [103280] Writing DB stats nova_cell0:SELECT=3 {{(pid=103280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:12:13.805810 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG dbcounter [-] [103280] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:12:14.022086 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi [None req-c3c69036-bd08-4259-b536-be229f156da2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:12:14.024520 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 15:12:14.024520 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: warnings.warn(msg) May 24 15:12:14.089430 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: INFO nova.api.openstack.requestlog [None req-c3c69036-bd08-4259-b536-be229f156da2 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.292617 May 24 15:12:14.090014 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: [pid: 103280|app: 0|req: 4/6] 10.222.0.45 () {64 vars in 1335 bytes} [Tue May 24 15:12:13 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:12:16.363472 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi [None req-54aedc48-b35e-4ef4-9166-0cd90b8c7395 admin admin] Calling method '>' {{(pid=103279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:12:16.364643 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: INFO nova.api.openstack.requestlog [None req-54aedc48-b35e-4ef4-9166-0cd90b8c7395 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001582 May 24 15:12:16.365401 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: [pid: 103279|app: 0|req: 3/7] 10.222.0.45 () {54 vars in 930 bytes} [Tue May 24 15:12:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:12:16.471689 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi [None req-2a086c0c-0da7-4a72-afa8-9baae8a27d8f admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "id": "d1", "disk": 5, "name": "ds512M", "swap": 0}} {{(pid=103280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:12:16.489696 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 15:12:16.489696 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: warnings.warn(msg) May 24 15:12:16.507802 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: INFO nova.api.openstack.requestlog [None req-2a086c0c-0da7-4a72-afa8-9baae8a27d8f admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.136071 May 24 15:12:16.508379 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: [pid: 103280|app: 0|req: 5/8] 10.222.0.45 () {64 vars in 1282 bytes} [Tue May 24 15:12:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:12:16.520690 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi [None req-f21c964a-2d22-4c55-a650-6504f1282c8a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:12:16.522166 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 15:12:16.522166 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: warnings.warn(msg) May 24 15:12:16.553393 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: INFO nova.api.openstack.requestlog [None req-f21c964a-2d22-4c55-a650-6504f1282c8a admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036914 May 24 15:12:16.553971 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: [pid: 103279|app: 0|req: 4/9] 10.222.0.45 () {64 vars in 1335 bytes} [Tue May 24 15:12:16 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:12:18.815180 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi [None req-2a086c0c-0da7-4a72-afa8-9baae8a27d8f admin admin] Calling method '>' {{(pid=103280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:12:18.816268 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: INFO nova.api.openstack.requestlog [None req-2a086c0c-0da7-4a72-afa8-9baae8a27d8f admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002160 May 24 15:12:18.816893 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: [pid: 103280|app: 0|req: 6/10] 10.222.0.45 () {54 vars in 930 bytes} [Tue May 24 15:12:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:12:18.879113 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi [None req-0a2a8435-7d20-4381-b7e8-8562b807155d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d2", "vcpus": 1, "rxtx_factor": 1.0, "disk": 10, "ram": 1024, "os-flavor-access:is_public": true}} {{(pid=103279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:12:18.903977 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: INFO nova.api.openstack.requestlog [None req-0a2a8435-7d20-4381-b7e8-8562b807155d admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.081222 May 24 15:12:18.905000 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: [pid: 103279|app: 0|req: 5/11] 10.222.0.45 () {64 vars in 1282 bytes} [Tue May 24 15:12:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 15:12:18.917477 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi [None req-46ccc8c5-f910-454c-8351-fea9fb6ca234 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:12:18.946559 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: INFO nova.api.openstack.requestlog [None req-46ccc8c5-f910-454c-8351-fea9fb6ca234 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032509 May 24 15:12:18.947317 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: [pid: 103280|app: 0|req: 7/12] 10.222.0.45 () {64 vars in 1335 bytes} [Tue May 24 15:12:18 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:12:21.237575 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi [None req-0a2a8435-7d20-4381-b7e8-8562b807155d admin admin] Calling method '>' {{(pid=103279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:12:21.238690 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: INFO nova.api.openstack.requestlog [None req-0a2a8435-7d20-4381-b7e8-8562b807155d admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001565 May 24 15:12:21.239356 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: [pid: 103279|app: 0|req: 6/13] 10.222.0.45 () {54 vars in 930 bytes} [Tue May 24 15:12:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:12:21.303112 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi [None req-66b4b836-cf1b-4b2b-9942-7983d34dfc2f admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 2, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 10, "rxtx_factor": 1.0, "name": "ds2G", "ram": 2048}} {{(pid=103280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:12:21.322935 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: INFO nova.api.openstack.requestlog [None req-66b4b836-cf1b-4b2b-9942-7983d34dfc2f admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077156 May 24 15:12:21.323499 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: [pid: 103280|app: 0|req: 8/14] 10.222.0.45 () {64 vars in 1282 bytes} [Tue May 24 15:12:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 15:12:21.335634 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi [None req-1ccff5ee-b1c0-4062-8f6d-9721d03232d1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:12:21.359529 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: INFO nova.api.openstack.requestlog [None req-1ccff5ee-b1c0-4062-8f6d-9721d03232d1 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027665 May 24 15:12:21.360148 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: [pid: 103279|app: 0|req: 7/15] 10.222.0.45 () {64 vars in 1335 bytes} [Tue May 24 15:12:21 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:12:23.601049 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi [None req-66b4b836-cf1b-4b2b-9942-7983d34dfc2f admin admin] Calling method '>' {{(pid=103280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:12:23.602065 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: INFO nova.api.openstack.requestlog [None req-66b4b836-cf1b-4b2b-9942-7983d34dfc2f admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 May 24 15:12:23.602493 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: [pid: 103280|app: 0|req: 9/16] 10.222.0.45 () {54 vars in 930 bytes} [Tue May 24 15:12:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:12:23.660847 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi [None req-6f580682-94e2-4068-bcec-f999a12a89cf admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 4096, "vcpus": 4, "disk": 20, "id": "d4", "rxtx_factor": 1.0, "swap": 0, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:12:23.682148 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: INFO nova.api.openstack.requestlog [None req-6f580682-94e2-4068-bcec-f999a12a89cf admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073545 May 24 15:12:23.691191 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: [pid: 103279|app: 0|req: 8/17] 10.222.0.45 () {64 vars in 1282 bytes} [Tue May 24 15:12:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 15:12:23.697062 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi [None req-8f831862-b1af-4e0b-844c-6f20cd634289 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:12:23.726576 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: INFO nova.api.openstack.requestlog [None req-8f831862-b1af-4e0b-844c-6f20cd634289 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034060 May 24 15:12:23.728143 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: [pid: 103280|app: 0|req: 10/18] 10.222.0.45 () {64 vars in 1335 bytes} [Tue May 24 15:12:23 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:12:25.961605 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi [None req-6f580682-94e2-4068-bcec-f999a12a89cf admin admin] Calling method '>' {{(pid=103279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:12:25.963184 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: INFO nova.api.openstack.requestlog [None req-6f580682-94e2-4068-bcec-f999a12a89cf admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002126 May 24 15:12:25.963752 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: [pid: 103279|app: 0|req: 9/19] 10.222.0.45 () {54 vars in 930 bytes} [Tue May 24 15:12:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:12:26.029003 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi [None req-0cead102-ca33-4638-a280-41dab775c877 admin admin] Calling method '>' {{(pid=103280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:12:26.054689 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: INFO nova.api.openstack.requestlog [None req-0cead102-ca33-4638-a280-41dab775c877 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.084320 May 24 15:12:26.055452 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: [pid: 103280|app: 0|req: 11/20] 10.222.0.45 () {60 vars in 1291 bytes} [Tue May 24 15:12:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:12:28.306053 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi [None req-6f580682-94e2-4068-bcec-f999a12a89cf admin admin] Calling method '>' {{(pid=103279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:12:28.307105 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: INFO nova.api.openstack.requestlog [None req-6f580682-94e2-4068-bcec-f999a12a89cf admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 May 24 15:12:28.307518 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: [pid: 103279|app: 0|req: 10/21] 10.222.0.45 () {54 vars in 930 bytes} [Tue May 24 15:12:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:12:28.368910 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi [None req-e23ec97a-9e22-4876-b4b7-d50d1279ac76 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "ram": 512, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "disk": 1, "name": "m1.tiny"}} {{(pid=103280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:12:28.394512 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: INFO nova.api.openstack.requestlog [None req-e23ec97a-9e22-4876-b4b7-d50d1279ac76 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.080856 May 24 15:12:28.395511 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: [pid: 103280|app: 0|req: 12/22] 10.222.0.45 () {64 vars in 1282 bytes} [Tue May 24 15:12:28 2022] POST /compute/v2.1/flavors => generated 402 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:12:28.407490 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi [None req-82a3fbb5-fe84-422b-9aa9-328dc067b7af admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:12:28.430495 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: INFO nova.api.openstack.requestlog [None req-82a3fbb5-fe84-422b-9aa9-328dc067b7af admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026720 May 24 15:12:28.431068 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: [pid: 103279|app: 0|req: 11/23] 10.222.0.45 () {64 vars in 1332 bytes} [Tue May 24 15:12:28 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:12:30.696612 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi [None req-e23ec97a-9e22-4876-b4b7-d50d1279ac76 admin admin] Calling method '>' {{(pid=103280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:12:30.697634 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: INFO nova.api.openstack.requestlog [None req-e23ec97a-9e22-4876-b4b7-d50d1279ac76 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 May 24 15:12:30.698045 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: [pid: 103280|app: 0|req: 13/24] 10.222.0.45 () {54 vars in 930 bytes} [Tue May 24 15:12:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:12:30.758084 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi [None req-d91000c6-a4b5-4d54-ba43-20f4980a20ce admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "swap": 0, "vcpus": 1, "ram": 2048, "disk": 20, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "rxtx_factor": 1.0}} {{(pid=103279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:12:30.775723 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: INFO nova.api.openstack.requestlog [None req-d91000c6-a4b5-4d54-ba43-20f4980a20ce admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.071624 May 24 15:12:30.776526 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: [pid: 103279|app: 0|req: 12/25] 10.222.0.45 () {64 vars in 1282 bytes} [Tue May 24 15:12:30 2022] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:12:30.790242 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi [None req-4b47e755-c673-4e1c-aefc-b36d190c9ba6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:12:30.819918 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: INFO nova.api.openstack.requestlog [None req-4b47e755-c673-4e1c-aefc-b36d190c9ba6 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034147 May 24 15:12:30.820922 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: [pid: 103280|app: 0|req: 14/26] 10.222.0.45 () {64 vars in 1332 bytes} [Tue May 24 15:12:30 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:12:33.131174 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi [None req-d91000c6-a4b5-4d54-ba43-20f4980a20ce admin admin] Calling method '>' {{(pid=103279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:12:33.131861 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: INFO nova.api.openstack.requestlog [None req-d91000c6-a4b5-4d54-ba43-20f4980a20ce admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001686 May 24 15:12:33.132369 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: [pid: 103279|app: 0|req: 13/27] 10.222.0.45 () {54 vars in 930 bytes} [Tue May 24 15:12:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:12:33.199171 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi [None req-a0cfe8fe-7b78-4408-a5f3-33e04fa37c84 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 4096, "disk": 40, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "3", "vcpus": 2}} {{(pid=103280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:12:33.217906 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: INFO nova.api.openstack.requestlog [None req-a0cfe8fe-7b78-4408-a5f3-33e04fa37c84 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.079251 May 24 15:12:33.218451 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: [pid: 103280|app: 0|req: 15/28] 10.222.0.45 () {64 vars in 1282 bytes} [Tue May 24 15:12:33 2022] POST /compute/v2.1/flavors => generated 406 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:12:33.231487 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi [None req-cdb16adf-7663-4e8c-91fd-8fe10dbfd3c4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:12:33.253212 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: INFO nova.api.openstack.requestlog [None req-cdb16adf-7663-4e8c-91fd-8fe10dbfd3c4 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025690 May 24 15:12:33.253868 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: [pid: 103279|app: 0|req: 14/29] 10.222.0.45 () {64 vars in 1332 bytes} [Tue May 24 15:12:33 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:12:35.479766 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi [None req-a0cfe8fe-7b78-4408-a5f3-33e04fa37c84 admin admin] Calling method '>' {{(pid=103280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:12:35.481052 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: INFO nova.api.openstack.requestlog [None req-a0cfe8fe-7b78-4408-a5f3-33e04fa37c84 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 May 24 15:12:35.481596 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: [pid: 103280|app: 0|req: 16/30] 10.222.0.45 () {54 vars in 930 bytes} [Tue May 24 15:12:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:12:35.536598 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi [None req-fa459b2d-7418-4a27-862e-52b467e21bd3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "disk": 80, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.large", "ram": 8192, "id": "4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:12:35.555716 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: INFO nova.api.openstack.requestlog [None req-fa459b2d-7418-4a27-862e-52b467e21bd3 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.068544 May 24 15:12:35.556447 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: [pid: 103279|app: 0|req: 15/31] 10.222.0.45 () {64 vars in 1282 bytes} [Tue May 24 15:12:35 2022] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:12:35.568993 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi [None req-000ff31e-0329-4028-a3d1-41da8391d446 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:12:35.591769 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: INFO nova.api.openstack.requestlog [None req-000ff31e-0329-4028-a3d1-41da8391d446 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026528 May 24 15:12:35.592346 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: [pid: 103280|app: 0|req: 17/32] 10.222.0.45 () {64 vars in 1332 bytes} [Tue May 24 15:12:35 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:12:37.841037 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi [None req-fa459b2d-7418-4a27-862e-52b467e21bd3 admin admin] Calling method '>' {{(pid=103279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:12:37.842643 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: INFO nova.api.openstack.requestlog [None req-fa459b2d-7418-4a27-862e-52b467e21bd3 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002083 May 24 15:12:37.843208 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: [pid: 103279|app: 0|req: 16/33] 10.222.0.45 () {54 vars in 930 bytes} [Tue May 24 15:12:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:12:37.910672 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi [None req-ecc68bb4-8851-421b-8a35-43b8ca7c6e71 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "ram": 16384, "name": "m1.xlarge", "vcpus": 8, "rxtx_factor": 1.0, "swap": 0, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=103280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:12:37.929483 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: INFO nova.api.openstack.requestlog [None req-ecc68bb4-8851-421b-8a35-43b8ca7c6e71 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.079783 May 24 15:12:37.930092 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: [pid: 103280|app: 0|req: 18/34] 10.222.0.45 () {64 vars in 1282 bytes} [Tue May 24 15:12:37 2022] POST /compute/v2.1/flavors => generated 408 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:12:37.942169 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi [None req-d8f3cee5-6ce6-4252-872e-6585e468c969 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:12:37.966668 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: INFO nova.api.openstack.requestlog [None req-d8f3cee5-6ce6-4252-872e-6585e468c969 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028287 May 24 15:12:37.967247 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: [pid: 103279|app: 0|req: 17/35] 10.222.0.45 () {64 vars in 1332 bytes} [Tue May 24 15:12:37 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:13:01.999023 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi [None req-ecc68bb4-8851-421b-8a35-43b8ca7c6e71 admin admin] Calling method '>' {{(pid=103280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:13:02.000029 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: INFO nova.api.openstack.requestlog [None req-ecc68bb4-8851-421b-8a35-43b8ca7c6e71 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 May 24 15:13:02.000457 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: [pid: 103280|app: 0|req: 19/36] 10.222.0.45 () {54 vars in 930 bytes} [Tue May 24 15:13:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:13:02.011468 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG dbcounter [-] [103279] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:13:02.058580 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi [None req-1ab64e32-cb82-425c-bae5-42278de6f560 admin admin] Calling method '>' {{(pid=103279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:13:02.075419 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: INFO nova.api.openstack.requestlog [None req-1ab64e32-cb82-425c-bae5-42278de6f560 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.068561 May 24 15:13:02.075966 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: [pid: 103279|app: 0|req: 18/37] 10.222.0.45 () {60 vars in 1291 bytes} [Tue May 24 15:13:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:13:03.053271 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi [None req-ecc68bb4-8851-421b-8a35-43b8ca7c6e71 admin admin] Calling method '>' {{(pid=103280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:13:03.054317 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: INFO nova.api.openstack.requestlog [None req-ecc68bb4-8851-421b-8a35-43b8ca7c6e71 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 May 24 15:13:03.054713 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: [pid: 103280|app: 0|req: 20/38] 10.222.0.45 () {56 vars in 1074 bytes} [Tue May 24 15:13:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:13:03.253179 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi [None req-aacb24b4-e243-4972-9ac8-eb1acbb59148 admin admin] Calling method '>' {{(pid=103279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:13:03.258974 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: INFO nova.api.openstack.wsgi [None req-aacb24b4-e243-4972-9ac8-eb1acbb59148 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 24 15:13:03.262237 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi [None req-aacb24b4-e243-4972-9ac8-eb1acbb59148 admin admin] Request method failure captured: May 24 15:13:03.262237 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 24 15:13:03.262237 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: Accept: application/json May 24 15:13:03.262237 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: Accept-Encoding: gzip, deflate May 24 15:13:03.262237 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: Connection: keep-alive May 24 15:13:03.262237 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: Content-Length: 0 May 24 15:13:03.262237 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: Host: 10.222.0.45 May 24 15:13:03.262237 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: Openstack-Api-Version: compute 2.90 May 24 15:13:03.262237 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: Openstack-System-Scope: None May 24 15:13:03.262237 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: User-Agent: python-novaclient May 24 15:13:03.262237 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: X-Auth-Token: gAAAAABijPX_fWd_HJ1bFBx6P0aJS5ca1HrgqCCH350fXuVNvIunGTO2tQw37UhP0CcjQ7T_WzMdis47P2K918MsX7v7MK0wJ1HPYRTg1HZhin6iqoZK4XJuyC-q-uUjBtCoUXr6_Nlf2sbca6dFJ_Czhx9Ar7ldc7pDZT_5IAzuOYDXdEPgdMQ May 24 15:13:03.262237 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: X-Domain-Id: None May 24 15:13:03.262237 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: X-Domain-Name: None May 24 15:13:03.262237 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: X-Identity-Status: Confirmed May 24 15:13:03.262237 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: X-Is-Admin-Project: True May 24 15:13:03.262237 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: X-Openstack-Nova-Api-Version: 2.90 May 24 15:13:03.262237 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: X-Project-Domain-Id: default May 24 15:13:03.262237 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: X-Project-Domain-Name: Default May 24 15:13:03.262237 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: X-Project-Id: afcdba301526446ba48fe1e8c0bb21bc May 24 15:13:03.262237 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: X-Project-Name: admin May 24 15:13:03.262237 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: X-Role: reader,admin,member May 24 15:13:03.262237 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: X-Roles: reader,admin,member May 24 15:13:03.263848 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/afcdba301526446ba48fe1e8c0bb21bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/afcdba301526446ba48fe1e8c0bb21bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/afcdba301526446ba48fe1e8c0bb21bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_afcdba301526446ba48fe1e8c0bb21bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 24 15:13:03.263848 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: X-Tenant: admin May 24 15:13:03.263848 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: X-Tenant-Id: afcdba301526446ba48fe1e8c0bb21bc May 24 15:13:03.263848 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: X-Tenant-Name: admin May 24 15:13:03.263848 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: X-User: admin May 24 15:13:03.263848 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: X-User-Domain-Id: default May 24 15:13:03.263848 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: X-User-Domain-Name: Default May 24 15:13:03.263848 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: X-User-Id: 3a944101ee294a37aa42cee1133a9032 May 24 15:13:03.263848 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: X-User-Name: admin May 24 15:13:03.263848 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: method: > May 24 15:13:03.263848 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: exception: Flavor 42 could not be found. May 24 15:13:03.263848 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: action_args: {'id': '42'} May 24 15:13:03.263848 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: {{(pid=103279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:13:03.263848 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:13:03.264771 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 24 15:13:03.264771 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 24 15:13:03.264771 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 24 15:13:03.264771 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 24 15:13:03.264771 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 24 15:13:03.264771 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 24 15:13:03.264771 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 24 15:13:03.264771 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 24 15:13:03.264771 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 24 15:13:03.264771 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:13:03.264771 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 24 15:13:03.264771 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 24 15:13:03.264771 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 24 15:13:03.264771 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi May 24 15:13:03.264771 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:13:03.264771 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi May 24 15:13:03.264771 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:13:03.264771 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:13:03.264771 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:13:03.266267 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:13:03.266267 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:13:03.266267 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:13:03.266267 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:13:03.266267 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 24 15:13:03.266267 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 24 15:13:03.266267 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 24 15:13:03.266267 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi May 24 15:13:03.266267 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:13:03.266267 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi May 24 15:13:03.266267 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:13:03.266267 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:13:03.266267 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:13:03.266267 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:13:03.266267 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:13:03.266267 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 24 15:13:03.266267 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi May 24 15:13:03.266267 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi [None req-aacb24b4-e243-4972-9ac8-eb1acbb59148 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103279) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:13:03.268036 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: INFO nova.api.openstack.requestlog [None req-aacb24b4-e243-4972-9ac8-eb1acbb59148 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.061438 May 24 15:13:03.268036 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: [pid: 103279|app: 0|req: 19/39] 10.222.0.45 () {60 vars in 1190 bytes} [Tue May 24 15:13:03 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 24 15:13:03.273850 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi [None req-e56fde5f-60e7-4c5e-aded-72a5f54d5b2e admin admin] Calling method '>' {{(pid=103280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:13:03.276839 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG dbcounter [-] [103280] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:13:03.296916 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: INFO nova.api.openstack.requestlog [None req-e56fde5f-60e7-4c5e-aded-72a5f54d5b2e admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026685 May 24 15:13:03.297472 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: [pid: 103280|app: 0|req: 21/40] 10.222.0.45 () {60 vars in 1210 bytes} [Tue May 24 15:13:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:13:03.306924 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi [None req-6f3bb8c9-ef5c-4544-b11c-033763a434a5 admin admin] Calling method '>' {{(pid=103279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:13:03.327835 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: INFO nova.api.openstack.requestlog [None req-6f3bb8c9-ef5c-4544-b11c-033763a434a5 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024468 May 24 15:13:03.328377 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: [pid: 103279|app: 0|req: 20/41] 10.222.0.45 () {60 vars in 1210 bytes} [Tue May 24 15:13:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:13:03.337870 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi [None req-fee8f05a-96a4-4386-8e9e-65be472c4658 admin admin] Calling method '>' {{(pid=103280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:13:03.343987 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: INFO nova.api.openstack.wsgi [None req-fee8f05a-96a4-4386-8e9e-65be472c4658 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 24 15:13:03.347882 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi [None req-fee8f05a-96a4-4386-8e9e-65be472c4658 admin admin] Request method failure captured: May 24 15:13:03.347882 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 24 15:13:03.347882 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: Accept: application/json May 24 15:13:03.347882 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: Accept-Encoding: gzip, deflate May 24 15:13:03.347882 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: Connection: keep-alive May 24 15:13:03.347882 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: Content-Length: 0 May 24 15:13:03.347882 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: Host: 10.222.0.45 May 24 15:13:03.347882 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: Openstack-Api-Version: compute 2.90 May 24 15:13:03.347882 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: Openstack-System-Scope: None May 24 15:13:03.347882 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: User-Agent: python-novaclient May 24 15:13:03.347882 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: X-Auth-Token: gAAAAABijPX_fWd_HJ1bFBx6P0aJS5ca1HrgqCCH350fXuVNvIunGTO2tQw37UhP0CcjQ7T_WzMdis47P2K918MsX7v7MK0wJ1HPYRTg1HZhin6iqoZK4XJuyC-q-uUjBtCoUXr6_Nlf2sbca6dFJ_Czhx9Ar7ldc7pDZT_5IAzuOYDXdEPgdMQ May 24 15:13:03.347882 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: X-Domain-Id: None May 24 15:13:03.347882 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: X-Domain-Name: None May 24 15:13:03.347882 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: X-Identity-Status: Confirmed May 24 15:13:03.347882 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: X-Is-Admin-Project: True May 24 15:13:03.347882 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: X-Openstack-Nova-Api-Version: 2.90 May 24 15:13:03.347882 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: X-Project-Domain-Id: default May 24 15:13:03.347882 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: X-Project-Domain-Name: Default May 24 15:13:03.347882 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: X-Project-Id: afcdba301526446ba48fe1e8c0bb21bc May 24 15:13:03.347882 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: X-Project-Name: admin May 24 15:13:03.347882 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: X-Role: reader,admin,member May 24 15:13:03.347882 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: X-Roles: reader,admin,member May 24 15:13:03.349485 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/afcdba301526446ba48fe1e8c0bb21bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/afcdba301526446ba48fe1e8c0bb21bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/afcdba301526446ba48fe1e8c0bb21bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_afcdba301526446ba48fe1e8c0bb21bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 24 15:13:03.349485 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: X-Tenant: admin May 24 15:13:03.349485 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: X-Tenant-Id: afcdba301526446ba48fe1e8c0bb21bc May 24 15:13:03.349485 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: X-Tenant-Name: admin May 24 15:13:03.349485 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: X-User: admin May 24 15:13:03.349485 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: X-User-Domain-Id: default May 24 15:13:03.349485 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: X-User-Domain-Name: Default May 24 15:13:03.349485 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: X-User-Id: 3a944101ee294a37aa42cee1133a9032 May 24 15:13:03.349485 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: X-User-Name: admin May 24 15:13:03.349485 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: method: > May 24 15:13:03.349485 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: exception: Flavor 42 could not be found. May 24 15:13:03.349485 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: action_args: {'id': '42'} May 24 15:13:03.349485 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: {{(pid=103280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:13:03.349485 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:13:03.350449 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 24 15:13:03.350449 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 24 15:13:03.350449 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 24 15:13:03.350449 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 24 15:13:03.350449 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 24 15:13:03.350449 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 24 15:13:03.350449 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 24 15:13:03.350449 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 24 15:13:03.350449 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 24 15:13:03.350449 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:13:03.350449 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 24 15:13:03.350449 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 24 15:13:03.350449 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 24 15:13:03.350449 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi May 24 15:13:03.350449 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:13:03.350449 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi May 24 15:13:03.350449 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:13:03.350449 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:13:03.350449 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:13:03.351744 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:13:03.351744 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:13:03.351744 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:13:03.351744 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:13:03.351744 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 24 15:13:03.351744 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 24 15:13:03.351744 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 24 15:13:03.351744 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi May 24 15:13:03.351744 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:13:03.351744 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi May 24 15:13:03.351744 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:13:03.351744 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:13:03.351744 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:13:03.351744 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:13:03.351744 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:13:03.351744 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 24 15:13:03.351744 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi May 24 15:13:03.351744 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi [None req-fee8f05a-96a4-4386-8e9e-65be472c4658 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:13:03.353008 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: INFO nova.api.openstack.requestlog [None req-fee8f05a-96a4-4386-8e9e-65be472c4658 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014937 May 24 15:13:03.353008 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: [pid: 103280|app: 0|req: 22/42] 10.222.0.45 () {60 vars in 1190 bytes} [Tue May 24 15:13:03 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 24 15:13:04.278685 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi [None req-6f3bb8c9-ef5c-4544-b11c-033763a434a5 admin admin] Calling method '>' {{(pid=103279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:13:04.279721 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: INFO nova.api.openstack.requestlog [None req-6f3bb8c9-ef5c-4544-b11c-033763a434a5 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 May 24 15:13:04.280112 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: [pid: 103279|app: 0|req: 21/43] 10.222.0.45 () {56 vars in 1074 bytes} [Tue May 24 15:13:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:13:04.490101 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi [None req-60becc20-445d-48bf-960e-8fde415120de admin admin] Calling method '>' {{(pid=103280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:13:04.495351 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: INFO nova.api.openstack.wsgi [None req-60becc20-445d-48bf-960e-8fde415120de admin admin] HTTP exception thrown: Flavor 84 could not be found. May 24 15:13:04.496883 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi [None req-60becc20-445d-48bf-960e-8fde415120de admin admin] Request method failure captured: May 24 15:13:04.496883 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 24 15:13:04.496883 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: Accept: application/json May 24 15:13:04.496883 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: Accept-Encoding: gzip, deflate May 24 15:13:04.496883 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: Connection: keep-alive May 24 15:13:04.496883 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: Content-Length: 0 May 24 15:13:04.496883 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: Host: 10.222.0.45 May 24 15:13:04.496883 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: Openstack-Api-Version: compute 2.90 May 24 15:13:04.496883 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: Openstack-System-Scope: None May 24 15:13:04.496883 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: User-Agent: python-novaclient May 24 15:13:04.496883 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: X-Auth-Token: gAAAAABijPYAOj74YKzdKMM_JxMqxoRL6SNc3lW5X0h3SkCuHQNhIrL9o0NxfGAp33mHivJh82wPyPe7iPA79JafnzIszWJrgkgIcZapyiq_ebEmiY5H7srNW0wm_yQW1oxv7_8Mh-kixRd_J7DuiqlAsuWFsG8ZOwK4WUkJCiXVhY3TxNXq9PM May 24 15:13:04.496883 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: X-Domain-Id: None May 24 15:13:04.496883 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: X-Domain-Name: None May 24 15:13:04.496883 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: X-Identity-Status: Confirmed May 24 15:13:04.496883 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: X-Is-Admin-Project: True May 24 15:13:04.496883 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: X-Openstack-Nova-Api-Version: 2.90 May 24 15:13:04.496883 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: X-Project-Domain-Id: default May 24 15:13:04.496883 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: X-Project-Domain-Name: Default May 24 15:13:04.496883 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: X-Project-Id: afcdba301526446ba48fe1e8c0bb21bc May 24 15:13:04.496883 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: X-Project-Name: admin May 24 15:13:04.496883 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: X-Role: reader,admin,member May 24 15:13:04.496883 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: X-Roles: reader,admin,member May 24 15:13:04.498440 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/afcdba301526446ba48fe1e8c0bb21bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/afcdba301526446ba48fe1e8c0bb21bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/afcdba301526446ba48fe1e8c0bb21bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_afcdba301526446ba48fe1e8c0bb21bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 24 15:13:04.498440 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: X-Tenant: admin May 24 15:13:04.498440 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: X-Tenant-Id: afcdba301526446ba48fe1e8c0bb21bc May 24 15:13:04.498440 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: X-Tenant-Name: admin May 24 15:13:04.498440 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: X-User: admin May 24 15:13:04.498440 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: X-User-Domain-Id: default May 24 15:13:04.498440 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: X-User-Domain-Name: Default May 24 15:13:04.498440 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: X-User-Id: 3a944101ee294a37aa42cee1133a9032 May 24 15:13:04.498440 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: X-User-Name: admin May 24 15:13:04.498440 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: method: > May 24 15:13:04.498440 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: exception: Flavor 84 could not be found. May 24 15:13:04.498440 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: action_args: {'id': '84'} May 24 15:13:04.498440 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: {{(pid=103280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:13:04.498440 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:13:04.499401 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 24 15:13:04.499401 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 24 15:13:04.499401 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 24 15:13:04.499401 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 24 15:13:04.499401 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 24 15:13:04.499401 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 24 15:13:04.499401 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 24 15:13:04.499401 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 24 15:13:04.499401 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 24 15:13:04.499401 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:13:04.499401 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 24 15:13:04.499401 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 24 15:13:04.499401 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 24 15:13:04.499401 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi May 24 15:13:04.499401 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:13:04.499401 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi May 24 15:13:04.499401 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:13:04.499401 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:13:04.499401 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:13:04.500463 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:13:04.500463 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:13:04.500463 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:13:04.500463 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:13:04.500463 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 24 15:13:04.500463 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 24 15:13:04.500463 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 24 15:13:04.500463 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi May 24 15:13:04.500463 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:13:04.500463 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi May 24 15:13:04.500463 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:13:04.500463 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:13:04.500463 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:13:04.500463 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:13:04.500463 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:13:04.500463 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 24 15:13:04.500463 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi May 24 15:13:04.500463 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi [None req-60becc20-445d-48bf-960e-8fde415120de admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:13:04.501611 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: INFO nova.api.openstack.requestlog [None req-60becc20-445d-48bf-960e-8fde415120de admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060589 May 24 15:13:04.501611 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: [pid: 103280|app: 0|req: 23/44] 10.222.0.45 () {60 vars in 1190 bytes} [Tue May 24 15:13:04 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 24 15:13:04.507955 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi [None req-55b2d81a-985a-46f4-b995-524ebd1590c9 admin admin] Calling method '>' {{(pid=103279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:13:04.523017 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: INFO nova.api.openstack.requestlog [None req-55b2d81a-985a-46f4-b995-524ebd1590c9 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018625 May 24 15:13:04.523544 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: [pid: 103279|app: 0|req: 22/45] 10.222.0.45 () {60 vars in 1210 bytes} [Tue May 24 15:13:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:13:04.533597 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi [None req-c275c4dc-a321-4e7d-a659-06b236c1e180 admin admin] Calling method '>' {{(pid=103280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:13:04.547760 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: INFO nova.api.openstack.requestlog [None req-c275c4dc-a321-4e7d-a659-06b236c1e180 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018223 May 24 15:13:04.548929 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: [pid: 103280|app: 0|req: 24/46] 10.222.0.45 () {60 vars in 1210 bytes} [Tue May 24 15:13:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:13:04.558260 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi [None req-b3360636-ef7c-47c5-88c0-fb40dff6ac58 admin admin] Calling method '>' {{(pid=103279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:13:04.563659 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: INFO nova.api.openstack.wsgi [None req-b3360636-ef7c-47c5-88c0-fb40dff6ac58 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 24 15:13:04.565302 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi [None req-b3360636-ef7c-47c5-88c0-fb40dff6ac58 admin admin] Request method failure captured: May 24 15:13:04.565302 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 24 15:13:04.565302 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: Accept: application/json May 24 15:13:04.565302 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: Accept-Encoding: gzip, deflate May 24 15:13:04.565302 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: Connection: keep-alive May 24 15:13:04.565302 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: Content-Length: 0 May 24 15:13:04.565302 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: Host: 10.222.0.45 May 24 15:13:04.565302 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: Openstack-Api-Version: compute 2.90 May 24 15:13:04.565302 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: Openstack-System-Scope: None May 24 15:13:04.565302 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: User-Agent: python-novaclient May 24 15:13:04.565302 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: X-Auth-Token: gAAAAABijPYAOj74YKzdKMM_JxMqxoRL6SNc3lW5X0h3SkCuHQNhIrL9o0NxfGAp33mHivJh82wPyPe7iPA79JafnzIszWJrgkgIcZapyiq_ebEmiY5H7srNW0wm_yQW1oxv7_8Mh-kixRd_J7DuiqlAsuWFsG8ZOwK4WUkJCiXVhY3TxNXq9PM May 24 15:13:04.565302 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: X-Domain-Id: None May 24 15:13:04.565302 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: X-Domain-Name: None May 24 15:13:04.565302 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: X-Identity-Status: Confirmed May 24 15:13:04.565302 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: X-Is-Admin-Project: True May 24 15:13:04.565302 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: X-Openstack-Nova-Api-Version: 2.90 May 24 15:13:04.565302 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: X-Project-Domain-Id: default May 24 15:13:04.565302 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: X-Project-Domain-Name: Default May 24 15:13:04.565302 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: X-Project-Id: afcdba301526446ba48fe1e8c0bb21bc May 24 15:13:04.565302 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: X-Project-Name: admin May 24 15:13:04.565302 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: X-Role: reader,admin,member May 24 15:13:04.565302 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: X-Roles: reader,admin,member May 24 15:13:04.566777 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/afcdba301526446ba48fe1e8c0bb21bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/afcdba301526446ba48fe1e8c0bb21bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/afcdba301526446ba48fe1e8c0bb21bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_afcdba301526446ba48fe1e8c0bb21bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 24 15:13:04.566777 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: X-Tenant: admin May 24 15:13:04.566777 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: X-Tenant-Id: afcdba301526446ba48fe1e8c0bb21bc May 24 15:13:04.566777 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: X-Tenant-Name: admin May 24 15:13:04.566777 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: X-User: admin May 24 15:13:04.566777 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: X-User-Domain-Id: default May 24 15:13:04.566777 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: X-User-Domain-Name: Default May 24 15:13:04.566777 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: X-User-Id: 3a944101ee294a37aa42cee1133a9032 May 24 15:13:04.566777 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: X-User-Name: admin May 24 15:13:04.566777 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: method: > May 24 15:13:04.566777 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: exception: Flavor 84 could not be found. May 24 15:13:04.566777 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: action_args: {'id': '84'} May 24 15:13:04.566777 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: {{(pid=103279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:13:04.566777 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:13:04.567677 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 24 15:13:04.567677 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 24 15:13:04.567677 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 24 15:13:04.567677 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 24 15:13:04.567677 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 24 15:13:04.567677 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 24 15:13:04.567677 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 24 15:13:04.567677 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 24 15:13:04.567677 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 24 15:13:04.567677 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:13:04.567677 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 24 15:13:04.567677 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 24 15:13:04.567677 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 24 15:13:04.567677 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi May 24 15:13:04.567677 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:13:04.567677 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi May 24 15:13:04.567677 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:13:04.567677 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:13:04.567677 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:13:04.568839 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:13:04.568839 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:13:04.568839 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:13:04.568839 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:13:04.568839 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 24 15:13:04.568839 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 24 15:13:04.568839 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 24 15:13:04.568839 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi May 24 15:13:04.568839 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:13:04.568839 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi May 24 15:13:04.568839 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:13:04.568839 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:13:04.568839 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:13:04.568839 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:13:04.568839 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:13:04.568839 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 24 15:13:04.568839 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi May 24 15:13:04.568839 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi [None req-b3360636-ef7c-47c5-88c0-fb40dff6ac58 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103279) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:13:04.569853 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: INFO nova.api.openstack.requestlog [None req-b3360636-ef7c-47c5-88c0-fb40dff6ac58 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011929 May 24 15:13:04.569853 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: [pid: 103279|app: 0|req: 23/47] 10.222.0.45 () {60 vars in 1190 bytes} [Tue May 24 15:13:04 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 24 15:13:05.495889 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi [None req-c275c4dc-a321-4e7d-a659-06b236c1e180 admin admin] Calling method '>' {{(pid=103280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:13:05.496933 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: INFO nova.api.openstack.requestlog [None req-c275c4dc-a321-4e7d-a659-06b236c1e180 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 May 24 15:13:05.497318 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: [pid: 103280|app: 0|req: 25/48] 10.222.0.45 () {56 vars in 1074 bytes} [Tue May 24 15:13:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:13:05.682556 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi [None req-984f79e3-e0f2-4822-8eb6-816f1b8c5371 admin admin] Calling method '>' {{(pid=103279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:13:05.688355 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: INFO nova.api.openstack.wsgi [None req-984f79e3-e0f2-4822-8eb6-816f1b8c5371 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 24 15:13:05.690493 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi [None req-984f79e3-e0f2-4822-8eb6-816f1b8c5371 admin admin] Request method failure captured: May 24 15:13:05.690493 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 24 15:13:05.690493 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: Accept: application/json May 24 15:13:05.690493 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: Accept-Encoding: gzip, deflate May 24 15:13:05.690493 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: Connection: keep-alive May 24 15:13:05.690493 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: Content-Length: 0 May 24 15:13:05.690493 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: Host: 10.222.0.45 May 24 15:13:05.690493 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: Openstack-Api-Version: compute 2.90 May 24 15:13:05.690493 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: Openstack-System-Scope: None May 24 15:13:05.690493 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: User-Agent: python-novaclient May 24 15:13:05.690493 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: X-Auth-Token: gAAAAABijPYB6AdcKMY2LtQwh_E0M_4LZ0FA_RvwvIiS2qYk9gFCWQJAH75csY0B4Cmuc8dN2fC70kp1DpIjIr9_A1NI-ArledCZSukhdu3Wx4YU9u3JPUsCwJhaI2-0xn2u0E75y5TFB0GPu0C2t6kvZRsHQRl-rIbHrYMEkfjmUju7izOzGlo May 24 15:13:05.690493 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: X-Domain-Id: None May 24 15:13:05.690493 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: X-Domain-Name: None May 24 15:13:05.690493 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: X-Identity-Status: Confirmed May 24 15:13:05.690493 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: X-Is-Admin-Project: True May 24 15:13:05.690493 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: X-Openstack-Nova-Api-Version: 2.90 May 24 15:13:05.690493 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: X-Project-Domain-Id: default May 24 15:13:05.690493 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: X-Project-Domain-Name: Default May 24 15:13:05.690493 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: X-Project-Id: afcdba301526446ba48fe1e8c0bb21bc May 24 15:13:05.690493 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: X-Project-Name: admin May 24 15:13:05.690493 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: X-Role: reader,admin,member May 24 15:13:05.690493 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: X-Roles: reader,admin,member May 24 15:13:05.691996 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/afcdba301526446ba48fe1e8c0bb21bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/afcdba301526446ba48fe1e8c0bb21bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/afcdba301526446ba48fe1e8c0bb21bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_afcdba301526446ba48fe1e8c0bb21bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 24 15:13:05.691996 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: X-Tenant: admin May 24 15:13:05.691996 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: X-Tenant-Id: afcdba301526446ba48fe1e8c0bb21bc May 24 15:13:05.691996 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: X-Tenant-Name: admin May 24 15:13:05.691996 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: X-User: admin May 24 15:13:05.691996 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: X-User-Domain-Id: default May 24 15:13:05.691996 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: X-User-Domain-Name: Default May 24 15:13:05.691996 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: X-User-Id: 3a944101ee294a37aa42cee1133a9032 May 24 15:13:05.691996 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: X-User-Name: admin May 24 15:13:05.691996 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: method: > May 24 15:13:05.691996 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: exception: Flavor 451 could not be found. May 24 15:13:05.691996 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: action_args: {'id': '451'} May 24 15:13:05.691996 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: {{(pid=103279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:13:05.691996 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:13:05.692976 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 24 15:13:05.692976 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 24 15:13:05.692976 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 24 15:13:05.692976 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 24 15:13:05.692976 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 24 15:13:05.692976 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 24 15:13:05.692976 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 24 15:13:05.692976 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 24 15:13:05.692976 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 24 15:13:05.692976 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:13:05.692976 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 24 15:13:05.692976 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 24 15:13:05.692976 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 24 15:13:05.692976 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi May 24 15:13:05.692976 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:13:05.692976 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi May 24 15:13:05.692976 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:13:05.692976 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:13:05.692976 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:13:05.694120 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:13:05.694120 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:13:05.694120 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:13:05.694120 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:13:05.694120 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 24 15:13:05.694120 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 24 15:13:05.694120 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 24 15:13:05.694120 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi May 24 15:13:05.694120 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:13:05.694120 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi May 24 15:13:05.694120 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:13:05.694120 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:13:05.694120 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:13:05.694120 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:13:05.694120 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:13:05.694120 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 24 15:13:05.694120 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: ERROR nova.api.openstack.wsgi May 24 15:13:05.694120 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi [None req-984f79e3-e0f2-4822-8eb6-816f1b8c5371 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103279) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:13:05.695111 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: INFO nova.api.openstack.requestlog [None req-984f79e3-e0f2-4822-8eb6-816f1b8c5371 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060432 May 24 15:13:05.695111 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: [pid: 103279|app: 0|req: 24/49] 10.222.0.45 () {60 vars in 1193 bytes} [Tue May 24 15:13:05 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 24 15:13:05.704063 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi [None req-cfbb4bed-df54-4cd4-8529-fbe2d593a06f admin admin] Calling method '>' {{(pid=103280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:13:05.718682 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: INFO nova.api.openstack.requestlog [None req-cfbb4bed-df54-4cd4-8529-fbe2d593a06f admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020296 May 24 15:13:05.719531 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: [pid: 103280|app: 0|req: 26/50] 10.222.0.45 () {60 vars in 1210 bytes} [Tue May 24 15:13:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:13:05.729333 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi [None req-1211d29a-0d20-45d2-884c-a51539035d82 admin admin] Calling method '>' {{(pid=103279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:13:05.743834 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: INFO nova.api.openstack.requestlog [None req-1211d29a-0d20-45d2-884c-a51539035d82 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018075 May 24 15:13:05.744376 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: [pid: 103279|app: 0|req: 25/51] 10.222.0.45 () {60 vars in 1210 bytes} [Tue May 24 15:13:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:13:05.754072 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi [None req-f85cb847-8c5d-4220-806e-a6380e6177e0 admin admin] Calling method '>' {{(pid=103280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:13:05.759360 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: INFO nova.api.openstack.wsgi [None req-f85cb847-8c5d-4220-806e-a6380e6177e0 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 24 15:13:05.760889 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi [None req-f85cb847-8c5d-4220-806e-a6380e6177e0 admin admin] Request method failure captured: May 24 15:13:05.760889 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 24 15:13:05.760889 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: Accept: application/json May 24 15:13:05.760889 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: Accept-Encoding: gzip, deflate May 24 15:13:05.760889 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: Connection: keep-alive May 24 15:13:05.760889 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: Content-Length: 0 May 24 15:13:05.760889 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: Host: 10.222.0.45 May 24 15:13:05.760889 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: Openstack-Api-Version: compute 2.90 May 24 15:13:05.760889 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: Openstack-System-Scope: None May 24 15:13:05.760889 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: User-Agent: python-novaclient May 24 15:13:05.760889 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: X-Auth-Token: gAAAAABijPYB6AdcKMY2LtQwh_E0M_4LZ0FA_RvwvIiS2qYk9gFCWQJAH75csY0B4Cmuc8dN2fC70kp1DpIjIr9_A1NI-ArledCZSukhdu3Wx4YU9u3JPUsCwJhaI2-0xn2u0E75y5TFB0GPu0C2t6kvZRsHQRl-rIbHrYMEkfjmUju7izOzGlo May 24 15:13:05.760889 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: X-Domain-Id: None May 24 15:13:05.760889 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: X-Domain-Name: None May 24 15:13:05.760889 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: X-Identity-Status: Confirmed May 24 15:13:05.760889 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: X-Is-Admin-Project: True May 24 15:13:05.760889 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: X-Openstack-Nova-Api-Version: 2.90 May 24 15:13:05.760889 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: X-Project-Domain-Id: default May 24 15:13:05.760889 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: X-Project-Domain-Name: Default May 24 15:13:05.760889 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: X-Project-Id: afcdba301526446ba48fe1e8c0bb21bc May 24 15:13:05.760889 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: X-Project-Name: admin May 24 15:13:05.760889 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: X-Role: reader,admin,member May 24 15:13:05.760889 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: X-Roles: reader,admin,member May 24 15:13:05.762594 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/afcdba301526446ba48fe1e8c0bb21bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/afcdba301526446ba48fe1e8c0bb21bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/afcdba301526446ba48fe1e8c0bb21bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_afcdba301526446ba48fe1e8c0bb21bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 24 15:13:05.762594 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: X-Tenant: admin May 24 15:13:05.762594 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: X-Tenant-Id: afcdba301526446ba48fe1e8c0bb21bc May 24 15:13:05.762594 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: X-Tenant-Name: admin May 24 15:13:05.762594 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: X-User: admin May 24 15:13:05.762594 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: X-User-Domain-Id: default May 24 15:13:05.762594 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: X-User-Domain-Name: Default May 24 15:13:05.762594 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: X-User-Id: 3a944101ee294a37aa42cee1133a9032 May 24 15:13:05.762594 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: X-User-Name: admin May 24 15:13:05.762594 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: method: > May 24 15:13:05.762594 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: exception: Flavor 451 could not be found. May 24 15:13:05.762594 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: action_args: {'id': '451'} May 24 15:13:05.762594 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: {{(pid=103280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:13:05.762594 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:13:05.763734 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 24 15:13:05.763734 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 24 15:13:05.763734 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 24 15:13:05.763734 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 24 15:13:05.763734 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 24 15:13:05.763734 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 24 15:13:05.763734 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 24 15:13:05.763734 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 24 15:13:05.763734 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 24 15:13:05.763734 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:13:05.763734 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 24 15:13:05.763734 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 24 15:13:05.763734 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 24 15:13:05.763734 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi May 24 15:13:05.763734 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:13:05.763734 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi May 24 15:13:05.763734 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:13:05.763734 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:13:05.763734 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:13:05.765164 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:13:05.765164 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:13:05.765164 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:13:05.765164 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:13:05.765164 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 24 15:13:05.765164 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 24 15:13:05.765164 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 24 15:13:05.765164 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi May 24 15:13:05.765164 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:13:05.765164 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi May 24 15:13:05.765164 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:13:05.765164 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:13:05.765164 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:13:05.765164 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:13:05.765164 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:13:05.765164 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 24 15:13:05.765164 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: ERROR nova.api.openstack.wsgi May 24 15:13:05.765164 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi [None req-f85cb847-8c5d-4220-806e-a6380e6177e0 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:13:05.766471 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: INFO nova.api.openstack.requestlog [None req-f85cb847-8c5d-4220-806e-a6380e6177e0 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012327 May 24 15:13:05.766471 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: [pid: 103280|app: 0|req: 27/52] 10.222.0.45 () {60 vars in 1193 bytes} [Tue May 24 15:13:05 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 24 15:13:06.617693 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi [None req-1211d29a-0d20-45d2-884c-a51539035d82 admin admin] Calling method '>' {{(pid=103279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:13:06.618708 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: INFO nova.api.openstack.requestlog [None req-1211d29a-0d20-45d2-884c-a51539035d82 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 May 24 15:13:06.619104 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: [pid: 103279|app: 0|req: 26/53] 10.222.0.45 () {56 vars in 1074 bytes} [Tue May 24 15:13:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:13:06.811912 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi [None req-0aea9da1-fbe5-4761-9c79-84711e91643f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:13:06.830145 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: INFO nova.api.openstack.requestlog [None req-0aea9da1-fbe5-4761-9c79-84711e91643f admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.070528 May 24 15:13:06.830594 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: [pid: 103280|app: 0|req: 28/54] 10.222.0.45 () {64 vars in 1235 bytes} [Tue May 24 15:13:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:13:07.691803 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi [None req-1211d29a-0d20-45d2-884c-a51539035d82 admin admin] Calling method '>' {{(pid=103279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:13:07.692826 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: INFO nova.api.openstack.requestlog [None req-1211d29a-0d20-45d2-884c-a51539035d82 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 May 24 15:13:07.693221 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: [pid: 103279|app: 0|req: 27/55] 10.222.0.45 () {56 vars in 1074 bytes} [Tue May 24 15:13:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:13:07.881130 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi [None req-270e7a37-3e15-46b0-ac5a-68df273a7d72 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:13:07.897700 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: INFO nova.api.openstack.requestlog [None req-270e7a37-3e15-46b0-ac5a-68df273a7d72 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.067927 May 24 15:13:07.898244 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: [pid: 103280|app: 0|req: 29/56] 10.222.0.45 () {64 vars in 1235 bytes} [Tue May 24 15:13:07 2022] POST /compute/v2.1/flavors => generated 405 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:13:08.764257 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi [None req-1211d29a-0d20-45d2-884c-a51539035d82 admin admin] Calling method '>' {{(pid=103279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:13:08.765285 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: INFO nova.api.openstack.requestlog [None req-1211d29a-0d20-45d2-884c-a51539035d82 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 May 24 15:13:08.765678 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: [pid: 103279|app: 0|req: 28/57] 10.222.0.45 () {56 vars in 1074 bytes} [Tue May 24 15:13:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:13:08.950565 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi [None req-50da30b2-a7a7-4e81-be9e-281056730450 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:13:08.968493 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: INFO nova.api.openstack.requestlog [None req-50da30b2-a7a7-4e81-be9e-281056730450 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.068788 May 24 15:13:08.969041 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: [pid: 103280|app: 0|req: 30/58] 10.222.0.45 () {64 vars in 1235 bytes} [Tue May 24 15:13:08 2022] POST /compute/v2.1/flavors => generated 407 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:13:09.820005 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi [None req-1211d29a-0d20-45d2-884c-a51539035d82 admin admin] Calling method '>' {{(pid=103279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:13:09.821075 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: INFO nova.api.openstack.requestlog [None req-1211d29a-0d20-45d2-884c-a51539035d82 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 May 24 15:13:09.821471 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: [pid: 103279|app: 0|req: 29/59] 10.222.0.45 () {56 vars in 1074 bytes} [Tue May 24 15:13:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:13:10.010630 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi [None req-26335efc-c10e-49ae-98d2-cfa8c50cdbb5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:13:10.028720 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: INFO nova.api.openstack.requestlog [None req-26335efc-c10e-49ae-98d2-cfa8c50cdbb5 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.069087 May 24 15:13:10.029255 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: [pid: 103280|app: 0|req: 31/60] 10.222.0.45 () {64 vars in 1235 bytes} [Tue May 24 15:13:09 2022] POST /compute/v2.1/flavors => generated 409 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:13:10.916850 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi [None req-1211d29a-0d20-45d2-884c-a51539035d82 admin admin] Calling method '>' {{(pid=103279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:13:10.917851 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: INFO nova.api.openstack.requestlog [None req-1211d29a-0d20-45d2-884c-a51539035d82 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 May 24 15:13:10.918246 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: [pid: 103279|app: 0|req: 30/61] 10.222.0.45 () {56 vars in 1074 bytes} [Tue May 24 15:13:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:13:11.105045 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi [None req-5a1d2c7e-5710-4acd-a24e-9c8768868a97 admin admin] Calling method '>' {{(pid=103280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:13:11.124695 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: INFO nova.api.openstack.requestlog [None req-5a1d2c7e-5710-4acd-a24e-9c8768868a97 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070831 May 24 15:13:11.125170 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: [pid: 103280|app: 0|req: 32/62] 10.222.0.45 () {60 vars in 1202 bytes} [Tue May 24 15:13:11 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:14:12.469486 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi [None req-1211d29a-0d20-45d2-884c-a51539035d82 admin admin] Calling method '>' {{(pid=103279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:14:12.470494 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: INFO nova.api.openstack.requestlog [None req-1211d29a-0d20-45d2-884c-a51539035d82 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002086 May 24 15:14:12.470890 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: [pid: 103279|app: 0|req: 31/63] 10.222.0.45 () {54 vars in 930 bytes} [Tue May 24 15:14:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:14:12.478236 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG dbcounter [-] [103280] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:14:12.530026 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi [None req-2b077762-739f-4e16-9878-a11314e8722f admin admin] Calling method '>' {{(pid=103280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:14:12.548818 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: INFO nova.api.openstack.requestlog [None req-2b077762-739f-4e16-9878-a11314e8722f admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071988 May 24 15:14:12.549351 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: [pid: 103280|app: 0|req: 33/64] 10.222.0.45 () {60 vars in 1291 bytes} [Tue May 24 15:14:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:14:12.569827 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG dbcounter [-] [103279] Writing DB stats nova_api:SELECT=14 {{(pid=103279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:14:12.573698 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi [None req-4f93ad3d-5f24-448a-8718-d7f4034e4fc7 admin admin] Calling method '>' {{(pid=103279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:14:12.582226 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: INFO nova.api.openstack.requestlog [None req-4f93ad3d-5f24-448a-8718-d7f4034e4fc7 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013832 May 24 15:14:12.582741 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: [pid: 103279|app: 0|req: 32/65] 10.222.0.45 () {60 vars in 1282 bytes} [Tue May 24 15:14:12 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:14:12.593901 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi [None req-62d4e68f-da12-493b-bfbe-d3dbecbd7a8d admin admin] Calling method '>' {{(pid=103280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:14:12.601363 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: INFO nova.api.openstack.requestlog [None req-62d4e68f-da12-493b-bfbe-d3dbecbd7a8d admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010969 May 24 15:14:12.601871 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: [pid: 103280|app: 0|req: 34/66] 10.222.0.45 () {60 vars in 1285 bytes} [Tue May 24 15:14:12 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:14:12.613080 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi [None req-700c6778-e320-4a6e-b167-b4bbf9708a77 admin admin] Calling method '>' {{(pid=103279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:14:12.620347 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: INFO nova.api.openstack.requestlog [None req-700c6778-e320-4a6e-b167-b4bbf9708a77 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010736 May 24 15:14:12.620851 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: [pid: 103279|app: 0|req: 33/67] 10.222.0.45 () {60 vars in 1285 bytes} [Tue May 24 15:14:12 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:14:12.633285 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi [None req-80000ed9-cdbd-4e48-be17-adec61c94ae8 admin admin] Calling method '>' {{(pid=103280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:14:12.641258 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: INFO nova.api.openstack.requestlog [None req-80000ed9-cdbd-4e48-be17-adec61c94ae8 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010825 May 24 15:14:12.641770 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: [pid: 103280|app: 0|req: 35/68] 10.222.0.45 () {60 vars in 1282 bytes} [Tue May 24 15:14:12 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:17:53.429118 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi [None req-700c6778-e320-4a6e-b167-b4bbf9708a77 admin admin] Calling method '>' {{(pid=103279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:17:53.430117 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: INFO nova.api.openstack.requestlog [None req-700c6778-e320-4a6e-b167-b4bbf9708a77 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 May 24 15:17:53.430517 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: [pid: 103279|app: 0|req: 34/69] 10.222.0.45 () {56 vars in 1074 bytes} [Tue May 24 15:17:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:17:53.585352 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG dbcounter [-] [103280] Writing DB stats nova_api:SELECT=6 {{(pid=103280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:17:53.698214 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi [None req-18136b4f-a6aa-4bd7-a2a7-7fe264d0bed5 admin admin] Calling method '>' {{(pid=103280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:17:53.699367 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 15:17:53.699367 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: warnings.warn(msg) May 24 15:17:53.700660 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG oslo_concurrency.lockutils [None req-18136b4f-a6aa-4bd7-a2a7-7fe264d0bed5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:17:53.701096 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG oslo_concurrency.lockutils [None req-18136b4f-a6aa-4bd7-a2a7-7fe264d0bed5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:17:53.701867 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG oslo_concurrency.lockutils [None req-18136b4f-a6aa-4bd7-a2a7-7fe264d0bed5 admin admin] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:17:53.702289 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG oslo_concurrency.lockutils [None req-18136b4f-a6aa-4bd7-a2a7-7fe264d0bed5 admin admin] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:17:53.736233 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: INFO nova.api.openstack.requestlog [None req-18136b4f-a6aa-4bd7-a2a7-7fe264d0bed5 admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.152338 May 24 15:17:53.736810 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: [pid: 103280|app: 0|req: 36/70] 10.222.0.45 () {60 vars in 1193 bytes} [Tue May 24 15:17:53 2022] GET /compute/v2.1/os-services => generated 791 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:17:54.612907 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi [None req-700c6778-e320-4a6e-b167-b4bbf9708a77 admin admin] Calling method '>' {{(pid=103279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:17:54.613924 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: INFO nova.api.openstack.requestlog [None req-700c6778-e320-4a6e-b167-b4bbf9708a77 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 May 24 15:17:54.614324 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: [pid: 103279|app: 0|req: 35/71] 10.222.0.45 () {56 vars in 1074 bytes} [Tue May 24 15:17:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:17:54.812026 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi [None req-cc5a736d-a070-4d57-a3a7-26c89fd08e02 admin admin] Calling method '>' {{(pid=103280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:17:54.813226 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 15:17:54.813226 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: warnings.warn(msg) May 24 15:17:54.814403 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG oslo_concurrency.lockutils [None req-cc5a736d-a070-4d57-a3a7-26c89fd08e02 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:17:54.814846 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG oslo_concurrency.lockutils [None req-cc5a736d-a070-4d57-a3a7-26c89fd08e02 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:17:54.815628 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG oslo_concurrency.lockutils [None req-cc5a736d-a070-4d57-a3a7-26c89fd08e02 admin admin] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:17:54.816056 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG oslo_concurrency.lockutils [None req-cc5a736d-a070-4d57-a3a7-26c89fd08e02 admin admin] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:17:54.836588 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: INFO nova.api.openstack.requestlog [None req-cc5a736d-a070-4d57-a3a7-26c89fd08e02 admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077137 May 24 15:17:54.837142 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: [pid: 103280|app: 0|req: 37/72] 10.222.0.45 () {60 vars in 1193 bytes} [Tue May 24 15:17:54 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:18:06.137322 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi [None req-700c6778-e320-4a6e-b167-b4bbf9708a77 admin admin] Calling method '>' {{(pid=103279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:18:06.138362 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: INFO nova.api.openstack.requestlog [None req-700c6778-e320-4a6e-b167-b4bbf9708a77 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 May 24 15:18:06.138759 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: [pid: 103279|app: 0|req: 36/73] 10.222.0.45 () {56 vars in 1074 bytes} [Tue May 24 15:18:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:18:06.286994 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG dbcounter [-] [103280] Writing DB stats nova_cell0:SELECT=4 {{(pid=103280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:18:06.287782 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG dbcounter [-] [103280] Writing DB stats nova_cell1:SELECT=4 {{(pid=103280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:18:06.288438 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG dbcounter [-] [103280] Writing DB stats nova_api:SELECT=8 {{(pid=103280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:18:06.336941 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi [None req-1a74384a-1c88-4475-add7-ee8f504f2b31 admin admin] Calling method '>' {{(pid=103280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:18:06.338134 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 15:18:06.338134 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: warnings.warn(msg) May 24 15:18:06.339316 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG oslo_concurrency.lockutils [None req-1a74384a-1c88-4475-add7-ee8f504f2b31 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:18:06.339763 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG oslo_concurrency.lockutils [None req-1a74384a-1c88-4475-add7-ee8f504f2b31 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:18:06.340595 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG oslo_concurrency.lockutils [None req-1a74384a-1c88-4475-add7-ee8f504f2b31 admin admin] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:18:06.341028 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG oslo_concurrency.lockutils [None req-1a74384a-1c88-4475-add7-ee8f504f2b31 admin admin] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:18:06.365829 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: INFO nova.api.openstack.requestlog [None req-1a74384a-1c88-4475-add7-ee8f504f2b31 admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.083283 May 24 15:18:06.366378 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: [pid: 103280|app: 0|req: 38/74] 10.222.0.45 () {60 vars in 1193 bytes} [Tue May 24 15:18:06 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:18:07.227388 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: DEBUG nova.api.openstack.wsgi [None req-700c6778-e320-4a6e-b167-b4bbf9708a77 admin admin] Calling method '>' {{(pid=103279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:18:07.228424 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: INFO nova.api.openstack.requestlog [None req-700c6778-e320-4a6e-b167-b4bbf9708a77 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 May 24 15:18:07.228827 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: [pid: 103279|app: 0|req: 37/75] 10.222.0.45 () {56 vars in 1074 bytes} [Tue May 24 15:18:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:18:07.419571 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG nova.api.openstack.wsgi [None req-b3c1bd2c-9ab8-4e79-8968-f5306f679f25 admin admin] Calling method '>' {{(pid=103280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:18:07.420818 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 15:18:07.420818 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: warnings.warn(msg) May 24 15:18:07.422006 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG oslo_concurrency.lockutils [None req-b3c1bd2c-9ab8-4e79-8968-f5306f679f25 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:18:07.422453 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG oslo_concurrency.lockutils [None req-b3c1bd2c-9ab8-4e79-8968-f5306f679f25 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:18:07.423242 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG oslo_concurrency.lockutils [None req-b3c1bd2c-9ab8-4e79-8968-f5306f679f25 admin admin] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:18:07.423682 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: DEBUG oslo_concurrency.lockutils [None req-b3c1bd2c-9ab8-4e79-8968-f5306f679f25 admin admin] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:18:07.445110 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: INFO nova.api.openstack.requestlog [None req-b3c1bd2c-9ab8-4e79-8968-f5306f679f25 admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.076664 May 24 15:18:07.445650 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: [pid: 103280|app: 0|req: 39/76] 10.222.0.45 () {60 vars in 1193 bytes} [Tue May 24 15:18:07 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:19:04.807422 dv-cinder-843151-1-iscsi devstack@n-api.service[103278]: Tue May 24 15:19:04 2022 - graceful shutdown triggered... May 24 15:19:04.807210 dv-cinder-843151-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 24 15:19:04.808468 dv-cinder-843151-1-iscsi devstack@n-api.service[103279]: Gracefully killing worker 1 (pid: 103279)... May 24 15:19:04.808848 dv-cinder-843151-1-iscsi devstack@n-api.service[103280]: Gracefully killing worker 2 (pid: 103280)... May 24 15:19:05.808224 dv-cinder-843151-1-iscsi devstack@n-api.service[103278]: worker 1 buried after 1 seconds May 24 15:19:05.808780 dv-cinder-843151-1-iscsi devstack@n-api.service[103278]: worker 2 buried after 1 seconds May 24 15:19:05.808780 dv-cinder-843151-1-iscsi devstack@n-api.service[103278]: goodbye to uWSGI. May 24 15:19:05.810261 dv-cinder-843151-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 24 15:19:05.810855 dv-cinder-843151-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 24 15:19:05.813555 dv-cinder-843151-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 24 15:19:05.828715 dv-cinder-843151-1-iscsi devstack@n-api.service[117687]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 24 15:19:05.848513 dv-cinder-843151-1-iscsi devstack@n-api.service[117687]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 24 15:19:05 2022] *** May 24 15:19:05.848513 dv-cinder-843151-1-iscsi devstack@n-api.service[117687]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 24 15:19:05.848513 dv-cinder-843151-1-iscsi devstack@n-api.service[117687]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 24 15:19:05.848513 dv-cinder-843151-1-iscsi devstack@n-api.service[117687]: nodename: dv-cinder-843151-1-iscsi May 24 15:19:05.848513 dv-cinder-843151-1-iscsi devstack@n-api.service[117687]: machine: x86_64 May 24 15:19:05.848513 dv-cinder-843151-1-iscsi devstack@n-api.service[117687]: clock source: unix May 24 15:19:05.848513 dv-cinder-843151-1-iscsi devstack@n-api.service[117687]: pcre jit disabled May 24 15:19:05.848513 dv-cinder-843151-1-iscsi devstack@n-api.service[117687]: detected number of CPU cores: 4 May 24 15:19:05.848513 dv-cinder-843151-1-iscsi devstack@n-api.service[117687]: current working directory: / May 24 15:19:05.848513 dv-cinder-843151-1-iscsi devstack@n-api.service[117687]: detected binary path: /usr/bin/uwsgi-core May 24 15:19:05.848513 dv-cinder-843151-1-iscsi devstack@n-api.service[117687]: your processes number limit is 47680 May 24 15:19:05.848513 dv-cinder-843151-1-iscsi devstack@n-api.service[117687]: your memory page size is 4096 bytes May 24 15:19:05.848513 dv-cinder-843151-1-iscsi devstack@n-api.service[117687]: detected max file descriptor number: 2048 May 24 15:19:05.848513 dv-cinder-843151-1-iscsi devstack@n-api.service[117687]: lock engine: pthread robust mutexes May 24 15:19:05.849956 dv-cinder-843151-1-iscsi devstack@n-api.service[117687]: thunder lock: enabled May 24 15:19:05.849956 dv-cinder-843151-1-iscsi devstack@n-api.service[117687]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 24 15:19:05.849956 dv-cinder-843151-1-iscsi devstack@n-api.service[117687]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 24 15:19:05.897122 dv-cinder-843151-1-iscsi devstack@n-api.service[117687]: Python main interpreter initialized at 0x559ffeb009c0 May 24 15:19:05.897122 dv-cinder-843151-1-iscsi devstack@n-api.service[117687]: python threads support enabled May 24 15:19:05.897122 dv-cinder-843151-1-iscsi devstack@n-api.service[117687]: your server socket listen backlog is limited to 100 connections May 24 15:19:05.897122 dv-cinder-843151-1-iscsi devstack@n-api.service[117687]: your mercy for graceful operations on workers is 90 seconds May 24 15:19:05.897584 dv-cinder-843151-1-iscsi devstack@n-api.service[117687]: mapped 403077 bytes (393 KB) for 2 cores May 24 15:19:05.897584 dv-cinder-843151-1-iscsi devstack@n-api.service[117687]: *** Operational MODE: preforking *** May 24 15:19:05.897818 dv-cinder-843151-1-iscsi devstack@n-api.service[117687]: *** uWSGI is running in multiple interpreter mode *** May 24 15:19:05.897818 dv-cinder-843151-1-iscsi devstack@n-api.service[117687]: spawned uWSGI master process (pid: 117687) May 24 15:19:05.898021 dv-cinder-843151-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 24 15:19:05.900923 dv-cinder-843151-1-iscsi devstack@n-api.service[117687]: spawned uWSGI worker 1 (pid: 117698, cores: 1) May 24 15:19:05.900923 dv-cinder-843151-1-iscsi devstack@n-api.service[117687]: spawned uWSGI worker 2 (pid: 117699, cores: 1) May 24 15:19:05.900923 dv-cinder-843151-1-iscsi devstack@n-api.service[117687]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 24 15:19:07.073409 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 24 15:19:07.090752 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 24 15:19:07.854026 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 24 15:19:07.854026 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: from cryptography.utils import int_from_bytes May 24 15:19:07.854424 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 24 15:19:07.854424 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: from cryptography.utils import int_from_bytes May 24 15:19:07.874460 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 24 15:19:07.874460 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: from cryptography.utils import int_from_bytes May 24 15:19:07.874797 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 24 15:19:07.874797 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: from cryptography.utils import int_from_bytes May 24 15:19:10.290599 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 24 15:19:10.291116 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 24 15:19:10.291378 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 24 15:19:10.291738 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 24 15:19:10.291993 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 24 15:19:10.292402 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.292729 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.293047 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.293363 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.293687 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.294022 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.294348 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.294662 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.294990 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.295247 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.295559 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.295877 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843151-1-iscsi {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.296196 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.296533 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.296839 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.297148 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.297448 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.297763 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.298063 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.298555 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.298988 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.299291 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.299599 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.299935 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.300245 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.300586 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.300901 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.301205 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.301524 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.301830 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.302224 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843151-1-iscsi {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.302536 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.302843 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.303150 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.303554 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.303861 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.304171 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.304518 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.304817 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 24 15:19:10.305229 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.305318 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 24 15:19:10.305411 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.305411 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.305581 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 24 15:19:10.305734 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.305965 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 24 15:19:10.306091 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.306207 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 24 15:19:10.306344 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.306592 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.306698 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.306919 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.307026 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.307219 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.307318 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.307529 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.307694 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.307830 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.307936 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.308130 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.308226 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.312577 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.312792 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.312962 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.313112 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.313262 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.313419 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.313571 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.313716 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.313888 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.314193 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.314341 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.314494 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843151-1-iscsi {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.314645 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.314800 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.314959 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.315252 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.315414 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.315535 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.315631 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.315804 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.315917 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.316008 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.316100 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.316195 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.316290 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.316408 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.316501 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.316501 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.316668 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.316775 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.316875 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.316986 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.317083 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.317168 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.317257 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.317352 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.317445 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.317539 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.317631 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.317864 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.317999 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.318129 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.318266 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.318405 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.318541 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.318681 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.318809 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.318943 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.319085 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.319216 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.319351 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843151-1-iscsi {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.319489 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.319630 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.319630 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.319630 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.319630 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.320131 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.320271 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.320461 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.320593 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.320722 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.320857 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.320993 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.321121 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.321274 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.321414 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.321553 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.321690 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.321820 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.321955 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.322093 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.322222 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.322362 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.322492 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.322632 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.322775 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.322913 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.323048 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.323176 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.323313 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.323448 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.323590 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.323721 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.323849 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.323984 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.324113 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.324113 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.324396 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.324535 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.324666 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.324794 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.324929 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.325064 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.325255 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.325255 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.325973 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.325973 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.326229 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.326366 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.326496 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.326635 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.326771 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.326907 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.327044 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.327180 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.327315 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.327440 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.327549 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.327664 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.327791 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.328006 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.328142 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.328278 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.328477 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.328607 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.328744 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.328874 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.329009 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.329146 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.329291 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.329420 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.329553 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.329681 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.329819 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.329962 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.330098 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.330237 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.330372 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.330505 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.330641 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.330641 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.330902 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.330902 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.331161 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.331300 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.331428 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.331428 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.331665 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.331776 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.331890 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.332027 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.332169 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.332315 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.332465 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.332596 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.332723 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.332839 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.332957 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.333087 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.333222 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.333359 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.333494 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.333641 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.333794 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.333925 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.334036 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.334170 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.334286 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.334286 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.334546 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.334636 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.334750 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.334862 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.334969 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.335123 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.335222 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.335328 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.335453 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.335558 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.335637 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.335778 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.336033 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.336204 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.336507 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.336655 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.336785 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.336884 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.337074 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.337214 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.337388 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.337516 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.337697 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.337845 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.337992 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.338201 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.338330 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.338489 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.338634 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.338889 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.339029 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.339249 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.339422 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.339535 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.339668 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.339798 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.340146 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.340484 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.340734 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.340980 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.341207 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.341407 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.341558 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.341664 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.341869 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.341969 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.342194 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.342334 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.342502 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.342652 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.342808 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.342901 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.343208 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.343380 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.343517 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.343702 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.343827 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.344022 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.344146 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.344364 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.344517 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.344684 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.344787 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.345002 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.345103 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.345330 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.345437 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.345653 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.345744 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.345957 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.346062 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.346261 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.346366 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.346565 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.346658 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.346868 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.346960 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.347171 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.347264 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.347474 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.347566 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.347775 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.347867 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.348096 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.348211 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.348444 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.348550 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.348751 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.348864 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.349059 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.349169 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.349363 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.349507 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.349672 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.349806 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:19:10.349970 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.350080 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.350282 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.350383 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.350763 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.350880 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.351017 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.351120 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.351212 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.351297 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.351515 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.351615 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.351823 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.351925 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.352138 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.352230 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.352474 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.352627 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.352790 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.352932 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.353098 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.353202 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.353408 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.353508 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.353714 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.353807 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.354017 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.354110 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.354319 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.354465 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.354609 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.354739 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.354919 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.355059 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.355221 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.355355 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.355536 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.355678 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.355858 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.356001 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.356162 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.356328 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.356564 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.356692 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.356873 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.357018 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.357181 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.357329 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.357489 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.357630 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.357798 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.358174 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.358399 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.358678 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.358814 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.358951 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.359081 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.359193 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.359388 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.359577 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.359692 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.359803 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.360019 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.360205 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.360403 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.360524 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.360739 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.360851 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.361060 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.361207 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.361381 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.361476 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.361694 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.361785 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.362004 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.362097 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.362311 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.362404 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.362619 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.362721 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.362928 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.363020 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.363249 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.363343 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.363561 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.363651 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.363868 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.363975 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.364180 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.364271 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.364523 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.364617 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.364838 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.364944 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.365150 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.365253 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.365465 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.365600 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.365774 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.365890 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.366074 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.366207 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.366376 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.366515 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.366709 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.366851 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.366994 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.367132 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.367270 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.367400 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.367567 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.367664 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.367830 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.367923 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.368130 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.368278 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.368442 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.368539 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.368747 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.368851 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.369046 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.369140 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.369366 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.369470 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.369669 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.369762 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.369970 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.370070 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.370269 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.370363 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.370568 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.370669 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.370907 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.371011 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.371207 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.371298 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.371514 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.371604 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.371840 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.371952 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.372741 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.372838 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.372972 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.373074 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.373376 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.373492 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.373588 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.373693 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.373901 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.374042 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.374215 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.374318 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.374526 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.374669 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.374832 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.374962 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.375151 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.375290 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.375458 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.375594 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.375775 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.375867 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.376080 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.376182 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.376426 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.376526 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.376738 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.376842 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.377084 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.377180 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.377396 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.377487 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.377700 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.377799 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.378011 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.378104 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.378317 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.378409 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.378631 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.378732 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.378938 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.379035 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.379246 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.379388 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.379549 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.379655 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.379852 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.379944 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.380155 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.380247 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.380487 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.380596 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.380793 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.380889 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.381108 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.381202 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.381413 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.381518 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.381718 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.381811 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.382019 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.382110 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.382321 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.382422 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.382632 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.382730 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.382946 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.383038 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.383248 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.383385 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.383559 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.383660 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.383882 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.383985 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.384209 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.384332 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.384539 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.384633 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.384846 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.384988 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.385157 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.385289 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.385469 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.385562 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.385773 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.385871 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.386080 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.386181 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.386381 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.386472 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.386681 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.386782 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.386985 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.387088 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.387294 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.387393 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.387612 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.388231 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.388492 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.388600 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.388797 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.388891 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.389107 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.389217 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.389412 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.389505 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.389712 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.389812 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.390011 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.390117 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.390317 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.390418 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.390633 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.390726 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.390940 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.391041 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.391256 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.391359 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.391570 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.391671 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.391870 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.391962 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.392172 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.392369 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.392513 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.392606 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.392818 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.392920 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.393117 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.393217 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.393416 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.393509 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.393715 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.393808 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.394038 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.394137 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.394344 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.394435 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.394644 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.394747 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.394951 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.395051 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.395265 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.395371 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.395567 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.395658 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.395877 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.395977 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.396183 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.396284 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.396521 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.396627 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.396839 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.396932 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.397147 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.397314 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.397453 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.397553 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.397762 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.397903 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.398067 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.398211 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.398369 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.398470 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.398674 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.398773 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.398987 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.399121 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.399289 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.399380 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.399595 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.399733 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.399900 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.400031 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.400201 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.400368 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.400531 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.400672 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.400834 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.400967 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.401135 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.401415 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.401546 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.401743 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.401889 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.402052 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.402183 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.402364 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.402492 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.402680 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.402812 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.402981 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.403118 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.403867 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.404067 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.404355 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.404575 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.404726 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.404856 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.405020 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.405164 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.405328 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.405473 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.405636 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.405801 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.406468 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.406615 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.406748 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.406877 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.407006 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.407149 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.407287 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.407443 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.407585 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.407722 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.407859 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.408007 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.408146 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.408276 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.408429 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.408560 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.408689 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.408833 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.408970 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.409107 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.409240 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.409369 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.409516 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.409614 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.409700 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.409792 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.409885 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.409971 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.410089 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.410191 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.410397 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.410490 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.410701 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.410801 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.411004 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.411098 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.411304 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.411449 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.411644 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.411745 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.411947 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.412051 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.412275 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.412411 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.412615 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.412720 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.412951 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.413191 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.413293 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.413528 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.413623 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.413848 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.413942 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.414146 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.414244 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.414447 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.414555 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.414747 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.414850 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.415052 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.415194 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.415362 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.415468 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.415662 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.415761 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.415970 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.416084 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.416279 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.416405 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.416609 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.416711 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.416916 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.417024 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.417218 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.417319 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.417524 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.417624 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.417825 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.417930 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.418126 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.418225 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.418432 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.418577 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.418732 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.418827 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.419583 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.419692 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.419893 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.419986 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.420197 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.420293 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.420524 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.420630 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.420834 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.420938 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.421135 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.421230 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.421439 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.421538 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.421739 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.421841 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.422040 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.422144 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.422341 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.422434 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.422646 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.422746 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.422947 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.423046 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.423290 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.423397 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.423596 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.423743 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.423934 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.424035 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.424252 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.424376 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.424583 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.424689 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.424888 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.424990 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.425195 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.425317 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.425497 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.425591 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.425802 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.425898 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.426105 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.426203 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.426408 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.426509 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.426709 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.426800 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.427013 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.427105 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.427314 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.427407 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.427612 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.427703 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.427912 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.428005 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.428215 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.428330 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.428540 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.428635 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.428839 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.428942 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.429136 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.429237 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.429437 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.429536 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.429735 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.429891 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.430047 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.430139 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.430347 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.430439 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.430647 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.430748 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.430947 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.431048 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.431246 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.431347 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.431546 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.431652 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.431857 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.431958 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.432161 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.432258 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.432502 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.432606 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.432809 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.432902 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.433115 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.433208 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.433419 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.433513 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.433725 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.433825 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.434030 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.434121 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.434330 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.434424 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.434666 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.434763 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.434978 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.435077 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.435280 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.435377 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.435578 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.435670 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.435884 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.435987 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.436187 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.436289 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.436543 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.436635 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.436852 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.436964 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.437171 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.437271 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.437489 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.437581 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.437794 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.437901 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.438091 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.438183 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.438393 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.438490 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.438696 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.438804 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.438996 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.439096 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.439301 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.439401 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.439603 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.439705 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.439904 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.440008 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.440206 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.440359 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.440552 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.440684 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.440858 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.440997 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.441179 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.441309 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.441486 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.441614 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.441789 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.441923 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.442095 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.442229 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.442399 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.442531 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.442743 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.442838 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.443047 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.443148 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.443405 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.443506 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.443712 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.443806 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.444013 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.444117 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.444359 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.444468 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.444645 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.444738 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.444960 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.445062 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.445276 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.445415 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.445584 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.445711 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.445898 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.446043 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.446210 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.446340 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.446523 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.446616 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.446828 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.446935 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.447130 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.447231 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.447436 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.447564 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.447751 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.447844 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.448063 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.448158 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.448419 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.448517 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.448753 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.448848 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.449052 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.449144 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.449355 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.449449 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.449663 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.449764 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.449971 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.450055 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.450304 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.450616 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.450717 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.450926 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.451026 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.451226 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.451317 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.451537 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.451638 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.451835 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.451927 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.452148 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.452283 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.452490 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.452585 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.452820 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.452914 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.453132 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.453232 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.453441 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.453565 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.453747 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.453875 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.454072 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.454173 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.454381 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.454474 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.454684 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.454777 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.454993 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.455100 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.455297 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.455391 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.455775 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.455930 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.456031 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.456171 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.456378 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.456532 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.456692 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.456794 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.456999 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.457101 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.457305 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.457396 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.457603 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.457701 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.457918 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.458024 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.458235 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.458326 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.458545 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.458645 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.458856 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.458955 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.459264 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.459356 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.459576 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.459668 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.459881 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.459969 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.460191 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.460282 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.460521 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.460633 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.460828 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.460920 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.461130 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.461236 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.461436 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.461545 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.461737 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.461839 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.462041 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.462135 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.462346 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.462450 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.462645 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.462744 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.462954 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.463048 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.463261 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.463361 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.463565 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.463665 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.463865 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.463958 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.464166 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.464262 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.464509 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.464690 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.464795 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.465002 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.465104 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.465313 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.465414 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.465635 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.466280 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.466474 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.466602 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.466802 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.466903 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.467106 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.467208 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.467421 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.467516 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.467721 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.467813 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.468023 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.468116 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.468414 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.468525 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.468693 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.468787 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.469008 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.469116 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.469320 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.469414 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.469642 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.469781 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.469963 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.470071 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.470270 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.470362 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.470588 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.470680 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.470913 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.471014 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.471227 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.471320 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.471544 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.471638 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.471868 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.471970 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.472173 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.472266 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.472502 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.472599 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.472810 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.472904 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.473113 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.473209 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.473417 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.473511 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.473720 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.473842 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.474026 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.474122 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.474327 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.474421 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.474630 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.474733 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.474934 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.475035 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.475238 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.475342 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.475542 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.475636 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.475847 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.475947 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.476159 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.476260 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.476485 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.476590 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.476788 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.476880 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.477089 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.477192 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.477415 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.477515 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.477716 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.477816 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.478029 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.478134 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.478350 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.478444 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.478658 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.478759 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.478963 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.479061 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.479272 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.479373 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.479577 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.479670 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.479893 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.479986 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.480209 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.480349 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.480551 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.480697 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.480865 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.480960 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.481179 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.481280 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.482056 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.482188 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.482370 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.482496 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.482762 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.483210 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.483310 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.483539 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.483644 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.483858 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.483961 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.484176 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.484278 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.484551 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.484752 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.484845 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.485084 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.485186 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.485400 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.485508 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.485712 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.485813 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.486030 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.486134 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.486333 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.486471 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.486641 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.486746 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.486948 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.487043 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.487256 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.487357 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.487560 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.487660 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.487866 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.488003 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.488180 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.488274 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.488511 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.488613 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.488819 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.488912 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.489124 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.489218 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.489459 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.489551 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.489763 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.489865 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.490074 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.490166 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.490386 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.490488 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.490707 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.490808 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.491037 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.491138 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.491339 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.491485 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.491652 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.491755 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.491965 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.492059 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.492276 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.492414 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.492612 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.492726 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.492924 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.493031 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.493233 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.493326 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.493544 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.493651 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.493852 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.493946 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.494159 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.494251 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.494468 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.494571 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.494779 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.494881 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.495093 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.495185 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.495421 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.495631 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.495725 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.495963 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.496103 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.496281 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.496398 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.496618 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.496765 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.496933 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.497183 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.497287 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.497496 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.497589 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.497826 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.497928 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.498149 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.498256 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.498465 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.498567 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.498776 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.498876 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.499091 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.499185 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.499415 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.499516 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.499720 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.499821 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.500023 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.500117 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.500347 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.500456 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.500657 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.500750 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.500956 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.501052 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.501264 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.501358 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.501571 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.501678 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.501872 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.501966 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.502186 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.502287 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.502492 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.502598 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.502837 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.503024 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.503150 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.503372 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.503466 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.503687 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.503781 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.504010 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.504103 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.504351 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.504464 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.504670 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.504771 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.504976 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.505076 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.505287 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.505393 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.505587 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.505686 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.505894 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.506001 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.506208 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.506349 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.506515 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.506617 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.506817 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.506910 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.507120 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.507213 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.507426 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.507526 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.507731 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.507944 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.508046 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.508260 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.508390 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.508618 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.508712 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.508944 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.509052 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.509261 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.509354 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.509564 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.509658 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.509864 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.509966 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.510173 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.510267 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.510474 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.510573 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.510774 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.510868 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.511074 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.511178 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.511376 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.511477 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.511679 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.511780 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.511977 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.512069 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.512280 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.512413 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.513144 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.513262 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.513419 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.513521 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.513719 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.513814 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.514024 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.514250 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.514372 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.514600 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.514694 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.514919 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.515027 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.515247 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.515341 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.515567 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.515666 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.515875 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.515969 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.516179 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.516343 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.516530 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.516628 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.516836 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.516971 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.517138 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.517272 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.517455 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.517550 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.517767 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.517990 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.518091 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.518324 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.518417 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.518643 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.518738 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.518951 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.519050 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.519255 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.519348 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.519565 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.519666 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.519864 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.519956 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.520171 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.520272 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.520503 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.520605 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.520811 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.520912 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.521114 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.521256 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.521419 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.521512 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.521718 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.521812 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.522023 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.522124 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.522324 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.522417 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.522627 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.522727 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.522933 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.523040 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.523251 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.523368 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.523532 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.523626 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.523834 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.523939 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.524135 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.524235 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.524459 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.524553 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.524769 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.524892 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.525127 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.525220 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.525451 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.525544 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.525756 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.525858 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.526059 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.526153 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.526377 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.526471 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.526687 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.526792 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.527004 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.527096 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.527311 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.527454 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.527624 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.527747 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.527943 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.528070 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.528842 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.529082 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.529353 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.529456 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.529690 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.529785 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.530017 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.530121 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.530352 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.530447 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.530683 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.530784 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.530992 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.531170 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.531299 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.531393 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.531606 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.531708 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.531916 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.532323 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.532467 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.532558 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.532656 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.532742 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.532873 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.532968 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.533183 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.533276 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.533498 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.533604 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.533803 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.533907 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.534113 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.534208 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.534415 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.534508 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.534719 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.534820 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.535022 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.535123 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.535331 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.535439 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.535636 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.535728 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.535938 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.536040 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.536239 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.536427 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.536584 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.536726 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.536889 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.536990 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.537189 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.537296 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.537492 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.537601 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.537793 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.537887 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.538099 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.538193 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.538399 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.538503 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.538700 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.538811 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.539000 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.539094 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.539299 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.539392 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.539598 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.539691 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.539897 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.540002 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.540199 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.540343 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.540525 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.540661 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.540825 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.540980 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.541124 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.541301 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.541424 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.541612 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.541707 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.541934 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.542034 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.542255 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.542350 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.542569 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.542671 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.542889 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.542983 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.543199 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.543293 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.543532 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.543647 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.543862 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.543983 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.544182 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.544290 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.544528 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.544626 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.544839 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.544946 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.545141 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.545248 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.545443 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.545535 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.545751 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.545853 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.546056 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.546159 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.546370 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.546462 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.546675 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.546779 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.546978 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.547081 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.547283 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.547377 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.547584 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.547683 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.547887 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.547988 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.548193 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.548286 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.548521 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.548615 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.548829 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.548924 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.549132 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.549227 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.549436 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.549574 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.549745 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.549845 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.550044 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.550146 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.550346 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.550449 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.550650 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.550743 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.550956 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.551057 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.551257 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.551360 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.551559 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.551655 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.551860 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.551954 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.552163 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.552270 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.552489 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.552582 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.552819 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.552910 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.553126 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.553230 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.553450 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.553541 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.553771 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.553876 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.554079 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.554185 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.554400 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.554494 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.554707 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.554800 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.555027 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.555121 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.555347 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.555448 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.555656 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.555747 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.555960 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.556055 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.556205 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 24 15:19:10.556320 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.556606 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.556918 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.557231 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.557540 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.557847 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.558156 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.558481 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.558806 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.559110 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.559435 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.559792 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.560145 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.560489 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.560805 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.561135 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.561448 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.561760 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.562077 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.562389 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.562701 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.563016 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.563331 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.563656 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.563981 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.564289 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.564634 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.564960 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.565304 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.565617 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.565963 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.566293 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.566607 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.566922 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.567229 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:19:10.567469 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 24 15:19:10.615777 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO dbcounter [None req-3fb4e940-06a7-479f-8990-60a606fd630d None None] Registered counter for database nova_api May 24 15:19:10.627833 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO dbcounter [None req-3918beac-d29a-4f5e-a339-7bdd6768a3d2 None None] Registered counter for database nova_api May 24 15:19:10.635597 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_db.sqlalchemy.engines [None req-3fb4e940-06a7-479f-8990-60a606fd630d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117698) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 15:19:10.643457 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writer thread running {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 15:19:10.652618 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_db.sqlalchemy.engines [None req-3918beac-d29a-4f5e-a339-7bdd6768a3d2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117699) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 15:19:10.660678 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writer thread running {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 15:19:10.699329 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.context [None req-3fb4e940-06a7-479f-8990-60a606fd630d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4d042716-ec3d-4081-835a-0e5e9de595c8(cell1) {{(pid=117698) load_cells /opt/stack/nova/nova/context.py:464}} May 24 15:19:10.703976 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3fb4e940-06a7-479f-8990-60a606fd630d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:19:10.705570 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3fb4e940-06a7-479f-8990-60a606fd630d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:19:10.706367 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3fb4e940-06a7-479f-8990-60a606fd630d None None] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:19:10.708348 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3fb4e940-06a7-479f-8990-60a606fd630d None None] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:19:10.710299 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO dbcounter [None req-3fb4e940-06a7-479f-8990-60a606fd630d None None] Registered counter for database nova_cell0 May 24 15:19:10.714313 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO dbcounter [None req-3fb4e940-06a7-479f-8990-60a606fd630d None None] Registered counter for database nova_cell1 May 24 15:19:10.715591 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.context [None req-3918beac-d29a-4f5e-a339-7bdd6768a3d2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4d042716-ec3d-4081-835a-0e5e9de595c8(cell1) {{(pid=117699) load_cells /opt/stack/nova/nova/context.py:464}} May 24 15:19:10.720291 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3918beac-d29a-4f5e-a339-7bdd6768a3d2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:19:10.721898 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3918beac-d29a-4f5e-a339-7bdd6768a3d2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:19:10.722289 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_db.sqlalchemy.engines [None req-3fb4e940-06a7-479f-8990-60a606fd630d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117698) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 15:19:10.722732 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3918beac-d29a-4f5e-a339-7bdd6768a3d2 None None] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:19:10.723513 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_db.sqlalchemy.engines [None req-3fb4e940-06a7-479f-8990-60a606fd630d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117698) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 15:19:10.724750 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3918beac-d29a-4f5e-a339-7bdd6768a3d2 None None] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:19:10.726729 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO dbcounter [None req-3918beac-d29a-4f5e-a339-7bdd6768a3d2 None None] Registered counter for database nova_cell0 May 24 15:19:10.730496 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writer thread running {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 15:19:10.730751 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO dbcounter [None req-3918beac-d29a-4f5e-a339-7bdd6768a3d2 None None] Registered counter for database nova_cell1 May 24 15:19:10.731819 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writer thread running {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 15:19:10.738082 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_db.sqlalchemy.engines [None req-3918beac-d29a-4f5e-a339-7bdd6768a3d2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117699) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 15:19:10.740260 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_db.sqlalchemy.engines [None req-3918beac-d29a-4f5e-a339-7bdd6768a3d2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117699) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 15:19:10.745652 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writer thread running {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 15:19:10.747662 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writer thread running {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 15:19:10.882421 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO dbcounter [None req-3fb4e940-06a7-479f-8990-60a606fd630d None None] Registered counter for database nova_cell0 May 24 15:19:10.889992 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_db.sqlalchemy.engines [None req-3fb4e940-06a7-479f-8990-60a606fd630d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117698) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 15:19:10.894383 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO dbcounter [None req-3918beac-d29a-4f5e-a339-7bdd6768a3d2 None None] Registered counter for database nova_cell0 May 24 15:19:10.894590 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writer thread running {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 15:19:10.901048 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_db.sqlalchemy.engines [None req-3918beac-d29a-4f5e-a339-7bdd6768a3d2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117699) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 15:19:10.905745 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writer thread running {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 15:19:11.220485 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: WARNING keystonemiddleware.auth_token [None req-3918beac-d29a-4f5e-a339-7bdd6768a3d2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 24 15:19:11.227704 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: WARNING keystonemiddleware.auth_token [None req-3918beac-d29a-4f5e-a339-7bdd6768a3d2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 24 15:19:11.240679 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: WARNING keystonemiddleware.auth_token [None req-3fb4e940-06a7-479f-8990-60a606fd630d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 24 15:19:11.250788 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: WARNING keystonemiddleware.auth_token [None req-3fb4e940-06a7-479f-8990-60a606fd630d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 24 15:19:11.572010 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: WARNING keystonemiddleware.auth_token [None req-3918beac-d29a-4f5e-a339-7bdd6768a3d2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 24 15:19:11.578048 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: WARNING keystonemiddleware.auth_token [None req-3918beac-d29a-4f5e-a339-7bdd6768a3d2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 24 15:19:11.583300 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559ffeb009c0 pid: 117699 (default app) May 24 15:19:11.608449 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: WARNING keystonemiddleware.auth_token [None req-3fb4e940-06a7-479f-8990-60a606fd630d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 24 15:19:11.614471 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: WARNING keystonemiddleware.auth_token [None req-3fb4e940-06a7-479f-8990-60a606fd630d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 24 15:19:11.619753 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559ffeb009c0 pid: 117698 (default app) May 24 15:19:51.992694 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_api:SELECT=3 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:19:51.994412 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell0:SELECT=3 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:19:51.995482 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=3 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:19:51.996877 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell0:SELECT=3 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:19:53.124357 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_api:SELECT=3 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:19:53.125467 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=3 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:19:53.126742 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell0:SELECT=3 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:19:53.129528 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell0:SELECT=3 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:19:53.205605 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-4f36ba29-df4e-424e-9c07-204815d8ad33 tempest-VolumesGetTestJSON-1296471390 tempest-VolumesGetTestJSON-1296471390-project] Action: 'create', calling method: .version_select at 0x7f2dd8e63c10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-565958348", "metadata": {"Type": "work"}}} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:19:54.067462 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-290b6806-7c07-4824-b7cc-8c05abafdc98 tempest-VolumesSnapshotsTestJSON-765148267 tempest-VolumesSnapshotsTestJSON-765148267-project] Action: 'create', calling method: .version_select at 0x7f2dd8e64c10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1561884559"}} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:19:55.694209 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-4f36ba29-df4e-424e-9c07-204815d8ad33 tempest-VolumesGetTestJSON-1296471390 tempest-VolumesGetTestJSON-1296471390-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.708030 May 24 15:19:55.695953 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1/1] 10.222.0.45 () {60 vars in 1155 bytes} [Tue May 24 15:19:51 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3712 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 24 15:19:55.783269 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-290b6806-7c07-4824-b7cc-8c05abafdc98 tempest-VolumesSnapshotsTestJSON-765148267 tempest-VolumesSnapshotsTestJSON-765148267-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.664538 May 24 15:19:55.784890 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1/2] 10.222.0.45 () {60 vars in 1154 bytes} [Tue May 24 15:19:53 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 2668 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 24 15:19:55.793560 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-485abb4d-01c1-4695-b9a3-ca17bf0e0aa4 tempest-VolumesGetTestJSON-1296471390 tempest-VolumesGetTestJSON-1296471390-project] Calling method '.version_select at 0x7f2dd8cb3b80>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:19:55.911641 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-485abb4d-01c1-4695-b9a3-ca17bf0e0aa4 tempest-VolumesGetTestJSON-1296471390 tempest-VolumesGetTestJSON-1296471390-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/1005d3fd-a2c8-45c9-8c2a-15b6f6f9372c" status: 200 len: 352 microversion: 2.1 time: 0.124143 May 24 15:19:55.912953 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 2/3] 10.222.0.45 () {58 vars in 1244 bytes} [Tue May 24 15:19:55 2022] GET /compute/v2.1/os-volumes/1005d3fd-a2c8-45c9-8c2a-15b6f6f9372c => generated 352 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:19:55.942097 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-858d5e0a-2386-4670-a782-223bb2555215 tempest-VolumesSnapshotsTestJSON-765148267 tempest-VolumesSnapshotsTestJSON-765148267-project] Calling method '.version_select at 0x7f2dd8cb3d30>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:19:55.987975 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-21c08aa0-1cae-4c77-a4d6-3d3750bde99e tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-651063857", "imageRef": "f921f75e-bbd1-4d99-ab1e-5cce2d895148", "flavorRef": "452", "networks": [{"uuid": "c704aab0-2599-4339-90da-708eda24dc22"}]}} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:19:56.064222 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-858d5e0a-2386-4670-a782-223bb2555215 tempest-VolumesSnapshotsTestJSON-765148267 tempest-VolumesSnapshotsTestJSON-765148267-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/f5dd2920-ee08-4b26-a67a-84dda7d40c68" status: 200 len: 345 microversion: 2.1 time: 0.150064 May 24 15:19:56.064965 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 3/4] 10.222.0.45 () {58 vars in 1244 bytes} [Tue May 24 15:19:55 2022] GET /compute/v2.1/os-volumes/f5dd2920-ee08-4b26-a67a-84dda7d40c68 => generated 345 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:19:56.228369 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.network.neutron [None req-21c08aa0-1cae-4c77-a4d6-3d3750bde99e tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] validate_networks() for [('c704aab0-2599-4339-90da-708eda24dc22', None, None, None, None, None)] {{(pid=117699) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 15:19:56.925389 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-46b2c424-7a21-412c-8f67-501dc0950e09 tempest-VolumesGetTestJSON-1296471390 tempest-VolumesGetTestJSON-1296471390-project] Calling method '.version_select at 0x7f2dd8cc73a0>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:19:57.015462 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-46b2c424-7a21-412c-8f67-501dc0950e09 tempest-VolumesGetTestJSON-1296471390 tempest-VolumesGetTestJSON-1296471390-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/1005d3fd-a2c8-45c9-8c2a-15b6f6f9372c" status: 200 len: 353 microversion: 2.1 time: 0.093833 May 24 15:19:57.016017 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 4/5] 10.222.0.45 () {58 vars in 1244 bytes} [Tue May 24 15:19:56 2022] GET /compute/v2.1/os-volumes/1005d3fd-a2c8-45c9-8c2a-15b6f6f9372c => generated 353 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:19:57.027058 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-f97ac12e-a277-4db2-9f89-2df9e4482969 tempest-VolumesGetTestJSON-1296471390 tempest-VolumesGetTestJSON-1296471390-project] Calling method '.version_select at 0x7f2dd8cc7a60>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:19:57.134865 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-f97ac12e-a277-4db2-9f89-2df9e4482969 tempest-VolumesGetTestJSON-1296471390 tempest-VolumesGetTestJSON-1296471390-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/1005d3fd-a2c8-45c9-8c2a-15b6f6f9372c" status: 200 len: 353 microversion: 2.1 time: 0.111673 May 24 15:19:57.135677 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 5/6] 10.222.0.45 () {58 vars in 1244 bytes} [Tue May 24 15:19:57 2022] GET /compute/v2.1/os-volumes/1005d3fd-a2c8-45c9-8c2a-15b6f6f9372c => generated 353 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:19:57.141378 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-1fa8a059-c33b-48be-a510-8b578afe539a tempest-VolumesSnapshotsTestJSON-765148267 tempest-VolumesSnapshotsTestJSON-765148267-project] Calling method '.version_select at 0x7f2dd8cd2160>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:19:57.264496 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-1fa8a059-c33b-48be-a510-8b578afe539a tempest-VolumesSnapshotsTestJSON-765148267 tempest-VolumesSnapshotsTestJSON-765148267-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/f5dd2920-ee08-4b26-a67a-84dda7d40c68" status: 200 len: 346 microversion: 2.1 time: 0.127741 May 24 15:19:57.265506 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 6/7] 10.222.0.45 () {58 vars in 1244 bytes} [Tue May 24 15:19:57 2022] GET /compute/v2.1/os-volumes/f5dd2920-ee08-4b26-a67a-84dda7d40c68 => generated 346 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:19:57.271118 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-1cd5b314-7fe3-49aa-9aaa-36f09dd63027 tempest-VolumesGetTestJSON-1296471390 tempest-VolumesGetTestJSON-1296471390-project] Calling method '.version_select at 0x7f2dd8cb3d30>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:19:57.383143 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-1cd5b314-7fe3-49aa-9aaa-36f09dd63027 tempest-VolumesGetTestJSON-1296471390 tempest-VolumesGetTestJSON-1296471390-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/1005d3fd-a2c8-45c9-8c2a-15b6f6f9372c" status: 202 len: 0 microversion: 2.1 time: 0.116066 May 24 15:19:57.386761 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 7/8] 10.222.0.45 () {58 vars in 1247 bytes} [Tue May 24 15:19:57 2022] DELETE /compute/v2.1/os-volumes/1005d3fd-a2c8-45c9-8c2a-15b6f6f9372c => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 15:19:57.395126 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-621640f3-eff6-4950-ad6c-09926cd5d172 tempest-VolumesSnapshotsTestJSON-765148267 tempest-VolumesSnapshotsTestJSON-765148267-project] Action: 'create', calling method: .version_select at 0x7f2dd8cd21f0>, body: {"snapshot": {"volume_id": "f5dd2920-ee08-4b26-a67a-84dda7d40c68", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1570265926"}} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:19:57.778209 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-621640f3-eff6-4950-ad6c-09926cd5d172 tempest-VolumesSnapshotsTestJSON-765148267 tempest-VolumesSnapshotsTestJSON-765148267-project] 10.222.0.45 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.391873 May 24 15:19:57.785796 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 8/9] 10.222.0.45 () {60 vars in 1161 bytes} [Tue May 24 15:19:57 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:19:57.807713 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c756f23f-09cb-4933-bc96-42ff314cdc08 tempest-VolumesGetTestJSON-1296471390 tempest-VolumesGetTestJSON-1296471390-project] Calling method '.version_select at 0x7f2dd8cd6040>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:19:57.897698 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.wsgi [None req-c756f23f-09cb-4933-bc96-42ff314cdc08 tempest-VolumesGetTestJSON-1296471390 tempest-VolumesGetTestJSON-1296471390-project] HTTP exception thrown: Volume 1005d3fd-a2c8-45c9-8c2a-15b6f6f9372c could not be found. May 24 15:19:57.934565 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c756f23f-09cb-4933-bc96-42ff314cdc08 tempest-VolumesGetTestJSON-1296471390 tempest-VolumesGetTestJSON-1296471390-project] Request method failure captured: May 24 15:19:57.934565 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: request: GET /compute/v2.1/os-volumes/1005d3fd-a2c8-45c9-8c2a-15b6f6f9372c HTTP/1.1 May 24 15:19:57.934565 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Accept: application/json May 24 15:19:57.934565 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Accept-Encoding: identity May 24 15:19:57.934565 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Connection: close May 24 15:19:57.934565 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Content-Length: 0 May 24 15:19:57.934565 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Content-Type: application/json May 24 15:19:57.934565 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Host: 10.222.0.45 May 24 15:19:57.934565 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Openstack-System-Scope: None May 24 15:19:57.934565 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: User-Agent: python-urllib3/1.26.9 May 24 15:19:57.934565 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Auth-Token: gAAAAABijPeX7E7366mT80MrnjzDmHzce_ae0-jpi1KYAdqSmMiA4OcO_257MMxc4RL3-a6GkS848EN6RhIxKBrAazpIpTK27qFHqrGT42MySbclo1S6e7QCSXJHZaB8K_4KoO_nobTIPIJEWJ06i3xb4K1mt_mFdKnGtAGODl4xeP2Zp5uxk2M May 24 15:19:57.934565 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Domain-Id: None May 24 15:19:57.934565 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Domain-Name: None May 24 15:19:57.934565 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Identity-Status: Confirmed May 24 15:19:57.934565 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Is-Admin-Project: True May 24 15:19:57.934565 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Domain-Id: default May 24 15:19:57.934565 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Domain-Name: Default May 24 15:19:57.934565 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Id: cb5a1867355149cd844bf31c563b9866 May 24 15:19:57.934565 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Name: tempest-VolumesGetTestJSON-1296471390 May 24 15:19:57.934565 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Role: reader,member May 24 15:19:57.934565 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Roles: reader,member May 24 15:19:57.936088 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cb5a1867355149cd844bf31c563b9866"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cb5a1867355149cd844bf31c563b9866"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/cb5a1867355149cd844bf31c563b9866"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_cb5a1867355149cd844bf31c563b9866"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 24 15:19:57.936088 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Tenant: tempest-VolumesGetTestJSON-1296471390 May 24 15:19:57.936088 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Tenant-Id: cb5a1867355149cd844bf31c563b9866 May 24 15:19:57.936088 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Tenant-Name: tempest-VolumesGetTestJSON-1296471390 May 24 15:19:57.936088 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User: tempest-VolumesGetTestJSON-1296471390-project May 24 15:19:57.936088 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Domain-Id: default May 24 15:19:57.936088 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Domain-Name: Default May 24 15:19:57.936088 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Id: 8120c09231af4074a4d52db426e4e4cc May 24 15:19:57.936088 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Name: tempest-VolumesGetTestJSON-1296471390-project May 24 15:19:57.936088 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: method: May 24 15:19:57.936088 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: exception: Volume 1005d3fd-a2c8-45c9-8c2a-15b6f6f9372c could not be found. May 24 15:19:57.936088 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: action_args: {'id': '1005d3fd-a2c8-45c9-8c2a-15b6f6f9372c'} May 24 15:19:57.936088 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:19:57.942058 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:19:57.942058 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 15:19:57.942058 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 15:19:57.942058 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 24 15:19:57.942058 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi item = cinderclient( May 24 15:19:57.942058 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 24 15:19:57.942058 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 24 15:19:57.942058 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 24 15:19:57.942058 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 24 15:19:57.942058 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 24 15:19:57.942058 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 24 15:19:57.942058 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 15:19:57.942058 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 15:19:57.942058 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 15:19:57.942058 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 15:19:57.942058 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1005d3fd-a2c8-45c9-8c2a-15b6f6f9372c could not be found. (HTTP 404) (Request-ID: req-6520a81f-aaa9-4324-95a5-c26e8d53c385) May 24 15:19:57.942058 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:19:57.942058 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:19:57.942058 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:19:57.943393 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:19:57.943393 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 24 15:19:57.943393 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 24 15:19:57.943393 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 24 15:19:57.943393 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 24 15:19:57.943393 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 24 15:19:57.943393 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 24 15:19:57.943393 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 24 15:19:57.943393 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 24 15:19:57.943393 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 15:19:57.943393 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 15:19:57.943393 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 24 15:19:57.943393 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi item = cinderclient( May 24 15:19:57.943393 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 24 15:19:57.943393 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 24 15:19:57.943393 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 24 15:19:57.943393 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 24 15:19:57.943393 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 24 15:19:57.943393 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 24 15:19:57.944266 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 15:19:57.944266 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 15:19:57.944266 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 15:19:57.944266 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 15:19:57.944266 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1005d3fd-a2c8-45c9-8c2a-15b6f6f9372c could not be found. May 24 15:19:57.944266 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:19:57.944266 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:19:57.944266 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:19:57.944266 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:19:57.944266 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:19:57.944266 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:19:57.944266 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:19:57.944266 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:19:57.944266 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 24 15:19:57.944266 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 24 15:19:57.944266 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:19:57.944266 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:19:57.944266 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 24 15:19:57.944266 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:19:57.945208 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1005d3fd-a2c8-45c9-8c2a-15b6f6f9372c could not be found. May 24 15:19:57.945208 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:19:57.945208 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:19:57.945208 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:19:57.945208 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:19:57.945208 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:19:57.945208 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:19:57.945208 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:19:57.945208 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:19:57.945208 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1005d3fd-a2c8-45c9-8c2a-15b6f6f9372c could not be found. May 24 15:19:57.945208 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:19:57.951749 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c756f23f-09cb-4933-bc96-42ff314cdc08 tempest-VolumesGetTestJSON-1296471390 tempest-VolumesGetTestJSON-1296471390-project] Returning 404 to user: Volume 1005d3fd-a2c8-45c9-8c2a-15b6f6f9372c could not be found. {{(pid=117698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:19:57.952855 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-c756f23f-09cb-4933-bc96-42ff314cdc08 tempest-VolumesGetTestJSON-1296471390 tempest-VolumesGetTestJSON-1296471390-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/1005d3fd-a2c8-45c9-8c2a-15b6f6f9372c" status: 404 len: 109 microversion: 2.1 time: 0.164221 May 24 15:19:57.960603 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 9/10] 10.222.0.45 () {58 vars in 1244 bytes} [Tue May 24 15:19:57 2022] GET /compute/v2.1/os-volumes/1005d3fd-a2c8-45c9-8c2a-15b6f6f9372c => generated 109 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:19:57.971254 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-29d6d623-a357-4345-8f09-02274402b379 tempest-VolumesSnapshotsTestJSON-765148267 tempest-VolumesSnapshotsTestJSON-765148267-project] Calling method '.version_select at 0x7f2dd8cd64c0>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:19:58.118130 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-29d6d623-a357-4345-8f09-02274402b379 tempest-VolumesSnapshotsTestJSON-765148267 tempest-VolumesSnapshotsTestJSON-765148267-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/16bdc2dd-2d4a-4a9b-a3d6-53b24a384cb2" status: 200 len: 287 microversion: 2.1 time: 0.155490 May 24 15:19:58.125570 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 10/11] 10.222.0.45 () {58 vars in 1250 bytes} [Tue May 24 15:19:57 2022] GET /compute/v2.1/os-snapshots/16bdc2dd-2d4a-4a9b-a3d6-53b24a384cb2 => generated 287 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:19:58.133810 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c6bbde79-dea7-4560-8cb4-27a447bbd92a tempest-VolumesSnapshotsTestJSON-765148267 tempest-VolumesSnapshotsTestJSON-765148267-project] Calling method '.version_select at 0x7f2dd8cd6b80>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:19:58.211382 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-c6bbde79-dea7-4560-8cb4-27a447bbd92a tempest-VolumesSnapshotsTestJSON-765148267 tempest-VolumesSnapshotsTestJSON-765148267-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.082526 May 24 15:19:58.221247 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 11/12] 10.222.0.45 () {58 vars in 1139 bytes} [Tue May 24 15:19:58 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:19:58.229000 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-62592fbc-1408-43d4-934b-aa0761c46ce4 tempest-VolumesSnapshotsTestJSON-765148267 tempest-VolumesSnapshotsTestJSON-765148267-project] Calling method '.version_select at 0x7f2dd8cd6820>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:19:58.291163 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-62592fbc-1408-43d4-934b-aa0761c46ce4 tempest-VolumesSnapshotsTestJSON-765148267 tempest-VolumesSnapshotsTestJSON-765148267-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/16bdc2dd-2d4a-4a9b-a3d6-53b24a384cb2" status: 200 len: 287 microversion: 2.1 time: 0.067967 May 24 15:19:58.297129 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 12/13] 10.222.0.45 () {58 vars in 1250 bytes} [Tue May 24 15:19:58 2022] GET /compute/v2.1/os-snapshots/16bdc2dd-2d4a-4a9b-a3d6-53b24a384cb2 => generated 287 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:19:58.810402 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.virt.hardware [None req-21c08aa0-1cae-4c77-a4d6-3d3750bde99e tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Flavor limits 0:0:0 {{(pid=117699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 15:19:58.810958 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.virt.hardware [None req-21c08aa0-1cae-4c77-a4d6-3d3750bde99e tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Image limits 0:0:0 {{(pid=117699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 15:19:58.811282 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.virt.hardware [None req-21c08aa0-1cae-4c77-a4d6-3d3750bde99e tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Flavor pref 0:0:0 {{(pid=117699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 15:19:58.811869 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.virt.hardware [None req-21c08aa0-1cae-4c77-a4d6-3d3750bde99e tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Image pref 0:0:0 {{(pid=117699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 15:19:58.812447 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.virt.hardware [None req-21c08aa0-1cae-4c77-a4d6-3d3750bde99e tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 15:19:58.849563 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-21c08aa0-1cae-4c77-a4d6-3d3750bde99e tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:19:58.851918 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-21c08aa0-1cae-4c77-a4d6-3d3750bde99e tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:19:58.853032 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-21c08aa0-1cae-4c77-a4d6-3d3750bde99e tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:19:58.856014 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-21c08aa0-1cae-4c77-a4d6-3d3750bde99e tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:19:58.950376 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.quota [None req-21c08aa0-1cae-4c77-a4d6-3d3750bde99e tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Getting quotas for project b175a657eab24493b2adbec405cbd515. Resources: {'instances', 'ram', 'cores'} {{(pid=117699) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 15:19:58.974702 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.quota [None req-21c08aa0-1cae-4c77-a4d6-3d3750bde99e tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Getting quotas for user 0dc17670edbb4cc797103b0d41835bf9 and project b175a657eab24493b2adbec405cbd515. Resources: {'instances', 'ram', 'cores'} {{(pid=117699) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 15:19:58.993459 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-21c08aa0-1cae-4c77-a4d6-3d3750bde99e tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Going to run 1 instances... {{(pid=117699) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 15:19:58.998845 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-21c08aa0-1cae-4c77-a4d6-3d3750bde99e tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] [instance: 445c11ea-3365-4eb1-a467-bde08bb9ad98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f921f75e-bbd1-4d99-ab1e-5cce2d895148',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 15:19:59.144392 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-21c08aa0-1cae-4c77-a4d6-3d3750bde99e tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.446810 May 24 15:19:59.146658 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 2/14] 10.222.0.45 () {60 vars in 1146 bytes} [Tue May 24 15:19:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 3450 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 15:19:59.158336 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-a95cd69f-397b-4da6-8982-2da0d34d0800 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:19:59.159212 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-a95cd69f-397b-4da6-8982-2da0d34d0800 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] [instance: 445c11ea-3365-4eb1-a467-bde08bb9ad98] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:19:59.303771 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-075a0c91-5557-4fd6-8fd6-6ddad723cf85 tempest-VolumesSnapshotsTestJSON-765148267 tempest-VolumesSnapshotsTestJSON-765148267-project] Calling method '.version_select at 0x7f2dd83cc700>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:19:59.362284 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-075a0c91-5557-4fd6-8fd6-6ddad723cf85 tempest-VolumesSnapshotsTestJSON-765148267 tempest-VolumesSnapshotsTestJSON-765148267-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/16bdc2dd-2d4a-4a9b-a3d6-53b24a384cb2" status: 200 len: 287 microversion: 2.1 time: 0.062472 May 24 15:19:59.362859 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 3/15] 10.222.0.45 () {58 vars in 1250 bytes} [Tue May 24 15:19:59 2022] GET /compute/v2.1/os-snapshots/16bdc2dd-2d4a-4a9b-a3d6-53b24a384cb2 => generated 287 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:19:59.604005 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-a95cd69f-397b-4da6-8982-2da0d34d0800 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc17670edbb4cc797103b0d41835bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b175a657eab24493b2adbec405cbd515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:19:59.628951 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-a95cd69f-397b-4da6-8982-2da0d34d0800 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] 10.222.0.45 "GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98" status: 200 len: 1214 microversion: 2.1 time: 0.475483 May 24 15:19:59.641253 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 13/16] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:19:59 2022] GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98 => generated 1214 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:20:00.374850 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d7471996-4cbd-44ff-a63b-dfcc123d9e24 tempest-VolumesSnapshotsTestJSON-765148267 tempest-VolumesSnapshotsTestJSON-765148267-project] Calling method '.version_select at 0x7f2dd83ccd30>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:00.471915 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d7471996-4cbd-44ff-a63b-dfcc123d9e24 tempest-VolumesSnapshotsTestJSON-765148267 tempest-VolumesSnapshotsTestJSON-765148267-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/16bdc2dd-2d4a-4a9b-a3d6-53b24a384cb2" status: 200 len: 287 microversion: 2.1 time: 0.101569 May 24 15:20:00.476018 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 4/17] 10.222.0.45 () {58 vars in 1250 bytes} [Tue May 24 15:20:00 2022] GET /compute/v2.1/os-snapshots/16bdc2dd-2d4a-4a9b-a3d6-53b24a384cb2 => generated 287 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:20:00.658125 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-897555ce-b20b-4d1d-9169-d53bf9e0ef6e tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:00.658738 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-897555ce-b20b-4d1d-9169-d53bf9e0ef6e tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] [instance: 445c11ea-3365-4eb1-a467-bde08bb9ad98] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:00.790311 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-897555ce-b20b-4d1d-9169-d53bf9e0ef6e tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc17670edbb4cc797103b0d41835bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b175a657eab24493b2adbec405cbd515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:00.799407 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-897555ce-b20b-4d1d-9169-d53bf9e0ef6e tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] 10.222.0.45 "GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98" status: 200 len: 1214 microversion: 2.1 time: 0.145039 May 24 15:20:00.810996 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 14/18] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:00 2022] GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98 => generated 1214 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:20:01.484114 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f7d58131-7254-4364-b7c6-b3d434120024 tempest-VolumesSnapshotsTestJSON-765148267 tempest-VolumesSnapshotsTestJSON-765148267-project] Calling method '.version_select at 0x7f2dd83cc550>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:01.566774 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f7d58131-7254-4364-b7c6-b3d434120024 tempest-VolumesSnapshotsTestJSON-765148267 tempest-VolumesSnapshotsTestJSON-765148267-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/16bdc2dd-2d4a-4a9b-a3d6-53b24a384cb2" status: 200 len: 288 microversion: 2.1 time: 0.087548 May 24 15:20:01.567475 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 5/19] 10.222.0.45 () {58 vars in 1250 bytes} [Tue May 24 15:20:01 2022] GET /compute/v2.1/os-snapshots/16bdc2dd-2d4a-4a9b-a3d6-53b24a384cb2 => generated 288 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:20:01.579528 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-46a44353-3e8a-411d-813a-e8c76723a306 tempest-VolumesSnapshotsTestJSON-765148267 tempest-VolumesSnapshotsTestJSON-765148267-project] Calling method '.version_select at 0x7f2dd8bf3430>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:01.778714 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-46a44353-3e8a-411d-813a-e8c76723a306 tempest-VolumesSnapshotsTestJSON-765148267 tempest-VolumesSnapshotsTestJSON-765148267-project] 10.222.0.45 "DELETE /compute/v2.1/os-snapshots/16bdc2dd-2d4a-4a9b-a3d6-53b24a384cb2" status: 202 len: 0 microversion: 2.1 time: 0.194916 May 24 15:20:01.781139 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 15/20] 10.222.0.45 () {58 vars in 1253 bytes} [Tue May 24 15:20:01 2022] DELETE /compute/v2.1/os-snapshots/16bdc2dd-2d4a-4a9b-a3d6-53b24a384cb2 => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 15:20:01.787646 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-1422ae5b-b668-492e-bede-89fd668b1216 tempest-VolumesSnapshotsTestJSON-765148267 tempest-VolumesSnapshotsTestJSON-765148267-project] Calling method '.version_select at 0x7f2dd836c280>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:01.817920 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-a056970b-bbb4-4701-9569-a20584019c09 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:01.818745 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-a056970b-bbb4-4701-9569-a20584019c09 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] [instance: 445c11ea-3365-4eb1-a467-bde08bb9ad98] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:01.840844 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a056970b-bbb4-4701-9569-a20584019c09 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:01.844578 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a056970b-bbb4-4701-9569-a20584019c09 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:01.845575 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a056970b-bbb4-4701-9569-a20584019c09 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:01.847946 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a056970b-bbb4-4701-9569-a20584019c09 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:01.888975 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-1422ae5b-b668-492e-bede-89fd668b1216 tempest-VolumesSnapshotsTestJSON-765148267 tempest-VolumesSnapshotsTestJSON-765148267-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/16bdc2dd-2d4a-4a9b-a3d6-53b24a384cb2" status: 200 len: 287 microversion: 2.1 time: 0.105079 May 24 15:20:01.889681 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 6/21] 10.222.0.45 () {58 vars in 1250 bytes} [Tue May 24 15:20:01 2022] GET /compute/v2.1/os-snapshots/16bdc2dd-2d4a-4a9b-a3d6-53b24a384cb2 => generated 287 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:20:02.463760 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-a056970b-bbb4-4701-9569-a20584019c09 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc17670edbb4cc797103b0d41835bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b175a657eab24493b2adbec405cbd515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:02.500275 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-a056970b-bbb4-4701-9569-a20584019c09 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] 10.222.0.45 "GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98" status: 200 len: 1218 microversion: 2.1 time: 0.686682 May 24 15:20:02.512903 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 16/22] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:01 2022] GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98 => generated 1218 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:20:02.915026 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-b8314327-1913-43f7-82bb-163e53a5c2f4 tempest-VolumesSnapshotsTestJSON-765148267 tempest-VolumesSnapshotsTestJSON-765148267-project] Calling method '.version_select at 0x7f2dd83ccdc0>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:02.977134 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.wsgi [None req-b8314327-1913-43f7-82bb-163e53a5c2f4 tempest-VolumesSnapshotsTestJSON-765148267 tempest-VolumesSnapshotsTestJSON-765148267-project] HTTP exception thrown: Snapshot 16bdc2dd-2d4a-4a9b-a3d6-53b24a384cb2 could not be found. May 24 15:20:02.982385 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-b8314327-1913-43f7-82bb-163e53a5c2f4 tempest-VolumesSnapshotsTestJSON-765148267 tempest-VolumesSnapshotsTestJSON-765148267-project] Request method failure captured: May 24 15:20:02.982385 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: request: GET /compute/v2.1/os-snapshots/16bdc2dd-2d4a-4a9b-a3d6-53b24a384cb2 HTTP/1.1 May 24 15:20:02.982385 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Accept: application/json May 24 15:20:02.982385 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Accept-Encoding: identity May 24 15:20:02.982385 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Connection: close May 24 15:20:02.982385 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Content-Length: 0 May 24 15:20:02.982385 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Content-Type: application/json May 24 15:20:02.982385 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Host: 10.222.0.45 May 24 15:20:02.982385 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Openstack-System-Scope: None May 24 15:20:02.982385 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: User-Agent: python-urllib3/1.26.9 May 24 15:20:02.982385 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Auth-Token: gAAAAABijPeZzNytBDCje1vuj4cPuNzOCB10PcmTXboMPi6zgf2lgtbPnOAJdpE6zzQ3KQ4gc_5FmSA-S0kfgEMZoSqne6JxxFLuh2ZSo5Miqh9QYH1FsaHpT1wnI3GGkfaNtjz9YwuCauD7RfI_0n8uiiiWQm1FqenFajcAh6S4oIr5kgivVXc May 24 15:20:02.982385 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Domain-Id: None May 24 15:20:02.982385 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Domain-Name: None May 24 15:20:02.982385 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Identity-Status: Confirmed May 24 15:20:02.982385 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Is-Admin-Project: True May 24 15:20:02.982385 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Domain-Id: default May 24 15:20:02.982385 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Domain-Name: Default May 24 15:20:02.982385 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Id: e3d7790a5da14f9090ecbfc53c3f7b49 May 24 15:20:02.982385 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-765148267 May 24 15:20:02.982385 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Role: reader,member May 24 15:20:02.982385 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Roles: reader,member May 24 15:20:02.983773 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e3d7790a5da14f9090ecbfc53c3f7b49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e3d7790a5da14f9090ecbfc53c3f7b49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e3d7790a5da14f9090ecbfc53c3f7b49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e3d7790a5da14f9090ecbfc53c3f7b49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 24 15:20:02.983773 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant: tempest-VolumesSnapshotsTestJSON-765148267 May 24 15:20:02.983773 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant-Id: e3d7790a5da14f9090ecbfc53c3f7b49 May 24 15:20:02.983773 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-765148267 May 24 15:20:02.983773 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User: tempest-VolumesSnapshotsTestJSON-765148267-project May 24 15:20:02.983773 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Domain-Id: default May 24 15:20:02.983773 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Domain-Name: Default May 24 15:20:02.983773 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Id: 0905caa551494b479b47da44cc0b7de7 May 24 15:20:02.983773 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Name: tempest-VolumesSnapshotsTestJSON-765148267-project May 24 15:20:02.983773 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: method: May 24 15:20:02.983773 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: exception: Snapshot 16bdc2dd-2d4a-4a9b-a3d6-53b24a384cb2 could not be found. May 24 15:20:02.983773 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: action_args: {'id': '16bdc2dd-2d4a-4a9b-a3d6-53b24a384cb2'} May 24 15:20:02.983773 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:20:02.984515 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:20:02.984515 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 24 15:20:02.984515 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 24 15:20:02.984515 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 24 15:20:02.984515 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 24 15:20:02.984515 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 24 15:20:02.984515 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 24 15:20:02.984515 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 24 15:20:02.984515 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 24 15:20:02.984515 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 24 15:20:02.984515 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 24 15:20:02.984515 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 15:20:02.984515 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 15:20:02.984515 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 15:20:02.984515 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 15:20:02.984515 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 16bdc2dd-2d4a-4a9b-a3d6-53b24a384cb2 could not be found. (HTTP 404) (Request-ID: req-63e9244a-08a9-40cc-909f-0a0b0a006b40) May 24 15:20:02.984515 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:20:02.984515 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:20:02.985396 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:20:02.985396 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:20:02.985396 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 24 15:20:02.985396 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 24 15:20:02.985396 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 24 15:20:02.985396 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 24 15:20:02.985396 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 24 15:20:02.985396 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 24 15:20:02.985396 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 24 15:20:02.985396 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 24 15:20:02.985396 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 24 15:20:02.985396 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 24 15:20:02.985396 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 24 15:20:02.985396 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 24 15:20:02.985396 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 24 15:20:02.985396 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 24 15:20:02.985396 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 24 15:20:02.985396 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 24 15:20:02.985396 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 24 15:20:02.986226 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 24 15:20:02.986226 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 15:20:02.986226 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 15:20:02.986226 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 15:20:02.986226 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 15:20:02.986226 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 16bdc2dd-2d4a-4a9b-a3d6-53b24a384cb2 could not be found. May 24 15:20:02.986226 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:20:02.986226 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:20:02.986226 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:20:02.986226 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:20:02.986226 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:20:02.986226 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:20:02.986226 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:20:02.986226 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:20:02.986226 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 24 15:20:02.986226 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 24 15:20:02.986226 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:20:02.986226 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:20:02.986226 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 24 15:20:02.986226 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:20:02.987203 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 16bdc2dd-2d4a-4a9b-a3d6-53b24a384cb2 could not be found. May 24 15:20:02.987203 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:20:02.987203 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:20:02.987203 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:20:02.987203 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:20:02.987203 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:20:02.987203 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:20:02.987203 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:20:02.987203 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:20:02.987203 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 16bdc2dd-2d4a-4a9b-a3d6-53b24a384cb2 could not be found. May 24 15:20:02.987203 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:20:02.987706 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-b8314327-1913-43f7-82bb-163e53a5c2f4 tempest-VolumesSnapshotsTestJSON-765148267 tempest-VolumesSnapshotsTestJSON-765148267-project] Returning 404 to user: Snapshot 16bdc2dd-2d4a-4a9b-a3d6-53b24a384cb2 could not be found. {{(pid=117699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:20:02.999490 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-b8314327-1913-43f7-82bb-163e53a5c2f4 tempest-VolumesSnapshotsTestJSON-765148267 tempest-VolumesSnapshotsTestJSON-765148267-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/16bdc2dd-2d4a-4a9b-a3d6-53b24a384cb2" status: 404 len: 111 microversion: 2.1 time: 0.091100 May 24 15:20:03.000133 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 7/23] 10.222.0.45 () {58 vars in 1250 bytes} [Tue May 24 15:20:02 2022] GET /compute/v2.1/os-snapshots/16bdc2dd-2d4a-4a9b-a3d6-53b24a384cb2 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:20:03.009146 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-51f32579-2c8a-4a6f-98b7-86edb66dd940 tempest-VolumesSnapshotsTestJSON-765148267 tempest-VolumesSnapshotsTestJSON-765148267-project] Calling method '.version_select at 0x7f2dd8b71940>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:03.188797 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-51f32579-2c8a-4a6f-98b7-86edb66dd940 tempest-VolumesSnapshotsTestJSON-765148267 tempest-VolumesSnapshotsTestJSON-765148267-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/f5dd2920-ee08-4b26-a67a-84dda7d40c68" status: 202 len: 0 microversion: 2.1 time: 0.183683 May 24 15:20:03.189369 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 17/24] 10.222.0.45 () {58 vars in 1247 bytes} [Tue May 24 15:20:03 2022] DELETE /compute/v2.1/os-volumes/f5dd2920-ee08-4b26-a67a-84dda7d40c68 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 15:20:03.198214 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-8706ea2b-b4b9-4129-ae61-80e73a785abf tempest-VolumesSnapshotsTestJSON-765148267 tempest-VolumesSnapshotsTestJSON-765148267-project] Calling method '.version_select at 0x7f2dd9643280>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:03.354389 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-8706ea2b-b4b9-4129-ae61-80e73a785abf tempest-VolumesSnapshotsTestJSON-765148267 tempest-VolumesSnapshotsTestJSON-765148267-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/f5dd2920-ee08-4b26-a67a-84dda7d40c68" status: 200 len: 345 microversion: 2.1 time: 0.160352 May 24 15:20:03.356041 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 8/25] 10.222.0.45 () {58 vars in 1244 bytes} [Tue May 24 15:20:03 2022] GET /compute/v2.1/os-volumes/f5dd2920-ee08-4b26-a67a-84dda7d40c68 => generated 345 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:20:03.518822 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-0c683c7d-a3e2-46a9-bdec-0fdc699312af tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:03.519963 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-0c683c7d-a3e2-46a9-bdec-0fdc699312af tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] [instance: 445c11ea-3365-4eb1-a467-bde08bb9ad98] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:03.533518 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0c683c7d-a3e2-46a9-bdec-0fdc699312af tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:03.540523 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0c683c7d-a3e2-46a9-bdec-0fdc699312af tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:03.541398 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0c683c7d-a3e2-46a9-bdec-0fdc699312af tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:03.544723 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0c683c7d-a3e2-46a9-bdec-0fdc699312af tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:03.799312 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-0c683c7d-a3e2-46a9-bdec-0fdc699312af tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc17670edbb4cc797103b0d41835bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b175a657eab24493b2adbec405cbd515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:03.810929 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-0c683c7d-a3e2-46a9-bdec-0fdc699312af tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] 10.222.0.45 "GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98" status: 200 len: 1284 microversion: 2.1 time: 0.295806 May 24 15:20:03.826777 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 18/26] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:03 2022] GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98 => generated 1284 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:20:04.368216 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-dc1d8192-fb1c-4531-98c8-f8d14c8a9bc1 tempest-VolumesSnapshotsTestJSON-765148267 tempest-VolumesSnapshotsTestJSON-765148267-project] Calling method '.version_select at 0x7f2dd8b9f820>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:04.494517 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-dc1d8192-fb1c-4531-98c8-f8d14c8a9bc1 tempest-VolumesSnapshotsTestJSON-765148267 tempest-VolumesSnapshotsTestJSON-765148267-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/f5dd2920-ee08-4b26-a67a-84dda7d40c68" status: 200 len: 345 microversion: 2.1 time: 0.129997 May 24 15:20:04.496667 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 19/27] 10.222.0.45 () {58 vars in 1244 bytes} [Tue May 24 15:20:04 2022] GET /compute/v2.1/os-volumes/f5dd2920-ee08-4b26-a67a-84dda7d40c68 => generated 345 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:20:04.669943 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-ddc6e2fd-d492-4c36-be9b-b02085f68f89 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-705542715", "imageRef": "f921f75e-bbd1-4d99-ab1e-5cce2d895148", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:20:04.777319 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.network.neutron [None req-ddc6e2fd-d492-4c36-be9b-b02085f68f89 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] validate_networks() for [('80d9590c-ed37-4e01-9bdc-105e40ccc4fc', None, None, None, None, None)] {{(pid=117699) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 15:20:04.844083 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-9c6e310f-78d5-4e3f-b06e-2880ab02d05a tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:04.845555 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-9c6e310f-78d5-4e3f-b06e-2880ab02d05a tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] [instance: 445c11ea-3365-4eb1-a467-bde08bb9ad98] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:04.859157 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9c6e310f-78d5-4e3f-b06e-2880ab02d05a tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:04.859904 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9c6e310f-78d5-4e3f-b06e-2880ab02d05a tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:04.861326 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9c6e310f-78d5-4e3f-b06e-2880ab02d05a tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:04.865414 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9c6e310f-78d5-4e3f-b06e-2880ab02d05a tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:05.121507 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-9c6e310f-78d5-4e3f-b06e-2880ab02d05a tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc17670edbb4cc797103b0d41835bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b175a657eab24493b2adbec405cbd515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:05.129623 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-9c6e310f-78d5-4e3f-b06e-2880ab02d05a tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] 10.222.0.45 "GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98" status: 200 len: 1272 microversion: 2.1 time: 0.290550 May 24 15:20:05.130184 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 20/28] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:04 2022] GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98 => generated 1272 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:20:05.507798 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-0efa0d6d-6450-4cde-9b3f-2cb6311078e1 tempest-VolumesSnapshotsTestJSON-765148267 tempest-VolumesSnapshotsTestJSON-765148267-project] Calling method '.version_select at 0x7f2dd8b715e0>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:05.625132 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-0efa0d6d-6450-4cde-9b3f-2cb6311078e1 tempest-VolumesSnapshotsTestJSON-765148267 tempest-VolumesSnapshotsTestJSON-765148267-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/f5dd2920-ee08-4b26-a67a-84dda7d40c68" status: 200 len: 345 microversion: 2.1 time: 0.121731 May 24 15:20:05.625816 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 21/29] 10.222.0.45 () {58 vars in 1244 bytes} [Tue May 24 15:20:05 2022] GET /compute/v2.1/os-volumes/f5dd2920-ee08-4b26-a67a-84dda7d40c68 => generated 345 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:20:05.989815 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.virt.hardware [None req-ddc6e2fd-d492-4c36-be9b-b02085f68f89 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Flavor limits 0:0:0 {{(pid=117699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 15:20:05.991134 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.virt.hardware [None req-ddc6e2fd-d492-4c36-be9b-b02085f68f89 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Image limits 0:0:0 {{(pid=117699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 15:20:05.991822 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.virt.hardware [None req-ddc6e2fd-d492-4c36-be9b-b02085f68f89 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Flavor pref 0:0:0 {{(pid=117699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 15:20:05.992415 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.virt.hardware [None req-ddc6e2fd-d492-4c36-be9b-b02085f68f89 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Image pref 0:0:0 {{(pid=117699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 15:20:05.992885 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.virt.hardware [None req-ddc6e2fd-d492-4c36-be9b-b02085f68f89 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 15:20:06.009190 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ddc6e2fd-d492-4c36-be9b-b02085f68f89 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:06.009648 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ddc6e2fd-d492-4c36-be9b-b02085f68f89 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:06.010455 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ddc6e2fd-d492-4c36-be9b-b02085f68f89 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:06.010892 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ddc6e2fd-d492-4c36-be9b-b02085f68f89 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:06.063228 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.quota [None req-ddc6e2fd-d492-4c36-be9b-b02085f68f89 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Getting quotas for project e8d86717f1954ab7a59cdef0cf13556c. Resources: {'instances', 'ram', 'cores'} {{(pid=117699) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 15:20:06.080323 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.quota [None req-ddc6e2fd-d492-4c36-be9b-b02085f68f89 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Getting quotas for user 2d8a7414fd254ec981d35b417dc373cd and project e8d86717f1954ab7a59cdef0cf13556c. Resources: {'instances', 'ram', 'cores'} {{(pid=117699) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 15:20:06.105533 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-ddc6e2fd-d492-4c36-be9b-b02085f68f89 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Going to run 1 instances... {{(pid=117699) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 15:20:06.108122 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-ddc6e2fd-d492-4c36-be9b-b02085f68f89 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: d01bc80d-033e-4940-a604-b4f34ee070a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f921f75e-bbd1-4d99-ab1e-5cce2d895148',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 15:20:06.147903 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-367480b5-d9a4-4391-9d8a-001bace474e1 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:06.149034 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-367480b5-d9a4-4391-9d8a-001bace474e1 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] [instance: 445c11ea-3365-4eb1-a467-bde08bb9ad98] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:06.162644 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-ddc6e2fd-d492-4c36-be9b-b02085f68f89 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.949554 May 24 15:20:06.173444 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 9/30] 10.222.0.45 () {60 vars in 1146 bytes} [Tue May 24 15:20:04 2022] POST /compute/v2.1/servers => generated 383 bytes in 1961 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 15:20:06.179075 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f07e521e-52d9-41b5-84cc-d4ae9b8dfd4c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:06.180462 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f07e521e-52d9-41b5-84cc-d4ae9b8dfd4c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: d01bc80d-033e-4940-a604-b4f34ee070a9] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:06.184514 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-367480b5-d9a4-4391-9d8a-001bace474e1 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:06.187297 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-367480b5-d9a4-4391-9d8a-001bace474e1 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:06.194218 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-367480b5-d9a4-4391-9d8a-001bace474e1 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:06.195755 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-367480b5-d9a4-4391-9d8a-001bace474e1 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:06.498393 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-f07e521e-52d9-41b5-84cc-d4ae9b8dfd4c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:06.552375 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f07e521e-52d9-41b5-84cc-d4ae9b8dfd4c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9" status: 200 len: 1221 microversion: 2.1 time: 0.375734 May 24 15:20:06.568342 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 10/31] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:06 2022] GET /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9 => generated 1221 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:20:06.644175 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-4799f6f6-8b5f-43c3-bdc2-2e3ee271601d tempest-VolumesSnapshotsTestJSON-765148267 tempest-VolumesSnapshotsTestJSON-765148267-project] Calling method '.version_select at 0x7f2dd83494c0>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:06.731481 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.wsgi [None req-4799f6f6-8b5f-43c3-bdc2-2e3ee271601d tempest-VolumesSnapshotsTestJSON-765148267 tempest-VolumesSnapshotsTestJSON-765148267-project] HTTP exception thrown: Volume f5dd2920-ee08-4b26-a67a-84dda7d40c68 could not be found. May 24 15:20:06.736408 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-4799f6f6-8b5f-43c3-bdc2-2e3ee271601d tempest-VolumesSnapshotsTestJSON-765148267 tempest-VolumesSnapshotsTestJSON-765148267-project] Request method failure captured: May 24 15:20:06.736408 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: request: GET /compute/v2.1/os-volumes/f5dd2920-ee08-4b26-a67a-84dda7d40c68 HTTP/1.1 May 24 15:20:06.736408 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Accept: application/json May 24 15:20:06.736408 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Accept-Encoding: identity May 24 15:20:06.736408 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Connection: close May 24 15:20:06.736408 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Content-Length: 0 May 24 15:20:06.736408 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Content-Type: application/json May 24 15:20:06.736408 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Host: 10.222.0.45 May 24 15:20:06.736408 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Openstack-System-Scope: None May 24 15:20:06.736408 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: User-Agent: python-urllib3/1.26.9 May 24 15:20:06.736408 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Auth-Token: gAAAAABijPeZzNytBDCje1vuj4cPuNzOCB10PcmTXboMPi6zgf2lgtbPnOAJdpE6zzQ3KQ4gc_5FmSA-S0kfgEMZoSqne6JxxFLuh2ZSo5Miqh9QYH1FsaHpT1wnI3GGkfaNtjz9YwuCauD7RfI_0n8uiiiWQm1FqenFajcAh6S4oIr5kgivVXc May 24 15:20:06.736408 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Domain-Id: None May 24 15:20:06.736408 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Domain-Name: None May 24 15:20:06.736408 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Identity-Status: Confirmed May 24 15:20:06.736408 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Is-Admin-Project: True May 24 15:20:06.736408 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Domain-Id: default May 24 15:20:06.736408 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Domain-Name: Default May 24 15:20:06.736408 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Id: e3d7790a5da14f9090ecbfc53c3f7b49 May 24 15:20:06.736408 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-765148267 May 24 15:20:06.736408 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Role: reader,member May 24 15:20:06.736408 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Roles: reader,member May 24 15:20:06.737722 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e3d7790a5da14f9090ecbfc53c3f7b49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e3d7790a5da14f9090ecbfc53c3f7b49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e3d7790a5da14f9090ecbfc53c3f7b49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e3d7790a5da14f9090ecbfc53c3f7b49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 24 15:20:06.737722 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant: tempest-VolumesSnapshotsTestJSON-765148267 May 24 15:20:06.737722 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant-Id: e3d7790a5da14f9090ecbfc53c3f7b49 May 24 15:20:06.737722 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-765148267 May 24 15:20:06.737722 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User: tempest-VolumesSnapshotsTestJSON-765148267-project May 24 15:20:06.737722 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Domain-Id: default May 24 15:20:06.737722 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Domain-Name: Default May 24 15:20:06.737722 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Id: 0905caa551494b479b47da44cc0b7de7 May 24 15:20:06.737722 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Name: tempest-VolumesSnapshotsTestJSON-765148267-project May 24 15:20:06.737722 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: method: May 24 15:20:06.737722 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: exception: Volume f5dd2920-ee08-4b26-a67a-84dda7d40c68 could not be found. May 24 15:20:06.737722 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: action_args: {'id': 'f5dd2920-ee08-4b26-a67a-84dda7d40c68'} May 24 15:20:06.737722 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:20:06.738501 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:20:06.738501 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 15:20:06.738501 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 15:20:06.738501 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 24 15:20:06.738501 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi item = cinderclient( May 24 15:20:06.738501 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 24 15:20:06.738501 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 24 15:20:06.738501 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 24 15:20:06.738501 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 24 15:20:06.738501 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 24 15:20:06.738501 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 24 15:20:06.738501 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 15:20:06.738501 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 15:20:06.738501 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 15:20:06.738501 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 15:20:06.738501 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f5dd2920-ee08-4b26-a67a-84dda7d40c68 could not be found. (HTTP 404) (Request-ID: req-b2caaa07-351f-4b96-abde-c96b583d7855) May 24 15:20:06.738501 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:20:06.738501 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:20:06.738501 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:20:06.739667 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:20:06.739667 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 24 15:20:06.739667 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 24 15:20:06.739667 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 24 15:20:06.739667 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 24 15:20:06.739667 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 24 15:20:06.739667 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 24 15:20:06.739667 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 24 15:20:06.739667 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 24 15:20:06.739667 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 15:20:06.739667 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 15:20:06.739667 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 24 15:20:06.739667 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi item = cinderclient( May 24 15:20:06.739667 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 24 15:20:06.739667 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 24 15:20:06.739667 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 24 15:20:06.739667 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 24 15:20:06.739667 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 24 15:20:06.739667 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 24 15:20:06.740852 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 15:20:06.740852 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 15:20:06.740852 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 15:20:06.740852 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 15:20:06.740852 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f5dd2920-ee08-4b26-a67a-84dda7d40c68 could not be found. May 24 15:20:06.740852 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:20:06.740852 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:20:06.740852 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:20:06.740852 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:20:06.740852 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:20:06.740852 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:20:06.740852 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:20:06.740852 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:20:06.740852 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 24 15:20:06.740852 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 24 15:20:06.740852 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:20:06.740852 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:20:06.740852 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 24 15:20:06.740852 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:20:06.741832 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f5dd2920-ee08-4b26-a67a-84dda7d40c68 could not be found. May 24 15:20:06.741832 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:20:06.741832 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:20:06.741832 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:20:06.741832 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:20:06.741832 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:20:06.741832 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:20:06.741832 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:20:06.741832 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:20:06.741832 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f5dd2920-ee08-4b26-a67a-84dda7d40c68 could not be found. May 24 15:20:06.741832 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:20:06.741832 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-4799f6f6-8b5f-43c3-bdc2-2e3ee271601d tempest-VolumesSnapshotsTestJSON-765148267 tempest-VolumesSnapshotsTestJSON-765148267-project] Returning 404 to user: Volume f5dd2920-ee08-4b26-a67a-84dda7d40c68 could not be found. {{(pid=117699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:20:06.741832 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-4799f6f6-8b5f-43c3-bdc2-2e3ee271601d tempest-VolumesSnapshotsTestJSON-765148267 tempest-VolumesSnapshotsTestJSON-765148267-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/f5dd2920-ee08-4b26-a67a-84dda7d40c68" status: 404 len: 109 microversion: 2.1 time: 0.104542 May 24 15:20:06.743669 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 11/32] 10.222.0.45 () {58 vars in 1244 bytes} [Tue May 24 15:20:06 2022] GET /compute/v2.1/os-volumes/f5dd2920-ee08-4b26-a67a-84dda7d40c68 => generated 109 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:20:06.767565 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-9989a1be-86ae-4d5d-b60e-366ccba3fa70 tempest-VolumesSnapshotsTestJSON-765148267 tempest-VolumesSnapshotsTestJSON-765148267-project] Calling method '.version_select at 0x7f2dd83464c0>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:06.841108 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.wsgi [None req-9989a1be-86ae-4d5d-b60e-366ccba3fa70 tempest-VolumesSnapshotsTestJSON-765148267 tempest-VolumesSnapshotsTestJSON-765148267-project] HTTP exception thrown: Volume f5dd2920-ee08-4b26-a67a-84dda7d40c68 could not be found. May 24 15:20:06.843464 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-9989a1be-86ae-4d5d-b60e-366ccba3fa70 tempest-VolumesSnapshotsTestJSON-765148267 tempest-VolumesSnapshotsTestJSON-765148267-project] Request method failure captured: May 24 15:20:06.843464 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: request: DELETE /compute/v2.1/os-volumes/f5dd2920-ee08-4b26-a67a-84dda7d40c68 HTTP/1.1 May 24 15:20:06.843464 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Accept: application/json May 24 15:20:06.843464 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Accept-Encoding: identity May 24 15:20:06.843464 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Connection: close May 24 15:20:06.843464 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Content-Length: 0 May 24 15:20:06.843464 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Content-Type: application/json May 24 15:20:06.843464 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Host: 10.222.0.45 May 24 15:20:06.843464 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Openstack-System-Scope: None May 24 15:20:06.843464 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: User-Agent: python-urllib3/1.26.9 May 24 15:20:06.843464 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Auth-Token: gAAAAABijPeZzNytBDCje1vuj4cPuNzOCB10PcmTXboMPi6zgf2lgtbPnOAJdpE6zzQ3KQ4gc_5FmSA-S0kfgEMZoSqne6JxxFLuh2ZSo5Miqh9QYH1FsaHpT1wnI3GGkfaNtjz9YwuCauD7RfI_0n8uiiiWQm1FqenFajcAh6S4oIr5kgivVXc May 24 15:20:06.843464 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Domain-Id: None May 24 15:20:06.843464 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Domain-Name: None May 24 15:20:06.843464 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Identity-Status: Confirmed May 24 15:20:06.843464 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Is-Admin-Project: True May 24 15:20:06.843464 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Domain-Id: default May 24 15:20:06.843464 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Domain-Name: Default May 24 15:20:06.843464 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Id: e3d7790a5da14f9090ecbfc53c3f7b49 May 24 15:20:06.843464 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-765148267 May 24 15:20:06.843464 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Role: reader,member May 24 15:20:06.843464 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Roles: reader,member May 24 15:20:06.844670 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e3d7790a5da14f9090ecbfc53c3f7b49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e3d7790a5da14f9090ecbfc53c3f7b49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e3d7790a5da14f9090ecbfc53c3f7b49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e3d7790a5da14f9090ecbfc53c3f7b49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 24 15:20:06.844670 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant: tempest-VolumesSnapshotsTestJSON-765148267 May 24 15:20:06.844670 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant-Id: e3d7790a5da14f9090ecbfc53c3f7b49 May 24 15:20:06.844670 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-765148267 May 24 15:20:06.844670 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User: tempest-VolumesSnapshotsTestJSON-765148267-project May 24 15:20:06.844670 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Domain-Id: default May 24 15:20:06.844670 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Domain-Name: Default May 24 15:20:06.844670 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Id: 0905caa551494b479b47da44cc0b7de7 May 24 15:20:06.844670 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Name: tempest-VolumesSnapshotsTestJSON-765148267-project May 24 15:20:06.844670 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: method: May 24 15:20:06.844670 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: exception: Volume f5dd2920-ee08-4b26-a67a-84dda7d40c68 could not be found. May 24 15:20:06.844670 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: action_args: {'id': 'f5dd2920-ee08-4b26-a67a-84dda7d40c68'} May 24 15:20:06.844670 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:20:06.845457 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:20:06.845457 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 15:20:06.845457 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 15:20:06.845457 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 24 15:20:06.845457 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 24 15:20:06.845457 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 24 15:20:06.845457 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 24 15:20:06.845457 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 24 15:20:06.845457 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 24 15:20:06.845457 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 24 15:20:06.845457 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 24 15:20:06.845457 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 15:20:06.845457 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 15:20:06.845457 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 15:20:06.845457 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 15:20:06.845457 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f5dd2920-ee08-4b26-a67a-84dda7d40c68 could not be found. (HTTP 404) (Request-ID: req-ca677cac-f2c1-4813-968e-a00f7548569a) May 24 15:20:06.845457 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:20:06.845457 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:20:06.845457 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:20:06.846506 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:20:06.846506 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 24 15:20:06.846506 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 24 15:20:06.846506 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 24 15:20:06.846506 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 24 15:20:06.846506 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 24 15:20:06.846506 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 24 15:20:06.846506 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 24 15:20:06.846506 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 24 15:20:06.846506 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 15:20:06.846506 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 15:20:06.846506 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 24 15:20:06.846506 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 24 15:20:06.846506 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 24 15:20:06.846506 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 24 15:20:06.846506 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 24 15:20:06.846506 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 24 15:20:06.846506 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 24 15:20:06.846506 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 24 15:20:06.847551 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 15:20:06.847551 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 15:20:06.847551 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 15:20:06.847551 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 15:20:06.847551 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f5dd2920-ee08-4b26-a67a-84dda7d40c68 could not be found. May 24 15:20:06.847551 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:20:06.847551 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:20:06.847551 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:20:06.847551 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:20:06.847551 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:20:06.847551 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:20:06.847551 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:20:06.847551 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:20:06.847551 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 24 15:20:06.847551 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 24 15:20:06.847551 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:20:06.847551 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:20:06.847551 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 24 15:20:06.847551 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:20:06.848646 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f5dd2920-ee08-4b26-a67a-84dda7d40c68 could not be found. May 24 15:20:06.848646 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:20:06.848646 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:20:06.848646 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:20:06.848646 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:20:06.848646 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:20:06.848646 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:20:06.848646 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:20:06.848646 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:20:06.848646 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f5dd2920-ee08-4b26-a67a-84dda7d40c68 could not be found. May 24 15:20:06.848646 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:20:06.848646 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-9989a1be-86ae-4d5d-b60e-366ccba3fa70 tempest-VolumesSnapshotsTestJSON-765148267 tempest-VolumesSnapshotsTestJSON-765148267-project] Returning 404 to user: Volume f5dd2920-ee08-4b26-a67a-84dda7d40c68 could not be found. {{(pid=117699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:20:06.848646 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-9989a1be-86ae-4d5d-b60e-366ccba3fa70 tempest-VolumesSnapshotsTestJSON-765148267 tempest-VolumesSnapshotsTestJSON-765148267-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/f5dd2920-ee08-4b26-a67a-84dda7d40c68" status: 404 len: 109 microversion: 2.1 time: 0.100518 May 24 15:20:06.848646 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 12/33] 10.222.0.45 () {58 vars in 1247 bytes} [Tue May 24 15:20:06 2022] DELETE /compute/v2.1/os-volumes/f5dd2920-ee08-4b26-a67a-84dda7d40c68 => generated 109 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:20:06.863621 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-970f9433-5fac-4794-aff0-42a2c3ac307f tempest-VolumesSnapshotsTestJSON-765148267 tempest-VolumesSnapshotsTestJSON-765148267-project] Calling method '.version_select at 0x7f2dd83499d0>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:06.932227 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.wsgi [None req-970f9433-5fac-4794-aff0-42a2c3ac307f tempest-VolumesSnapshotsTestJSON-765148267 tempest-VolumesSnapshotsTestJSON-765148267-project] HTTP exception thrown: Volume f5dd2920-ee08-4b26-a67a-84dda7d40c68 could not be found. May 24 15:20:06.935302 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-970f9433-5fac-4794-aff0-42a2c3ac307f tempest-VolumesSnapshotsTestJSON-765148267 tempest-VolumesSnapshotsTestJSON-765148267-project] Request method failure captured: May 24 15:20:06.935302 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: request: GET /compute/v2.1/os-volumes/f5dd2920-ee08-4b26-a67a-84dda7d40c68 HTTP/1.1 May 24 15:20:06.935302 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Accept: application/json May 24 15:20:06.935302 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Accept-Encoding: identity May 24 15:20:06.935302 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Connection: close May 24 15:20:06.935302 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Content-Length: 0 May 24 15:20:06.935302 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Content-Type: application/json May 24 15:20:06.935302 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Host: 10.222.0.45 May 24 15:20:06.935302 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Openstack-System-Scope: None May 24 15:20:06.935302 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: User-Agent: python-urllib3/1.26.9 May 24 15:20:06.935302 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Auth-Token: gAAAAABijPeZzNytBDCje1vuj4cPuNzOCB10PcmTXboMPi6zgf2lgtbPnOAJdpE6zzQ3KQ4gc_5FmSA-S0kfgEMZoSqne6JxxFLuh2ZSo5Miqh9QYH1FsaHpT1wnI3GGkfaNtjz9YwuCauD7RfI_0n8uiiiWQm1FqenFajcAh6S4oIr5kgivVXc May 24 15:20:06.935302 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Domain-Id: None May 24 15:20:06.935302 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Domain-Name: None May 24 15:20:06.935302 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Identity-Status: Confirmed May 24 15:20:06.935302 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Is-Admin-Project: True May 24 15:20:06.935302 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Domain-Id: default May 24 15:20:06.935302 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Domain-Name: Default May 24 15:20:06.935302 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Id: e3d7790a5da14f9090ecbfc53c3f7b49 May 24 15:20:06.935302 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-765148267 May 24 15:20:06.935302 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Role: reader,member May 24 15:20:06.935302 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Roles: reader,member May 24 15:20:06.936462 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e3d7790a5da14f9090ecbfc53c3f7b49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e3d7790a5da14f9090ecbfc53c3f7b49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e3d7790a5da14f9090ecbfc53c3f7b49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e3d7790a5da14f9090ecbfc53c3f7b49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 24 15:20:06.936462 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant: tempest-VolumesSnapshotsTestJSON-765148267 May 24 15:20:06.936462 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant-Id: e3d7790a5da14f9090ecbfc53c3f7b49 May 24 15:20:06.936462 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-765148267 May 24 15:20:06.936462 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User: tempest-VolumesSnapshotsTestJSON-765148267-project May 24 15:20:06.936462 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Domain-Id: default May 24 15:20:06.936462 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Domain-Name: Default May 24 15:20:06.936462 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Id: 0905caa551494b479b47da44cc0b7de7 May 24 15:20:06.936462 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Name: tempest-VolumesSnapshotsTestJSON-765148267-project May 24 15:20:06.936462 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: method: May 24 15:20:06.936462 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: exception: Volume f5dd2920-ee08-4b26-a67a-84dda7d40c68 could not be found. May 24 15:20:06.936462 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: action_args: {'id': 'f5dd2920-ee08-4b26-a67a-84dda7d40c68'} May 24 15:20:06.936462 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:20:06.937151 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:20:06.937151 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 15:20:06.937151 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 15:20:06.937151 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 24 15:20:06.937151 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi item = cinderclient( May 24 15:20:06.937151 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 24 15:20:06.937151 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 24 15:20:06.937151 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 24 15:20:06.937151 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 24 15:20:06.937151 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 24 15:20:06.937151 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 24 15:20:06.937151 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 15:20:06.937151 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 15:20:06.937151 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 15:20:06.937151 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 15:20:06.937151 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f5dd2920-ee08-4b26-a67a-84dda7d40c68 could not be found. (HTTP 404) (Request-ID: req-e4740666-a7c8-4440-a8a9-bba3fef3a22f) May 24 15:20:06.937151 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:20:06.937151 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:20:06.937151 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:20:06.938059 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:20:06.938059 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 24 15:20:06.938059 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 24 15:20:06.938059 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 24 15:20:06.938059 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 24 15:20:06.938059 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 24 15:20:06.938059 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 24 15:20:06.938059 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 24 15:20:06.938059 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 24 15:20:06.938059 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 15:20:06.938059 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 15:20:06.938059 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 24 15:20:06.938059 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi item = cinderclient( May 24 15:20:06.938059 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 24 15:20:06.938059 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 24 15:20:06.938059 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 24 15:20:06.938059 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 24 15:20:06.938059 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 24 15:20:06.938059 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 24 15:20:06.938886 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 15:20:06.938886 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 15:20:06.938886 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 15:20:06.938886 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 15:20:06.938886 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f5dd2920-ee08-4b26-a67a-84dda7d40c68 could not be found. May 24 15:20:06.938886 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:20:06.938886 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:20:06.938886 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:20:06.938886 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:20:06.938886 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:20:06.938886 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:20:06.938886 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:20:06.938886 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:20:06.938886 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 24 15:20:06.938886 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 24 15:20:06.938886 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:20:06.938886 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:20:06.938886 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 24 15:20:06.938886 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:20:06.939705 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f5dd2920-ee08-4b26-a67a-84dda7d40c68 could not be found. May 24 15:20:06.939705 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:20:06.939705 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:20:06.939705 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:20:06.939705 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:20:06.939705 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:20:06.939705 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:20:06.939705 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:20:06.939705 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:20:06.939705 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f5dd2920-ee08-4b26-a67a-84dda7d40c68 could not be found. May 24 15:20:06.939705 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:20:06.941243 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-970f9433-5fac-4794-aff0-42a2c3ac307f tempest-VolumesSnapshotsTestJSON-765148267 tempest-VolumesSnapshotsTestJSON-765148267-project] Returning 404 to user: Volume f5dd2920-ee08-4b26-a67a-84dda7d40c68 could not be found. {{(pid=117699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:20:06.942365 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-970f9433-5fac-4794-aff0-42a2c3ac307f tempest-VolumesSnapshotsTestJSON-765148267 tempest-VolumesSnapshotsTestJSON-765148267-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/f5dd2920-ee08-4b26-a67a-84dda7d40c68" status: 404 len: 109 microversion: 2.1 time: 0.091822 May 24 15:20:06.943090 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 13/34] 10.222.0.45 () {58 vars in 1244 bytes} [Tue May 24 15:20:06 2022] GET /compute/v2.1/os-volumes/f5dd2920-ee08-4b26-a67a-84dda7d40c68 => generated 109 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:20:06.954146 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-10572787-da19-479b-a50b-b2907b88457c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1906024586", "imageRef": "f921f75e-bbd1-4d99-ab1e-5cce2d895148", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:20:07.023445 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.network.neutron [None req-10572787-da19-479b-a50b-b2907b88457c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] validate_networks() for [('80d9590c-ed37-4e01-9bdc-105e40ccc4fc', None, None, None, None, None)] {{(pid=117699) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 15:20:07.217469 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-367480b5-d9a4-4391-9d8a-001bace474e1 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc17670edbb4cc797103b0d41835bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b175a657eab24493b2adbec405cbd515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:07.227541 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-367480b5-d9a4-4391-9d8a-001bace474e1 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] 10.222.0.45 "GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98" status: 200 len: 1272 microversion: 2.1 time: 1.084121 May 24 15:20:07.228359 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 22/35] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:06 2022] GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98 => generated 1272 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:20:08.075957 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.virt.hardware [None req-10572787-da19-479b-a50b-b2907b88457c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Flavor limits 0:0:0 {{(pid=117699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 15:20:08.076993 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.virt.hardware [None req-10572787-da19-479b-a50b-b2907b88457c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Image limits 0:0:0 {{(pid=117699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 15:20:08.077655 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.virt.hardware [None req-10572787-da19-479b-a50b-b2907b88457c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Flavor pref 0:0:0 {{(pid=117699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 15:20:08.078229 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.virt.hardware [None req-10572787-da19-479b-a50b-b2907b88457c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Image pref 0:0:0 {{(pid=117699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 15:20:08.078851 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.virt.hardware [None req-10572787-da19-479b-a50b-b2907b88457c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 15:20:08.116001 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-10572787-da19-479b-a50b-b2907b88457c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:08.116431 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-10572787-da19-479b-a50b-b2907b88457c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:08.122498 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-10572787-da19-479b-a50b-b2907b88457c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:08.125256 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-10572787-da19-479b-a50b-b2907b88457c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:08.234051 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.quota [None req-10572787-da19-479b-a50b-b2907b88457c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Getting quotas for project e8d86717f1954ab7a59cdef0cf13556c. Resources: {'instances', 'ram', 'cores'} {{(pid=117699) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 15:20:08.255290 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.quota [None req-10572787-da19-479b-a50b-b2907b88457c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Getting quotas for user 2d8a7414fd254ec981d35b417dc373cd and project e8d86717f1954ab7a59cdef0cf13556c. Resources: {'instances', 'ram', 'cores'} {{(pid=117699) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 15:20:08.335855 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-10572787-da19-479b-a50b-b2907b88457c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Going to run 1 instances... {{(pid=117699) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 15:20:08.351563 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-10572787-da19-479b-a50b-b2907b88457c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: baacc852-cde4-4e1a-ade9-183a97312b6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f921f75e-bbd1-4d99-ab1e-5cce2d895148',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 15:20:08.658610 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-10572787-da19-479b-a50b-b2907b88457c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.705572 May 24 15:20:08.659338 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 14/36] 10.222.0.45 () {60 vars in 1146 bytes} [Tue May 24 15:20:06 2022] POST /compute/v2.1/servers => generated 383 bytes in 1712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 15:20:08.725621 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-80b37ced-0d88-443c-b697-a5b89e7a63b0 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:08.737672 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-80b37ced-0d88-443c-b697-a5b89e7a63b0 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] [instance: 445c11ea-3365-4eb1-a467-bde08bb9ad98] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:08.781105 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-80b37ced-0d88-443c-b697-a5b89e7a63b0 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:08.785928 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-80b37ced-0d88-443c-b697-a5b89e7a63b0 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:08.786798 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-80b37ced-0d88-443c-b697-a5b89e7a63b0 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:08.787242 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-80b37ced-0d88-443c-b697-a5b89e7a63b0 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:09.631057 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-4b511bd2-2326-4d92-9030-233f7da50d46 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Action: 'create', calling method: .version_select at 0x7f2dd8b93280>, body: {"keypair": {"name": "tempest-keypair-1913796150", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8W5QDW2mPYw3moJl6WA0zfHnQFUlLFUoeu/ZIJIejaGT+1zZkh2duRTEgTwtqu9IpdsIRM3kJ4NHDORicF4hlUAwfQmpXM0DLtVvsQgJSOh3GcKC3XCjLIpTLqliOxAQ=="}} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:20:09.882937 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.quota [None req-4b511bd2-2326-4d92-9030-233f7da50d46 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Getting quotas for project 0812b13a287c43259d7e09b0c658d4c8. Resources: {'key_pairs'} {{(pid=117698) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 15:20:09.915368 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.quota [None req-4b511bd2-2326-4d92-9030-233f7da50d46 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Getting quotas for user 2befe74ad06542b785d326101fc06d0b and project 0812b13a287c43259d7e09b0c658d4c8. Resources: {'key_pairs'} {{(pid=117698) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 15:20:09.927649 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-80b37ced-0d88-443c-b697-a5b89e7a63b0 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc17670edbb4cc797103b0d41835bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b175a657eab24493b2adbec405cbd515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:10.006737 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-80b37ced-0d88-443c-b697-a5b89e7a63b0 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] 10.222.0.45 "GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98" status: 200 len: 1272 microversion: 2.1 time: 1.330711 May 24 15:20:10.017678 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 15/37] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:08 2022] GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98 => generated 1272 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:20:10.039730 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-5982782d-6ff7-4028-8003-a527a4a0b2b6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:10.040421 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-5982782d-6ff7-4028-8003-a527a4a0b2b6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: baacc852-cde4-4e1a-ade9-183a97312b6f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:10.067665 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5982782d-6ff7-4028-8003-a527a4a0b2b6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:10.077394 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5982782d-6ff7-4028-8003-a527a4a0b2b6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:10.079374 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5982782d-6ff7-4028-8003-a527a4a0b2b6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:10.084921 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5982782d-6ff7-4028-8003-a527a4a0b2b6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:10.109784 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-4b511bd2-2326-4d92-9030-233f7da50d46 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.981550 May 24 15:20:10.112606 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 23/38] 10.222.0.45 () {60 vars in 1158 bytes} [Tue May 24 15:20:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1985 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:20:10.798152 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-5982782d-6ff7-4028-8003-a527a4a0b2b6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:10.813296 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-5982782d-6ff7-4028-8003-a527a4a0b2b6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f" status: 200 len: 1226 microversion: 2.1 time: 0.799654 May 24 15:20:10.839535 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 16/39] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:10 2022] GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f => generated 1226 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:20:11.025982 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-cba7a830-2f86-4af3-8ed3-6757d16ccc68 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:11.037141 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-cba7a830-2f86-4af3-8ed3-6757d16ccc68 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] [instance: 445c11ea-3365-4eb1-a467-bde08bb9ad98] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:11.046087 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cba7a830-2f86-4af3-8ed3-6757d16ccc68 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:11.056066 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cba7a830-2f86-4af3-8ed3-6757d16ccc68 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:11.057310 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cba7a830-2f86-4af3-8ed3-6757d16ccc68 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:11.058004 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cba7a830-2f86-4af3-8ed3-6757d16ccc68 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:11.422538 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-cba7a830-2f86-4af3-8ed3-6757d16ccc68 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc17670edbb4cc797103b0d41835bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b175a657eab24493b2adbec405cbd515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:11.444363 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-cba7a830-2f86-4af3-8ed3-6757d16ccc68 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] 10.222.0.45 "GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98" status: 200 len: 1272 microversion: 2.1 time: 0.420590 May 24 15:20:11.447948 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 24/40] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:11 2022] GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98 => generated 1272 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:20:11.831783 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f59cbbdd-6c07-445f-b098-fa33885bc79b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:11.833247 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f59cbbdd-6c07-445f-b098-fa33885bc79b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: baacc852-cde4-4e1a-ade9-183a97312b6f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:11.859439 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f59cbbdd-6c07-445f-b098-fa33885bc79b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:11.865024 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f59cbbdd-6c07-445f-b098-fa33885bc79b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:11.867365 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f59cbbdd-6c07-445f-b098-fa33885bc79b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:11.870226 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f59cbbdd-6c07-445f-b098-fa33885bc79b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:12.470239 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-bb257637-3138-46ff-9c86-d5db873dd2e2 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:12.471702 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-bb257637-3138-46ff-9c86-d5db873dd2e2 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] [instance: 445c11ea-3365-4eb1-a467-bde08bb9ad98] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:12.487333 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bb257637-3138-46ff-9c86-d5db873dd2e2 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:12.488027 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bb257637-3138-46ff-9c86-d5db873dd2e2 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:12.489235 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bb257637-3138-46ff-9c86-d5db873dd2e2 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:12.489911 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bb257637-3138-46ff-9c86-d5db873dd2e2 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:12.687986 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-f59cbbdd-6c07-445f-b098-fa33885bc79b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:12.715951 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f59cbbdd-6c07-445f-b098-fa33885bc79b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f" status: 200 len: 1274 microversion: 2.1 time: 0.886333 May 24 15:20:12.718547 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 17/41] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:11 2022] GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f => generated 1274 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:20:13.737036 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-dd0034d0-0e3a-4045-838c-7179392fcc91 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:13.738573 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-dd0034d0-0e3a-4045-838c-7179392fcc91 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: baacc852-cde4-4e1a-ade9-183a97312b6f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:13.753693 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dd0034d0-0e3a-4045-838c-7179392fcc91 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:13.756032 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dd0034d0-0e3a-4045-838c-7179392fcc91 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:13.759418 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dd0034d0-0e3a-4045-838c-7179392fcc91 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:13.764060 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dd0034d0-0e3a-4045-838c-7179392fcc91 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:13.911498 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-bb257637-3138-46ff-9c86-d5db873dd2e2 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc17670edbb4cc797103b0d41835bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b175a657eab24493b2adbec405cbd515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:13.923665 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-bb257637-3138-46ff-9c86-d5db873dd2e2 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] 10.222.0.45 "GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98" status: 200 len: 1314 microversion: 2.1 time: 1.460083 May 24 15:20:13.926459 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 25/42] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:12 2022] GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98 => generated 1314 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:20:14.643688 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-dd0034d0-0e3a-4045-838c-7179392fcc91 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:14.688448 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-dd0034d0-0e3a-4045-838c-7179392fcc91 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f" status: 200 len: 1280 microversion: 2.1 time: 0.955749 May 24 15:20:14.690455 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 18/43] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:13 2022] GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f => generated 1280 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:20:14.942021 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-87b52f19-8ce8-4d1a-aea1-90b2b72bfd7a tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:14.943531 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-87b52f19-8ce8-4d1a-aea1-90b2b72bfd7a tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] [instance: 445c11ea-3365-4eb1-a467-bde08bb9ad98] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:14.961090 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-87b52f19-8ce8-4d1a-aea1-90b2b72bfd7a tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:14.961795 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-87b52f19-8ce8-4d1a-aea1-90b2b72bfd7a tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:14.965635 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-87b52f19-8ce8-4d1a-aea1-90b2b72bfd7a tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:14.967605 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-87b52f19-8ce8-4d1a-aea1-90b2b72bfd7a tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:15.999665 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-2c19286e-f747-413e-b181-401a37bbccdf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Action: 'create', calling method: .version_select at 0x7f2dd8235820>, body: {"keypair": {"name": "tempest-keypair-1810429186", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKW0xU7qw6U/ffu1y2ETM0a5V1Xwrf1TwZxZtXVoX1ufDF2vxh2Z+cFDsYDUkITMjTxJ0B7Hitimsenia3caftFmlDInfrl0lgTpcO2sAR4wVO6Bx1jTup0y3zm6n7nD4g=="}} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:20:16.060988 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.quota [None req-2c19286e-f747-413e-b181-401a37bbccdf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Getting quotas for project 0fe1d758c40542e9b237f9d7bcfa5755. Resources: {'key_pairs'} {{(pid=117699) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 15:20:16.093902 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.quota [None req-2c19286e-f747-413e-b181-401a37bbccdf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Getting quotas for user 40db5795ce7e4c5bbf06fb81ce404e78 and project 0fe1d758c40542e9b237f9d7bcfa5755. Resources: {'key_pairs'} {{(pid=117699) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 15:20:16.180593 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-2c19286e-f747-413e-b181-401a37bbccdf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.177645 May 24 15:20:16.181704 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 19/44] 10.222.0.45 () {62 vars in 1199 bytes} [Tue May 24 15:20:15 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1180 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 24 15:20:16.193333 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-674a5e5c-59f6-4f57-9e3a-b210cd0896d1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:16.194198 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-674a5e5c-59f6-4f57-9e3a-b210cd0896d1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: baacc852-cde4-4e1a-ade9-183a97312b6f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:16.207877 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-674a5e5c-59f6-4f57-9e3a-b210cd0896d1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:16.210581 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-674a5e5c-59f6-4f57-9e3a-b210cd0896d1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:16.215252 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-674a5e5c-59f6-4f57-9e3a-b210cd0896d1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:16.216088 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-674a5e5c-59f6-4f57-9e3a-b210cd0896d1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:17.152116 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-87b52f19-8ce8-4d1a-aea1-90b2b72bfd7a tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc17670edbb4cc797103b0d41835bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b175a657eab24493b2adbec405cbd515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:17.164095 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-87b52f19-8ce8-4d1a-aea1-90b2b72bfd7a tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] 10.222.0.45 "GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98" status: 200 len: 1314 microversion: 2.1 time: 2.225929 May 24 15:20:17.171714 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 26/45] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:14 2022] GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98 => generated 1314 bytes in 2234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:20:17.705628 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-674a5e5c-59f6-4f57-9e3a-b210cd0896d1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:17.718370 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-674a5e5c-59f6-4f57-9e3a-b210cd0896d1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f" status: 200 len: 1322 microversion: 2.1 time: 1.535304 May 24 15:20:17.720992 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 20/46] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:16 2022] GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f => generated 1322 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:20:17.986819 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-594e6e8c-935a-4d1d-9ae4-24680689b486 tempest-VolumesNegativeTest-1336256853 tempest-VolumesNegativeTest-1336256853-project] Action: 'create', calling method: .version_select at 0x7f2dd82d13a0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1903375341", "metadata": {"Type": "work"}}} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:20:18.020715 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-594e6e8c-935a-4d1d-9ae4-24680689b486 tempest-VolumesNegativeTest-1336256853 tempest-VolumesNegativeTest-1336256853-project] Request method failure captured: May 24 15:20:18.020715 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 24 15:20:18.020715 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Accept: application/json May 24 15:20:18.020715 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Accept-Encoding: identity May 24 15:20:18.020715 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Connection: close May 24 15:20:18.020715 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Content-Length: 122 May 24 15:20:18.020715 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Content-Type: application/json May 24 15:20:18.020715 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Host: 10.222.0.45 May 24 15:20:18.020715 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Openstack-System-Scope: None May 24 15:20:18.020715 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: User-Agent: python-urllib3/1.26.9 May 24 15:20:18.020715 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Auth-Token: gAAAAABijPew8TWc9ysGpFoA948KouZfki52B7yl9B24N74MYfa-_RCBM3nTmajsfk4c38ePOeBPD9if4pdUmU5stabuuIQE6rgdPZDj7pvMoYwQJPG6F6g4nL2ipGtE6ENleC4a4X9zRvDye7UTFSeD6ctqTDfHPzgJisozmQ981OSWpOAonlQ May 24 15:20:18.020715 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Domain-Id: None May 24 15:20:18.020715 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Domain-Name: None May 24 15:20:18.020715 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Identity-Status: Confirmed May 24 15:20:18.020715 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Is-Admin-Project: True May 24 15:20:18.020715 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Domain-Id: default May 24 15:20:18.020715 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Domain-Name: Default May 24 15:20:18.020715 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Id: c2b0f66ad6bb4ece98ea1859904d2a11 May 24 15:20:18.020715 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Name: tempest-VolumesNegativeTest-1336256853 May 24 15:20:18.020715 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Role: reader,member May 24 15:20:18.020715 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Roles: reader,member May 24 15:20:18.021909 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c2b0f66ad6bb4ece98ea1859904d2a11"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c2b0f66ad6bb4ece98ea1859904d2a11"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c2b0f66ad6bb4ece98ea1859904d2a11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c2b0f66ad6bb4ece98ea1859904d2a11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 24 15:20:18.021909 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Tenant: tempest-VolumesNegativeTest-1336256853 May 24 15:20:18.021909 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Tenant-Id: c2b0f66ad6bb4ece98ea1859904d2a11 May 24 15:20:18.021909 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Tenant-Name: tempest-VolumesNegativeTest-1336256853 May 24 15:20:18.021909 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User: tempest-VolumesNegativeTest-1336256853-project May 24 15:20:18.021909 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Domain-Id: default May 24 15:20:18.021909 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Domain-Name: Default May 24 15:20:18.021909 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Id: 9fe7d2ed13994dcf91884ac89dda3a0a May 24 15:20:18.021909 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Name: tempest-VolumesNegativeTest-1336256853-project May 24 15:20:18.021909 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: May 24 15:20:18.021909 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1903375341", "metadata": {"Type": "work"}}} May 24 15:20:18.021909 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: method: May 24 15:20:18.021909 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 24 15:20:18.022587 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1903375341', 'metadata': {'Type': 'work'}}}} May 24 15:20:18.022587 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:20:18.022587 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:20:18.022587 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 24 15:20:18.022587 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 24 15:20:18.022587 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 24 15:20:18.022587 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise error May 24 15:20:18.022587 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 24 15:20:18.022587 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:20:18.022587 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 24 15:20:18.022587 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 24 15:20:18.022587 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:20:18.022587 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi On instance['volume']: May 24 15:20:18.022587 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi '#$%' May 24 15:20:18.022587 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:20:18.022587 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:20:18.022587 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:20:18.022587 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:20:18.022587 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:20:18.022587 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:20:18.022587 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:20:18.022587 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:20:18.023656 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 24 15:20:18.023656 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 24 15:20:18.023656 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:20:18.023656 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:20:18.023656 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 24 15:20:18.023656 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 24 15:20:18.023656 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 24 15:20:18.023656 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 24 15:20:18.023656 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 24 15:20:18.023656 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 24 15:20:18.023656 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 24 15:20:18.023656 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:20:18.023656 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:20:18.023656 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:20:18.023656 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:20:18.023656 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:20:18.023656 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:20:18.023656 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 24 15:20:18.023656 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 24 15:20:18.025384 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 24 15:20:18.025384 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:20:18.026425 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-594e6e8c-935a-4d1d-9ae4-24680689b486 tempest-VolumesNegativeTest-1336256853 tempest-VolumesNegativeTest-1336256853-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:20:18.027509 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-594e6e8c-935a-4d1d-9ae4-24680689b486 tempest-VolumesNegativeTest-1336256853 tempest-VolumesNegativeTest-1336256853-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.853916 May 24 15:20:18.028587 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 27/47] 10.222.0.45 () {60 vars in 1155 bytes} [Tue May 24 15:20:17 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 856 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 24 15:20:18.039890 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-3f975f5c-ec1c-41e5-a376-0c9cebd383e5 tempest-VolumesNegativeTest-1336256853 tempest-VolumesNegativeTest-1336256853-project] Action: 'create', calling method: .version_select at 0x7f2dd825e1f0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1126513754", "metadata": {"Type": "work"}}} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:20:18.044645 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-3f975f5c-ec1c-41e5-a376-0c9cebd383e5 tempest-VolumesNegativeTest-1336256853 tempest-VolumesNegativeTest-1336256853-project] Request method failure captured: May 24 15:20:18.044645 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 24 15:20:18.044645 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Accept: application/json May 24 15:20:18.044645 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Accept-Encoding: identity May 24 15:20:18.044645 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Connection: close May 24 15:20:18.044645 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Content-Length: 120 May 24 15:20:18.044645 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Content-Type: application/json May 24 15:20:18.044645 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Host: 10.222.0.45 May 24 15:20:18.044645 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Openstack-System-Scope: None May 24 15:20:18.044645 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: User-Agent: python-urllib3/1.26.9 May 24 15:20:18.044645 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Auth-Token: gAAAAABijPew8TWc9ysGpFoA948KouZfki52B7yl9B24N74MYfa-_RCBM3nTmajsfk4c38ePOeBPD9if4pdUmU5stabuuIQE6rgdPZDj7pvMoYwQJPG6F6g4nL2ipGtE6ENleC4a4X9zRvDye7UTFSeD6ctqTDfHPzgJisozmQ981OSWpOAonlQ May 24 15:20:18.044645 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Domain-Id: None May 24 15:20:18.044645 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Domain-Name: None May 24 15:20:18.044645 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Identity-Status: Confirmed May 24 15:20:18.044645 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Is-Admin-Project: True May 24 15:20:18.044645 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Domain-Id: default May 24 15:20:18.044645 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Domain-Name: Default May 24 15:20:18.044645 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Id: c2b0f66ad6bb4ece98ea1859904d2a11 May 24 15:20:18.044645 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Name: tempest-VolumesNegativeTest-1336256853 May 24 15:20:18.044645 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Role: reader,member May 24 15:20:18.044645 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Roles: reader,member May 24 15:20:18.045740 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c2b0f66ad6bb4ece98ea1859904d2a11"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c2b0f66ad6bb4ece98ea1859904d2a11"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c2b0f66ad6bb4ece98ea1859904d2a11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c2b0f66ad6bb4ece98ea1859904d2a11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 24 15:20:18.045740 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant: tempest-VolumesNegativeTest-1336256853 May 24 15:20:18.045740 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant-Id: c2b0f66ad6bb4ece98ea1859904d2a11 May 24 15:20:18.045740 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant-Name: tempest-VolumesNegativeTest-1336256853 May 24 15:20:18.045740 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User: tempest-VolumesNegativeTest-1336256853-project May 24 15:20:18.045740 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Domain-Id: default May 24 15:20:18.045740 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Domain-Name: Default May 24 15:20:18.045740 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Id: 9fe7d2ed13994dcf91884ac89dda3a0a May 24 15:20:18.045740 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Name: tempest-VolumesNegativeTest-1336256853-project May 24 15:20:18.045740 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: May 24 15:20:18.045740 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1126513754", "metadata": {"Type": "work"}}} May 24 15:20:18.045740 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: method: May 24 15:20:18.045740 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 24 15:20:18.046442 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1126513754', 'metadata': {'Type': 'work'}}}} May 24 15:20:18.046442 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:20:18.046442 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:20:18.046442 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 24 15:20:18.046442 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 24 15:20:18.046442 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 24 15:20:18.046442 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise error May 24 15:20:18.046442 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 24 15:20:18.046442 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:20:18.046442 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 24 15:20:18.046442 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 24 15:20:18.046442 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:20:18.046442 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi On instance['volume']: May 24 15:20:18.046442 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi '0' May 24 15:20:18.046442 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:20:18.046442 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:20:18.046442 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:20:18.046442 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:20:18.046442 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:20:18.046442 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:20:18.046442 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:20:18.046442 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:20:18.047471 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 24 15:20:18.047471 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 24 15:20:18.047471 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:20:18.047471 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:20:18.047471 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 24 15:20:18.047471 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 24 15:20:18.047471 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 24 15:20:18.047471 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 24 15:20:18.047471 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 24 15:20:18.047471 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 24 15:20:18.047471 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 24 15:20:18.047471 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:20:18.047471 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:20:18.047471 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:20:18.047471 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:20:18.047471 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:20:18.047471 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:20:18.047471 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 24 15:20:18.047471 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 24 15:20:18.048388 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 24 15:20:18.048388 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:20:18.048388 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-3f975f5c-ec1c-41e5-a376-0c9cebd383e5 tempest-VolumesNegativeTest-1336256853 tempest-VolumesNegativeTest-1336256853-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:20:18.058526 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-3f975f5c-ec1c-41e5-a376-0c9cebd383e5 tempest-VolumesNegativeTest-1336256853 tempest-VolumesNegativeTest-1336256853-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.014213 May 24 15:20:18.060439 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 21/48] 10.222.0.45 () {60 vars in 1155 bytes} [Tue May 24 15:20:18 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 24 15:20:18.071983 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-63c796df-a9ab-43a4-8624-13b6794d3a39 tempest-VolumesNegativeTest-1336256853 tempest-VolumesNegativeTest-1336256853-project] Action: 'create', calling method: .version_select at 0x7f2dd82d21f0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-629551765", "metadata": {"Type": "work"}}} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:20:18.075931 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-63c796df-a9ab-43a4-8624-13b6794d3a39 tempest-VolumesNegativeTest-1336256853 tempest-VolumesNegativeTest-1336256853-project] Request method failure captured: May 24 15:20:18.075931 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 24 15:20:18.075931 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Accept: application/json May 24 15:20:18.075931 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Accept-Encoding: identity May 24 15:20:18.075931 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Connection: close May 24 15:20:18.075931 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Content-Length: 118 May 24 15:20:18.075931 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Content-Type: application/json May 24 15:20:18.075931 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Host: 10.222.0.45 May 24 15:20:18.075931 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Openstack-System-Scope: None May 24 15:20:18.075931 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: User-Agent: python-urllib3/1.26.9 May 24 15:20:18.075931 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Auth-Token: gAAAAABijPew8TWc9ysGpFoA948KouZfki52B7yl9B24N74MYfa-_RCBM3nTmajsfk4c38ePOeBPD9if4pdUmU5stabuuIQE6rgdPZDj7pvMoYwQJPG6F6g4nL2ipGtE6ENleC4a4X9zRvDye7UTFSeD6ctqTDfHPzgJisozmQ981OSWpOAonlQ May 24 15:20:18.075931 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Domain-Id: None May 24 15:20:18.075931 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Domain-Name: None May 24 15:20:18.075931 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Identity-Status: Confirmed May 24 15:20:18.075931 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Is-Admin-Project: True May 24 15:20:18.075931 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Domain-Id: default May 24 15:20:18.075931 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Domain-Name: Default May 24 15:20:18.075931 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Id: c2b0f66ad6bb4ece98ea1859904d2a11 May 24 15:20:18.075931 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Name: tempest-VolumesNegativeTest-1336256853 May 24 15:20:18.075931 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Role: reader,member May 24 15:20:18.075931 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Roles: reader,member May 24 15:20:18.077024 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c2b0f66ad6bb4ece98ea1859904d2a11"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c2b0f66ad6bb4ece98ea1859904d2a11"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c2b0f66ad6bb4ece98ea1859904d2a11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c2b0f66ad6bb4ece98ea1859904d2a11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 24 15:20:18.077024 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Tenant: tempest-VolumesNegativeTest-1336256853 May 24 15:20:18.077024 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Tenant-Id: c2b0f66ad6bb4ece98ea1859904d2a11 May 24 15:20:18.077024 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Tenant-Name: tempest-VolumesNegativeTest-1336256853 May 24 15:20:18.077024 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User: tempest-VolumesNegativeTest-1336256853-project May 24 15:20:18.077024 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Domain-Id: default May 24 15:20:18.077024 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Domain-Name: Default May 24 15:20:18.077024 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Id: 9fe7d2ed13994dcf91884ac89dda3a0a May 24 15:20:18.077024 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Name: tempest-VolumesNegativeTest-1336256853-project May 24 15:20:18.077024 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: May 24 15:20:18.077024 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-629551765", "metadata": {"Type": "work"}}} May 24 15:20:18.077024 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: method: May 24 15:20:18.077024 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 24 15:20:18.077654 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-629551765', 'metadata': {'Type': 'work'}}}} May 24 15:20:18.077654 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:20:18.077654 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:20:18.077654 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 24 15:20:18.077654 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 24 15:20:18.077654 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 24 15:20:18.077654 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise error May 24 15:20:18.077654 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 24 15:20:18.077654 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:20:18.077654 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 24 15:20:18.077654 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 24 15:20:18.077654 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:20:18.077654 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi On instance['volume']: May 24 15:20:18.077654 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi '' May 24 15:20:18.077654 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:20:18.077654 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:20:18.077654 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:20:18.077654 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:20:18.077654 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:20:18.077654 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:20:18.077654 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:20:18.077654 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:20:18.078664 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 24 15:20:18.078664 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 24 15:20:18.078664 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:20:18.078664 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:20:18.078664 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 24 15:20:18.078664 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 24 15:20:18.078664 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 24 15:20:18.078664 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 24 15:20:18.078664 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 24 15:20:18.078664 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 24 15:20:18.078664 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 24 15:20:18.078664 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:20:18.078664 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:20:18.078664 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:20:18.078664 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:20:18.078664 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:20:18.078664 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:20:18.078664 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 24 15:20:18.078664 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 24 15:20:18.079567 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 24 15:20:18.079567 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:20:18.080774 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-63c796df-a9ab-43a4-8624-13b6794d3a39 tempest-VolumesNegativeTest-1336256853 tempest-VolumesNegativeTest-1336256853-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:20:18.084100 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-63c796df-a9ab-43a4-8624-13b6794d3a39 tempest-VolumesNegativeTest-1336256853 tempest-VolumesNegativeTest-1336256853-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.016654 May 24 15:20:18.086082 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 28/49] 10.222.0.45 () {60 vars in 1155 bytes} [Tue May 24 15:20:18 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 24 15:20:18.095655 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a85f04db-244f-4d18-959d-285588923935 tempest-VolumesNegativeTest-1336256853 tempest-VolumesNegativeTest-1336256853-project] Calling method '.version_select at 0x7f2dd823faf0>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:18.184465 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell0:SELECT=6 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:20:18.192767 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-2f008380-0196-4c4c-b49e-a6979a9ecab7 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:18.194188 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-2f008380-0196-4c4c-b49e-a6979a9ecab7 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] [instance: 445c11ea-3365-4eb1-a467-bde08bb9ad98] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:18.218200 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2f008380-0196-4c4c-b49e-a6979a9ecab7 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:18.218920 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2f008380-0196-4c4c-b49e-a6979a9ecab7 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:18.222121 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2f008380-0196-4c4c-b49e-a6979a9ecab7 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:18.226959 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2f008380-0196-4c4c-b49e-a6979a9ecab7 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:18.238236 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.wsgi [None req-a85f04db-244f-4d18-959d-285588923935 tempest-VolumesNegativeTest-1336256853 tempest-VolumesNegativeTest-1336256853-project] HTTP exception thrown: Volume tempest-invalid-116224858 could not be found. May 24 15:20:18.240508 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a85f04db-244f-4d18-959d-285588923935 tempest-VolumesNegativeTest-1336256853 tempest-VolumesNegativeTest-1336256853-project] Request method failure captured: May 24 15:20:18.240508 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-116224858 HTTP/1.1 May 24 15:20:18.240508 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Accept: application/json May 24 15:20:18.240508 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Accept-Encoding: identity May 24 15:20:18.240508 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Connection: close May 24 15:20:18.240508 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Content-Length: 0 May 24 15:20:18.240508 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Content-Type: application/json May 24 15:20:18.240508 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Host: 10.222.0.45 May 24 15:20:18.240508 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Openstack-System-Scope: None May 24 15:20:18.240508 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: User-Agent: python-urllib3/1.26.9 May 24 15:20:18.240508 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Auth-Token: gAAAAABijPew8TWc9ysGpFoA948KouZfki52B7yl9B24N74MYfa-_RCBM3nTmajsfk4c38ePOeBPD9if4pdUmU5stabuuIQE6rgdPZDj7pvMoYwQJPG6F6g4nL2ipGtE6ENleC4a4X9zRvDye7UTFSeD6ctqTDfHPzgJisozmQ981OSWpOAonlQ May 24 15:20:18.240508 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Domain-Id: None May 24 15:20:18.240508 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Domain-Name: None May 24 15:20:18.240508 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Identity-Status: Confirmed May 24 15:20:18.240508 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Is-Admin-Project: True May 24 15:20:18.240508 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Domain-Id: default May 24 15:20:18.240508 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Domain-Name: Default May 24 15:20:18.240508 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Id: c2b0f66ad6bb4ece98ea1859904d2a11 May 24 15:20:18.240508 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Name: tempest-VolumesNegativeTest-1336256853 May 24 15:20:18.240508 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Role: reader,member May 24 15:20:18.240508 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Roles: reader,member May 24 15:20:18.242244 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c2b0f66ad6bb4ece98ea1859904d2a11"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c2b0f66ad6bb4ece98ea1859904d2a11"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c2b0f66ad6bb4ece98ea1859904d2a11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c2b0f66ad6bb4ece98ea1859904d2a11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 24 15:20:18.242244 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant: tempest-VolumesNegativeTest-1336256853 May 24 15:20:18.242244 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant-Id: c2b0f66ad6bb4ece98ea1859904d2a11 May 24 15:20:18.242244 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant-Name: tempest-VolumesNegativeTest-1336256853 May 24 15:20:18.242244 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User: tempest-VolumesNegativeTest-1336256853-project May 24 15:20:18.242244 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Domain-Id: default May 24 15:20:18.242244 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Domain-Name: Default May 24 15:20:18.242244 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Id: 9fe7d2ed13994dcf91884ac89dda3a0a May 24 15:20:18.242244 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Name: tempest-VolumesNegativeTest-1336256853-project May 24 15:20:18.242244 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: method: May 24 15:20:18.242244 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: exception: Volume tempest-invalid-116224858 could not be found. May 24 15:20:18.242244 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: action_args: {'id': 'tempest-invalid-116224858'} May 24 15:20:18.242244 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:20:18.243043 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:20:18.243043 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 15:20:18.243043 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 15:20:18.243043 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 24 15:20:18.243043 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 24 15:20:18.243043 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 24 15:20:18.243043 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 24 15:20:18.243043 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 24 15:20:18.243043 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 24 15:20:18.243043 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 24 15:20:18.243043 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 24 15:20:18.243043 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 15:20:18.243043 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 15:20:18.243043 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 15:20:18.243043 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 15:20:18.243043 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-116224858 could not be found. (HTTP 404) (Request-ID: req-7acd66ed-86e1-429e-96c8-8d032d060038) May 24 15:20:18.243043 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:20:18.243043 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:20:18.243043 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:20:18.244018 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:20:18.244018 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 24 15:20:18.244018 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 24 15:20:18.244018 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 24 15:20:18.244018 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 24 15:20:18.244018 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 24 15:20:18.244018 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 24 15:20:18.244018 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 24 15:20:18.244018 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 24 15:20:18.244018 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 15:20:18.244018 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 15:20:18.244018 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 24 15:20:18.244018 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 24 15:20:18.244018 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 24 15:20:18.244018 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 24 15:20:18.244018 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 24 15:20:18.244018 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 24 15:20:18.244018 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 24 15:20:18.244018 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 24 15:20:18.245736 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 15:20:18.245736 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 15:20:18.245736 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 15:20:18.245736 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 15:20:18.245736 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-116224858 could not be found. May 24 15:20:18.245736 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:20:18.245736 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:20:18.245736 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:20:18.245736 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:20:18.245736 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:20:18.245736 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:20:18.245736 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:20:18.245736 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:20:18.245736 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 24 15:20:18.245736 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 24 15:20:18.245736 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:20:18.245736 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:20:18.245736 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 24 15:20:18.245736 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:20:18.245736 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-116224858 could not be found. May 24 15:20:18.247208 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:20:18.247208 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:20:18.247208 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:20:18.247208 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:20:18.247208 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:20:18.247208 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:20:18.247208 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:20:18.247208 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:20:18.247208 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-116224858 could not be found. May 24 15:20:18.247208 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:20:18.251584 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a85f04db-244f-4d18-959d-285588923935 tempest-VolumesNegativeTest-1336256853 tempest-VolumesNegativeTest-1336256853-project] Returning 404 to user: Volume tempest-invalid-116224858 could not be found. {{(pid=117699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:20:18.252682 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a85f04db-244f-4d18-959d-285588923935 tempest-VolumesNegativeTest-1336256853 tempest-VolumesNegativeTest-1336256853-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/tempest-invalid-116224858" status: 404 len: 98 microversion: 2.1 time: 0.161522 May 24 15:20:18.254077 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 22/50] 10.222.0.45 () {58 vars in 1214 bytes} [Tue May 24 15:20:18 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-116224858 => generated 98 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 24 15:20:18.264313 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-561af811-5cc0-4e49-bd0c-f0a8333040b2 tempest-VolumesNegativeTest-1336256853 tempest-VolumesNegativeTest-1336256853-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005239 May 24 15:20:18.271862 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 23/51] 10.222.0.45 () {58 vars in 1139 bytes} [Tue May 24 15:20:18 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) May 24 15:20:18.278918 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-537fc3c7-930d-430b-91b2-849560d5015e tempest-VolumesNegativeTest-1336256853 tempest-VolumesNegativeTest-1336256853-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005007 May 24 15:20:18.284612 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 24/52] 10.222.0.45 () {58 vars in 1136 bytes} [Tue May 24 15:20:18 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 24 15:20:18.314968 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-49159981-bca5-44d3-a6b8-ba6c1cdc0df1 tempest-VolumesNegativeTest-1336256853 tempest-VolumesNegativeTest-1336256853-project] Calling method '.version_select at 0x7f2dd828de50>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:18.430731 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.wsgi [None req-49159981-bca5-44d3-a6b8-ba6c1cdc0df1 tempest-VolumesNegativeTest-1336256853 tempest-VolumesNegativeTest-1336256853-project] HTTP exception thrown: Volume 99e9d6e3-d6c1-4ceb-9372-3062c237a9c0 could not be found. May 24 15:20:18.432778 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-49159981-bca5-44d3-a6b8-ba6c1cdc0df1 tempest-VolumesNegativeTest-1336256853 tempest-VolumesNegativeTest-1336256853-project] Request method failure captured: May 24 15:20:18.432778 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: request: DELETE /compute/v2.1/os-volumes/99e9d6e3-d6c1-4ceb-9372-3062c237a9c0 HTTP/1.1 May 24 15:20:18.432778 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Accept: application/json May 24 15:20:18.432778 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Accept-Encoding: identity May 24 15:20:18.432778 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Connection: close May 24 15:20:18.432778 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Content-Length: 0 May 24 15:20:18.432778 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Content-Type: application/json May 24 15:20:18.432778 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Host: 10.222.0.45 May 24 15:20:18.432778 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Openstack-System-Scope: None May 24 15:20:18.432778 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: User-Agent: python-urllib3/1.26.9 May 24 15:20:18.432778 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Auth-Token: gAAAAABijPew8TWc9ysGpFoA948KouZfki52B7yl9B24N74MYfa-_RCBM3nTmajsfk4c38ePOeBPD9if4pdUmU5stabuuIQE6rgdPZDj7pvMoYwQJPG6F6g4nL2ipGtE6ENleC4a4X9zRvDye7UTFSeD6ctqTDfHPzgJisozmQ981OSWpOAonlQ May 24 15:20:18.432778 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Domain-Id: None May 24 15:20:18.432778 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Domain-Name: None May 24 15:20:18.432778 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Identity-Status: Confirmed May 24 15:20:18.432778 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Is-Admin-Project: True May 24 15:20:18.432778 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Domain-Id: default May 24 15:20:18.432778 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Domain-Name: Default May 24 15:20:18.432778 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Id: c2b0f66ad6bb4ece98ea1859904d2a11 May 24 15:20:18.432778 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Name: tempest-VolumesNegativeTest-1336256853 May 24 15:20:18.432778 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Role: reader,member May 24 15:20:18.432778 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Roles: reader,member May 24 15:20:18.433881 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c2b0f66ad6bb4ece98ea1859904d2a11"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c2b0f66ad6bb4ece98ea1859904d2a11"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c2b0f66ad6bb4ece98ea1859904d2a11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c2b0f66ad6bb4ece98ea1859904d2a11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 24 15:20:18.433881 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant: tempest-VolumesNegativeTest-1336256853 May 24 15:20:18.433881 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant-Id: c2b0f66ad6bb4ece98ea1859904d2a11 May 24 15:20:18.433881 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant-Name: tempest-VolumesNegativeTest-1336256853 May 24 15:20:18.433881 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User: tempest-VolumesNegativeTest-1336256853-project May 24 15:20:18.433881 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Domain-Id: default May 24 15:20:18.433881 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Domain-Name: Default May 24 15:20:18.433881 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Id: 9fe7d2ed13994dcf91884ac89dda3a0a May 24 15:20:18.433881 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Name: tempest-VolumesNegativeTest-1336256853-project May 24 15:20:18.433881 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: method: May 24 15:20:18.433881 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: exception: Volume 99e9d6e3-d6c1-4ceb-9372-3062c237a9c0 could not be found. May 24 15:20:18.433881 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: action_args: {'id': '99e9d6e3-d6c1-4ceb-9372-3062c237a9c0'} May 24 15:20:18.433881 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:20:18.434571 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:20:18.434571 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 15:20:18.434571 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 15:20:18.434571 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 24 15:20:18.434571 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 24 15:20:18.434571 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 24 15:20:18.434571 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 24 15:20:18.434571 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 24 15:20:18.434571 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 24 15:20:18.434571 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 24 15:20:18.434571 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 24 15:20:18.434571 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 15:20:18.434571 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 15:20:18.434571 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 15:20:18.434571 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 15:20:18.434571 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 99e9d6e3-d6c1-4ceb-9372-3062c237a9c0 could not be found. (HTTP 404) (Request-ID: req-75637154-7089-43c9-adc8-d1860d000f32) May 24 15:20:18.434571 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:20:18.434571 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:20:18.434571 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:20:18.435527 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:20:18.435527 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 24 15:20:18.435527 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 24 15:20:18.435527 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 24 15:20:18.435527 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 24 15:20:18.435527 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 24 15:20:18.435527 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 24 15:20:18.435527 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 24 15:20:18.435527 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 24 15:20:18.435527 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 15:20:18.435527 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 15:20:18.435527 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 24 15:20:18.435527 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 24 15:20:18.435527 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 24 15:20:18.435527 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 24 15:20:18.435527 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 24 15:20:18.435527 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 24 15:20:18.435527 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 24 15:20:18.435527 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 24 15:20:18.436486 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 15:20:18.436486 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 15:20:18.436486 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 15:20:18.436486 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 15:20:18.436486 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 99e9d6e3-d6c1-4ceb-9372-3062c237a9c0 could not be found. May 24 15:20:18.436486 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:20:18.436486 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:20:18.436486 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:20:18.436486 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:20:18.436486 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:20:18.436486 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:20:18.436486 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:20:18.436486 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:20:18.436486 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 24 15:20:18.436486 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 24 15:20:18.436486 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:20:18.436486 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:20:18.436486 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 24 15:20:18.436486 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:20:18.437386 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 99e9d6e3-d6c1-4ceb-9372-3062c237a9c0 could not be found. May 24 15:20:18.437386 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:20:18.437386 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:20:18.437386 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:20:18.437386 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:20:18.437386 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:20:18.437386 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:20:18.437386 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:20:18.437386 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:20:18.437386 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 99e9d6e3-d6c1-4ceb-9372-3062c237a9c0 could not be found. May 24 15:20:18.437386 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:20:18.437386 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-49159981-bca5-44d3-a6b8-ba6c1cdc0df1 tempest-VolumesNegativeTest-1336256853 tempest-VolumesNegativeTest-1336256853-project] Returning 404 to user: Volume 99e9d6e3-d6c1-4ceb-9372-3062c237a9c0 could not be found. {{(pid=117699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:20:18.437386 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-49159981-bca5-44d3-a6b8-ba6c1cdc0df1 tempest-VolumesNegativeTest-1336256853 tempest-VolumesNegativeTest-1336256853-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/99e9d6e3-d6c1-4ceb-9372-3062c237a9c0" status: 404 len: 109 microversion: 2.1 time: 0.143660 May 24 15:20:18.437386 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 25/53] 10.222.0.45 () {58 vars in 1247 bytes} [Tue May 24 15:20:18 2022] DELETE /compute/v2.1/os-volumes/99e9d6e3-d6c1-4ceb-9372-3062c237a9c0 => generated 109 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:20:18.456274 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-631332e9-1d9a-4fa9-90fb-960a1b8883da tempest-VolumesNegativeTest-1336256853 tempest-VolumesNegativeTest-1336256853-project] Calling method '.version_select at 0x7f2dd828d040>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:18.559834 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.wsgi [None req-631332e9-1d9a-4fa9-90fb-960a1b8883da tempest-VolumesNegativeTest-1336256853 tempest-VolumesNegativeTest-1336256853-project] HTTP exception thrown: Volume 347ab52b-f815-4a93-9daf-0d8d1812f51b could not be found. May 24 15:20:18.561985 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-631332e9-1d9a-4fa9-90fb-960a1b8883da tempest-VolumesNegativeTest-1336256853 tempest-VolumesNegativeTest-1336256853-project] Request method failure captured: May 24 15:20:18.561985 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: request: GET /compute/v2.1/os-volumes/347ab52b-f815-4a93-9daf-0d8d1812f51b HTTP/1.1 May 24 15:20:18.561985 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Accept: application/json May 24 15:20:18.561985 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Accept-Encoding: identity May 24 15:20:18.561985 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Connection: close May 24 15:20:18.561985 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Content-Length: 0 May 24 15:20:18.561985 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Content-Type: application/json May 24 15:20:18.561985 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Host: 10.222.0.45 May 24 15:20:18.561985 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Openstack-System-Scope: None May 24 15:20:18.561985 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: User-Agent: python-urllib3/1.26.9 May 24 15:20:18.561985 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Auth-Token: gAAAAABijPew8TWc9ysGpFoA948KouZfki52B7yl9B24N74MYfa-_RCBM3nTmajsfk4c38ePOeBPD9if4pdUmU5stabuuIQE6rgdPZDj7pvMoYwQJPG6F6g4nL2ipGtE6ENleC4a4X9zRvDye7UTFSeD6ctqTDfHPzgJisozmQ981OSWpOAonlQ May 24 15:20:18.561985 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Domain-Id: None May 24 15:20:18.561985 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Domain-Name: None May 24 15:20:18.561985 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Identity-Status: Confirmed May 24 15:20:18.561985 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Is-Admin-Project: True May 24 15:20:18.561985 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Domain-Id: default May 24 15:20:18.561985 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Domain-Name: Default May 24 15:20:18.561985 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Id: c2b0f66ad6bb4ece98ea1859904d2a11 May 24 15:20:18.561985 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Name: tempest-VolumesNegativeTest-1336256853 May 24 15:20:18.561985 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Role: reader,member May 24 15:20:18.561985 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Roles: reader,member May 24 15:20:18.563131 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c2b0f66ad6bb4ece98ea1859904d2a11"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c2b0f66ad6bb4ece98ea1859904d2a11"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c2b0f66ad6bb4ece98ea1859904d2a11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c2b0f66ad6bb4ece98ea1859904d2a11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 24 15:20:18.563131 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant: tempest-VolumesNegativeTest-1336256853 May 24 15:20:18.563131 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant-Id: c2b0f66ad6bb4ece98ea1859904d2a11 May 24 15:20:18.563131 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant-Name: tempest-VolumesNegativeTest-1336256853 May 24 15:20:18.563131 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User: tempest-VolumesNegativeTest-1336256853-project May 24 15:20:18.563131 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Domain-Id: default May 24 15:20:18.563131 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Domain-Name: Default May 24 15:20:18.563131 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Id: 9fe7d2ed13994dcf91884ac89dda3a0a May 24 15:20:18.563131 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Name: tempest-VolumesNegativeTest-1336256853-project May 24 15:20:18.563131 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: method: May 24 15:20:18.563131 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: exception: Volume 347ab52b-f815-4a93-9daf-0d8d1812f51b could not be found. May 24 15:20:18.563131 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: action_args: {'id': '347ab52b-f815-4a93-9daf-0d8d1812f51b'} May 24 15:20:18.563131 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:20:18.563785 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:20:18.563785 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 15:20:18.563785 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 15:20:18.563785 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 24 15:20:18.563785 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi item = cinderclient( May 24 15:20:18.563785 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 24 15:20:18.563785 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 24 15:20:18.563785 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 24 15:20:18.563785 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 24 15:20:18.563785 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 24 15:20:18.563785 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 24 15:20:18.563785 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 15:20:18.563785 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 15:20:18.563785 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 15:20:18.563785 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 15:20:18.563785 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 347ab52b-f815-4a93-9daf-0d8d1812f51b could not be found. (HTTP 404) (Request-ID: req-da1b18d2-10b9-426f-b693-32d74e12a263) May 24 15:20:18.563785 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:20:18.563785 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:20:18.563785 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:20:18.564722 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:20:18.564722 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 24 15:20:18.564722 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 24 15:20:18.564722 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 24 15:20:18.564722 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 24 15:20:18.564722 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 24 15:20:18.564722 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 24 15:20:18.564722 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 24 15:20:18.564722 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 24 15:20:18.564722 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 15:20:18.564722 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 15:20:18.564722 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 24 15:20:18.564722 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi item = cinderclient( May 24 15:20:18.564722 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 24 15:20:18.564722 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 24 15:20:18.564722 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 24 15:20:18.564722 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 24 15:20:18.564722 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 24 15:20:18.564722 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 24 15:20:18.565684 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 15:20:18.565684 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 15:20:18.565684 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 15:20:18.565684 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 15:20:18.565684 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 347ab52b-f815-4a93-9daf-0d8d1812f51b could not be found. May 24 15:20:18.565684 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:20:18.565684 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:20:18.565684 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:20:18.565684 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:20:18.565684 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:20:18.565684 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:20:18.565684 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:20:18.565684 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:20:18.565684 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 24 15:20:18.565684 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 24 15:20:18.565684 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:20:18.565684 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:20:18.565684 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 24 15:20:18.565684 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:20:18.566586 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 347ab52b-f815-4a93-9daf-0d8d1812f51b could not be found. May 24 15:20:18.566586 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:20:18.566586 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:20:18.566586 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:20:18.566586 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:20:18.566586 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:20:18.566586 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:20:18.566586 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:20:18.566586 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:20:18.566586 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 347ab52b-f815-4a93-9daf-0d8d1812f51b could not be found. May 24 15:20:18.566586 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:20:18.566586 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-631332e9-1d9a-4fa9-90fb-960a1b8883da tempest-VolumesNegativeTest-1336256853 tempest-VolumesNegativeTest-1336256853-project] Returning 404 to user: Volume 347ab52b-f815-4a93-9daf-0d8d1812f51b could not be found. {{(pid=117699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:20:18.566586 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-631332e9-1d9a-4fa9-90fb-960a1b8883da tempest-VolumesNegativeTest-1336256853 tempest-VolumesNegativeTest-1336256853-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/347ab52b-f815-4a93-9daf-0d8d1812f51b" status: 404 len: 109 microversion: 2.1 time: 0.123245 May 24 15:20:18.566586 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 26/54] 10.222.0.45 () {58 vars in 1244 bytes} [Tue May 24 15:20:18 2022] GET /compute/v2.1/os-volumes/347ab52b-f815-4a93-9daf-0d8d1812f51b => generated 109 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:20:18.739438 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-c3dd4137-23d5-4694-9865-6b929471ec23 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:18.740813 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-c3dd4137-23d5-4694-9865-6b929471ec23 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: baacc852-cde4-4e1a-ade9-183a97312b6f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:18.752794 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c3dd4137-23d5-4694-9865-6b929471ec23 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:18.761617 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c3dd4137-23d5-4694-9865-6b929471ec23 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:18.765489 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c3dd4137-23d5-4694-9865-6b929471ec23 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:18.768427 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c3dd4137-23d5-4694-9865-6b929471ec23 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:19.147702 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-2f008380-0196-4c4c-b49e-a6979a9ecab7 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc17670edbb4cc797103b0d41835bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b175a657eab24493b2adbec405cbd515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:19.159207 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-2f008380-0196-4c4c-b49e-a6979a9ecab7 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] 10.222.0.45 "GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98" status: 200 len: 1314 microversion: 2.1 time: 0.969712 May 24 15:20:19.162309 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 29/55] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:18 2022] GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98 => generated 1314 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:20:20.178617 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-35ce8150-894e-430b-874a-a576e1291228 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:20.179392 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-35ce8150-894e-430b-874a-a576e1291228 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] [instance: 445c11ea-3365-4eb1-a467-bde08bb9ad98] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:20.204422 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell0:SELECT=8 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:20:20.212330 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-35ce8150-894e-430b-874a-a576e1291228 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:20.214579 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-35ce8150-894e-430b-874a-a576e1291228 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:20.217697 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-35ce8150-894e-430b-874a-a576e1291228 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:20.219200 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-35ce8150-894e-430b-874a-a576e1291228 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:21.156013 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-35ce8150-894e-430b-874a-a576e1291228 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc17670edbb4cc797103b0d41835bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b175a657eab24493b2adbec405cbd515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:21.159315 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-c3dd4137-23d5-4694-9865-6b929471ec23 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:21.165512 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-35ce8150-894e-430b-874a-a576e1291228 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] 10.222.0.45 "GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98" status: 200 len: 1314 microversion: 2.1 time: 0.991592 May 24 15:20:21.168867 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-c3dd4137-23d5-4694-9865-6b929471ec23 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f" status: 200 len: 1322 microversion: 2.1 time: 2.434190 May 24 15:20:21.169652 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 30/56] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:20 2022] GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98 => generated 1314 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:20:21.180351 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 27/57] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:18 2022] GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f => generated 1322 bytes in 2446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:20:21.466171 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [req-3a478d56-1297-48d3-98a9-72355e1186a6 req-c0bab368-89ef-4a62-aa66-a67d02c145e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "445c11ea-3365-4eb1-a467-bde08bb9ad98", "tag": "f5fc33b3-50b8-454b-88ce-6680c8fd2e16"}]} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:20:21.496153 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-3a478d56-1297-48d3-98a9-72355e1186a6 req-c0bab368-89ef-4a62-aa66-a67d02c145e9 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:21.496628 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-3a478d56-1297-48d3-98a9-72355e1186a6 req-c0bab368-89ef-4a62-aa66-a67d02c145e9 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:21.576130 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.compute.server_external_events [req-3a478d56-1297-48d3-98a9-72355e1186a6 req-c0bab368-89ef-4a62-aa66-a67d02c145e9 service nova] Creating event network-changed:f5fc33b3-50b8-454b-88ce-6680c8fd2e16 for instance 445c11ea-3365-4eb1-a467-bde08bb9ad98 on hv-cinder-84315 May 24 15:20:21.583754 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-3a478d56-1297-48d3-98a9-72355e1186a6 req-c0bab368-89ef-4a62-aa66-a67d02c145e9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117698) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 24 15:20:21.587149 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d08074ac-db9a-49e9-9599-239770457f60 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:21.590465 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d08074ac-db9a-49e9-9599-239770457f60 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:21.593122 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d08074ac-db9a-49e9-9599-239770457f60 None None] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:21.601047 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d08074ac-db9a-49e9-9599-239770457f60 None None] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:21.634479 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.compute.rpcapi [None req-d08074ac-db9a-49e9-9599-239770457f60 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 24 15:20:21.643886 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d08074ac-db9a-49e9-9599-239770457f60 None None] Releasing lock "compute-rpcapi-router" {{(pid=117698) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 24 15:20:21.822630 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d08074ac-db9a-49e9-9599-239770457f60 None None] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.647708 May 24 15:20:21.827267 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 31/58] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:20:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:20:22.187384 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a58cd900-14de-444d-bf88-9961b7e1a03b tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:22.193335 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-dbada2da-18bc-40ab-a23d-c42b2ba84aa3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:22.194154 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-dbada2da-18bc-40ab-a23d-c42b2ba84aa3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: baacc852-cde4-4e1a-ade9-183a97312b6f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:22.194549 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a58cd900-14de-444d-bf88-9961b7e1a03b tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] [instance: 445c11ea-3365-4eb1-a467-bde08bb9ad98] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:22.199792 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=10 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:20:22.213028 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dbada2da-18bc-40ab-a23d-c42b2ba84aa3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:22.215127 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dbada2da-18bc-40ab-a23d-c42b2ba84aa3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:22.217647 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dbada2da-18bc-40ab-a23d-c42b2ba84aa3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:22.239144 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a58cd900-14de-444d-bf88-9961b7e1a03b tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:22.242428 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dbada2da-18bc-40ab-a23d-c42b2ba84aa3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:22.243346 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a58cd900-14de-444d-bf88-9961b7e1a03b tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:22.247910 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a58cd900-14de-444d-bf88-9961b7e1a03b tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:22.249848 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a58cd900-14de-444d-bf88-9961b7e1a03b tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:22.347956 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=43 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:20:22.931833 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-dbada2da-18bc-40ab-a23d-c42b2ba84aa3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:22.940403 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-dbada2da-18bc-40ab-a23d-c42b2ba84aa3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f" status: 200 len: 1322 microversion: 2.1 time: 0.751014 May 24 15:20:22.941326 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 32/59] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:22 2022] GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f => generated 1322 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:20:23.279980 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-a58cd900-14de-444d-bf88-9961b7e1a03b tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc17670edbb4cc797103b0d41835bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b175a657eab24493b2adbec405cbd515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:23.291497 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a58cd900-14de-444d-bf88-9961b7e1a03b tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] 10.222.0.45 "GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98" status: 200 len: 1314 microversion: 2.1 time: 1.107994 May 24 15:20:23.293975 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 28/60] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:22 2022] GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98 => generated 1314 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:20:23.832573 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-84559a5a-4a5d-469a-8a33-d2408151d919 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1113407430", "imageRef": "f921f75e-bbd1-4d99-ab1e-5cce2d895148", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "24c1579b-6886-424b-a2f8-7bc69ac1e33f"}], "security_groups": [{"name": "tempest-securitygroup--638002646"}], "key_name": "tempest-keypair-1913796150", "user_data": "}} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:20:23.855945 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [req-5d6cbcbb-2fb3-4ab6-adae-d3d28c8b8137 req-ec211d16-1f0a-4765-825d-13ad311068d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baacc852-cde4-4e1a-ade9-183a97312b6f", "tag": "8ddee3e5-269b-490f-9155-2edef63bd8a9"}]} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:20:23.897368 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-5d6cbcbb-2fb3-4ab6-adae-d3d28c8b8137 req-ec211d16-1f0a-4765-825d-13ad311068d6 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:23.899950 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-5d6cbcbb-2fb3-4ab6-adae-d3d28c8b8137 req-ec211d16-1f0a-4765-825d-13ad311068d6 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:23.900887 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:20:23.948836 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.compute.server_external_events [req-5d6cbcbb-2fb3-4ab6-adae-d3d28c8b8137 req-ec211d16-1f0a-4765-825d-13ad311068d6 service nova] Creating event network-changed:8ddee3e5-269b-490f-9155-2edef63bd8a9 for instance baacc852-cde4-4e1a-ade9-183a97312b6f on hv-cinder-84315 May 24 15:20:23.949604 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-5d6cbcbb-2fb3-4ab6-adae-d3d28c8b8137 req-ec211d16-1f0a-4765-825d-13ad311068d6 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117699) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 24 15:20:23.950928 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b7fd72bd-b43c-48b8-8323-ae65be9bb4a2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:23.951527 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b7fd72bd-b43c-48b8-8323-ae65be9bb4a2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:23.952758 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b7fd72bd-b43c-48b8-8323-ae65be9bb4a2 None None] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:23.953356 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b7fd72bd-b43c-48b8-8323-ae65be9bb4a2 None None] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:23.968734 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.compute.rpcapi [None req-b7fd72bd-b43c-48b8-8323-ae65be9bb4a2 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 24 15:20:23.969858 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b7fd72bd-b43c-48b8-8323-ae65be9bb4a2 None None] Releasing lock "compute-rpcapi-router" {{(pid=117699) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 24 15:20:24.006342 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-b7fd72bd-b43c-48b8-8323-ae65be9bb4a2 None None] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155668 May 24 15:20:24.007712 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 29/61] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:20:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:20:24.013280 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-1b026b23-f5fd-4e88-8cfb-da4946b1ea72 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:24.014895 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-1b026b23-f5fd-4e88-8cfb-da4946b1ea72 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: baacc852-cde4-4e1a-ade9-183a97312b6f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:24.028669 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1b026b23-f5fd-4e88-8cfb-da4946b1ea72 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:24.029127 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1b026b23-f5fd-4e88-8cfb-da4946b1ea72 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:24.029907 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1b026b23-f5fd-4e88-8cfb-da4946b1ea72 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:24.030346 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1b026b23-f5fd-4e88-8cfb-da4946b1ea72 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:24.206059 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.network.neutron [None req-84559a5a-4a5d-469a-8a33-d2408151d919 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] validate_networks() for [('24c1579b-6886-424b-a2f8-7bc69ac1e33f', None, None, None, None, None)] {{(pid=117698) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 15:20:24.684645 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-1b026b23-f5fd-4e88-8cfb-da4946b1ea72 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:24.694287 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-1b026b23-f5fd-4e88-8cfb-da4946b1ea72 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f" status: 200 len: 1322 microversion: 2.1 time: 0.684962 May 24 15:20:24.696358 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 30/62] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:24 2022] GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f => generated 1322 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:20:24.702376 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-45dad525-b171-4af4-a86c-4129851ff7a3 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:24.703144 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-45dad525-b171-4af4-a86c-4129851ff7a3 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] [instance: 445c11ea-3365-4eb1-a467-bde08bb9ad98] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:24.722173 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-45dad525-b171-4af4-a86c-4129851ff7a3 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:24.724873 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-45dad525-b171-4af4-a86c-4129851ff7a3 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:24.725833 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-45dad525-b171-4af4-a86c-4129851ff7a3 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:24.731628 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-45dad525-b171-4af4-a86c-4129851ff7a3 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:25.053344 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-45dad525-b171-4af4-a86c-4129851ff7a3 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc17670edbb4cc797103b0d41835bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b175a657eab24493b2adbec405cbd515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:25.062890 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-45dad525-b171-4af4-a86c-4129851ff7a3 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] 10.222.0.45 "GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98" status: 200 len: 1314 microversion: 2.1 time: 0.365139 May 24 15:20:25.072061 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 31/63] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:24 2022] GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98 => generated 1314 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:20:25.349483 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [req-c357f29d-8c21-4b98-b748-8e8995aee402 req-5747b31a-b880-4d11-b21e-caa1b23b937f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d01bc80d-033e-4940-a604-b4f34ee070a9", "tag": "3906dca3-c361-4161-9d8e-61cd5fe92161"}]} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:20:25.367164 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-c357f29d-8c21-4b98-b748-8e8995aee402 req-5747b31a-b880-4d11-b21e-caa1b23b937f service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:25.367608 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-c357f29d-8c21-4b98-b748-8e8995aee402 req-5747b31a-b880-4d11-b21e-caa1b23b937f service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:25.388797 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.compute.server_external_events [req-c357f29d-8c21-4b98-b748-8e8995aee402 req-5747b31a-b880-4d11-b21e-caa1b23b937f service nova] Creating event network-changed:3906dca3-c361-4161-9d8e-61cd5fe92161 for instance d01bc80d-033e-4940-a604-b4f34ee070a9 on hv-cinder-84315 May 24 15:20:25.394512 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [req-c357f29d-8c21-4b98-b748-8e8995aee402 req-5747b31a-b880-4d11-b21e-caa1b23b937f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.321019 May 24 15:20:25.395147 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 32/64] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:20:25.711465 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-8dbc7066-7bfb-4e85-9097-a49241c70cd7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:25.713007 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-8dbc7066-7bfb-4e85-9097-a49241c70cd7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: baacc852-cde4-4e1a-ade9-183a97312b6f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:25.726316 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8dbc7066-7bfb-4e85-9097-a49241c70cd7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:25.734458 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8dbc7066-7bfb-4e85-9097-a49241c70cd7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:25.741328 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8dbc7066-7bfb-4e85-9097-a49241c70cd7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:25.741781 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8dbc7066-7bfb-4e85-9097-a49241c70cd7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:26.048660 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.virt.hardware [None req-84559a5a-4a5d-469a-8a33-d2408151d919 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Flavor limits 0:0:0 {{(pid=117698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 15:20:26.049730 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.virt.hardware [None req-84559a5a-4a5d-469a-8a33-d2408151d919 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Image limits 0:0:0 {{(pid=117698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 15:20:26.050209 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.virt.hardware [None req-84559a5a-4a5d-469a-8a33-d2408151d919 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Flavor pref 0:0:0 {{(pid=117698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 15:20:26.050781 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.virt.hardware [None req-84559a5a-4a5d-469a-8a33-d2408151d919 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Image pref 0:0:0 {{(pid=117698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 15:20:26.051207 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.virt.hardware [None req-84559a5a-4a5d-469a-8a33-d2408151d919 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 15:20:26.072459 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-84559a5a-4a5d-469a-8a33-d2408151d919 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:26.073522 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-84559a5a-4a5d-469a-8a33-d2408151d919 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:26.074466 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-84559a5a-4a5d-469a-8a33-d2408151d919 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:26.075191 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-84559a5a-4a5d-469a-8a33-d2408151d919 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:26.100445 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=65 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:20:26.110471 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell0:SELECT=24 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:20:26.123710 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.quota [None req-84559a5a-4a5d-469a-8a33-d2408151d919 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Getting quotas for project 0812b13a287c43259d7e09b0c658d4c8. Resources: {'instances', 'ram', 'cores'} {{(pid=117698) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 15:20:26.128809 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.quota [None req-84559a5a-4a5d-469a-8a33-d2408151d919 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Getting quotas for user 2befe74ad06542b785d326101fc06d0b and project 0812b13a287c43259d7e09b0c658d4c8. Resources: {'instances', 'ram', 'cores'} {{(pid=117698) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 15:20:26.142772 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-84559a5a-4a5d-469a-8a33-d2408151d919 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Going to run 1 instances... {{(pid=117698) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 15:20:26.146042 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-84559a5a-4a5d-469a-8a33-d2408151d919 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f921f75e-bbd1-4d99-ab1e-5cce2d895148',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 15:20:26.237438 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-84559a5a-4a5d-469a-8a33-d2408151d919 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.415504 May 24 15:20:26.239313 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 33/65] 10.222.0.45 () {60 vars in 1146 bytes} [Tue May 24 15:20:23 2022] POST /compute/v2.1/servers => generated 401 bytes in 2418 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 15:20:26.246603 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d3276173-753f-4512-ab77-279ae9bbf361 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:26.247233 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d3276173-753f-4512-ab77-279ae9bbf361 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] [instance: 445c11ea-3365-4eb1-a467-bde08bb9ad98] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:26.256904 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d3276173-753f-4512-ab77-279ae9bbf361 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:26.257362 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d3276173-753f-4512-ab77-279ae9bbf361 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:26.259222 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d3276173-753f-4512-ab77-279ae9bbf361 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:26.260124 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d3276173-753f-4512-ab77-279ae9bbf361 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:26.363283 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-8dbc7066-7bfb-4e85-9097-a49241c70cd7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:26.378559 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-8dbc7066-7bfb-4e85-9097-a49241c70cd7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f" status: 200 len: 1322 microversion: 2.1 time: 0.670377 May 24 15:20:26.380544 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 33/66] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:25 2022] GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f => generated 1322 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:20:26.393553 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-27b4a926-30b0-4fea-b7d2-c6780bcef6f2 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:26.394664 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-27b4a926-30b0-4fea-b7d2-c6780bcef6f2 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:26.491279 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-27b4a926-30b0-4fea-b7d2-c6780bcef6f2 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:26.503414 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-27b4a926-30b0-4fea-b7d2-c6780bcef6f2 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1238 microversion: 2.1 time: 0.120014 May 24 15:20:26.504073 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 34/67] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:26 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1238 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:20:26.650278 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-d3276173-753f-4512-ab77-279ae9bbf361 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc17670edbb4cc797103b0d41835bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b175a657eab24493b2adbec405cbd515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:26.662932 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d3276173-753f-4512-ab77-279ae9bbf361 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] 10.222.0.45 "GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98" status: 200 len: 1314 microversion: 2.1 time: 0.421483 May 24 15:20:26.663592 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 34/68] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:26 2022] GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98 => generated 1314 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:20:26.900797 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-11917a90-3c94-4190-8036-4b391a352271 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-706984382", "imageRef": "f921f75e-bbd1-4d99-ab1e-5cce2d895148", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "03d59a96-71b6-4a30-bfcb-f7c0dbc4ebce"}], "security_groups": [{"name": "tempest-securitygroup--2046352494"}], "key_name": "tempest-keypair-1810429186", "user_data": "}} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:20:27.235506 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.network.neutron [None req-11917a90-3c94-4190-8036-4b391a352271 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] validate_networks() for [('03d59a96-71b6-4a30-bfcb-f7c0dbc4ebce', None, None, None, None, None)] {{(pid=117699) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 15:20:27.400001 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-85daecc2-edf5-4f8e-ad54-baaeaabde06f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:27.401925 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-85daecc2-edf5-4f8e-ad54-baaeaabde06f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: baacc852-cde4-4e1a-ade9-183a97312b6f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:27.415325 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-85daecc2-edf5-4f8e-ad54-baaeaabde06f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:27.419061 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-85daecc2-edf5-4f8e-ad54-baaeaabde06f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:27.423531 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-85daecc2-edf5-4f8e-ad54-baaeaabde06f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:27.424221 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-85daecc2-edf5-4f8e-ad54-baaeaabde06f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:27.848057 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.virt.hardware [None req-11917a90-3c94-4190-8036-4b391a352271 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Flavor limits 0:0:0 {{(pid=117699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 15:20:27.848504 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.virt.hardware [None req-11917a90-3c94-4190-8036-4b391a352271 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Image limits 0:0:0 {{(pid=117699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 15:20:27.848976 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.virt.hardware [None req-11917a90-3c94-4190-8036-4b391a352271 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Flavor pref 0:0:0 {{(pid=117699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 15:20:27.849378 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.virt.hardware [None req-11917a90-3c94-4190-8036-4b391a352271 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Image pref 0:0:0 {{(pid=117699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 15:20:27.849780 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.virt.hardware [None req-11917a90-3c94-4190-8036-4b391a352271 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 15:20:27.862703 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-11917a90-3c94-4190-8036-4b391a352271 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:27.863178 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-11917a90-3c94-4190-8036-4b391a352271 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:27.864172 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-11917a90-3c94-4190-8036-4b391a352271 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:27.864826 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-11917a90-3c94-4190-8036-4b391a352271 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:27.878492 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-85daecc2-edf5-4f8e-ad54-baaeaabde06f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:27.888478 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-85daecc2-edf5-4f8e-ad54-baaeaabde06f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f" status: 200 len: 1322 microversion: 2.1 time: 0.495450 May 24 15:20:27.889704 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 35/69] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:27 2022] GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f => generated 1322 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:20:27.894386 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-ff7c5dfe-1d19-47dc-bc64-cdb1637f2770 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:27.894598 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.quota [None req-11917a90-3c94-4190-8036-4b391a352271 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Getting quotas for project 0fe1d758c40542e9b237f9d7bcfa5755. Resources: {'instances', 'ram', 'cores'} {{(pid=117699) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 15:20:27.895971 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-ff7c5dfe-1d19-47dc-bc64-cdb1637f2770 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:27.904392 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.quota [None req-11917a90-3c94-4190-8036-4b391a352271 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Getting quotas for user 40db5795ce7e4c5bbf06fb81ce404e78 and project 0fe1d758c40542e9b237f9d7bcfa5755. Resources: {'instances', 'ram', 'cores'} {{(pid=117699) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 15:20:27.905351 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ff7c5dfe-1d19-47dc-bc64-cdb1637f2770 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:27.906007 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ff7c5dfe-1d19-47dc-bc64-cdb1637f2770 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:27.907042 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ff7c5dfe-1d19-47dc-bc64-cdb1637f2770 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:27.907698 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ff7c5dfe-1d19-47dc-bc64-cdb1637f2770 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:27.918013 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-11917a90-3c94-4190-8036-4b391a352271 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Going to run 1 instances... {{(pid=117699) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 15:20:27.920401 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-11917a90-3c94-4190-8036-4b391a352271 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f921f75e-bbd1-4d99-ab1e-5cce2d895148',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 15:20:27.988833 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-11917a90-3c94-4190-8036-4b391a352271 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.092407 May 24 15:20:27.989891 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 35/70] 10.222.0.45 () {62 vars in 1187 bytes} [Tue May 24 15:20:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 1094 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 24 15:20:27.996660 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-0ef24f88-410a-41b3-90cf-bea644f0f699 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:27.999527 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-0ef24f88-410a-41b3-90cf-bea644f0f699 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] [instance: 445c11ea-3365-4eb1-a467-bde08bb9ad98] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:28.008202 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0ef24f88-410a-41b3-90cf-bea644f0f699 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:28.009025 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0ef24f88-410a-41b3-90cf-bea644f0f699 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:28.010378 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0ef24f88-410a-41b3-90cf-bea644f0f699 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:28.011058 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0ef24f88-410a-41b3-90cf-bea644f0f699 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:28.033912 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ff7c5dfe-1d19-47dc-bc64-cdb1637f2770 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:28.045708 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-ff7c5dfe-1d19-47dc-bc64-cdb1637f2770 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1242 microversion: 2.1 time: 0.152046 May 24 15:20:28.047842 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 36/71] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:27 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1242 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:20:28.058488 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-f69fb749-6c41-47cd-baf9-8dbf7d61d3a1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:28.060421 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-f69fb749-6c41-47cd-baf9-8dbf7d61d3a1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:28.237008 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-f69fb749-6c41-47cd-baf9-8dbf7d61d3a1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:28.252749 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-f69fb749-6c41-47cd-baf9-8dbf7d61d3a1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:28.255334 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-f69fb749-6c41-47cd-baf9-8dbf7d61d3a1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:28.256744 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-f69fb749-6c41-47cd-baf9-8dbf7d61d3a1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1281 microversion: 2.20 time: 0.207025 May 24 15:20:28.262264 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 37/72] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:20:28 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1281 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:20:28.311807 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-0ef24f88-410a-41b3-90cf-bea644f0f699 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc17670edbb4cc797103b0d41835bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b175a657eab24493b2adbec405cbd515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:28.324118 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-0ef24f88-410a-41b3-90cf-bea644f0f699 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] 10.222.0.45 "GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98" status: 200 len: 1314 microversion: 2.1 time: 0.330033 May 24 15:20:28.324779 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 36/73] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:27 2022] GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98 => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:20:28.909816 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-b9c5c7e6-4987-450f-b047-bd529014192b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:28.910992 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-b9c5c7e6-4987-450f-b047-bd529014192b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: baacc852-cde4-4e1a-ade9-183a97312b6f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:28.922204 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b9c5c7e6-4987-450f-b047-bd529014192b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:28.931520 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b9c5c7e6-4987-450f-b047-bd529014192b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:28.932856 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b9c5c7e6-4987-450f-b047-bd529014192b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:28.936150 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b9c5c7e6-4987-450f-b047-bd529014192b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:29.062602 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-4e02b467-b71b-4000-9540-34840bc15c48 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:29.064196 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-4e02b467-b71b-4000-9540-34840bc15c48 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:29.078911 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4e02b467-b71b-4000-9540-34840bc15c48 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:29.084393 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4e02b467-b71b-4000-9540-34840bc15c48 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:29.086559 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4e02b467-b71b-4000-9540-34840bc15c48 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:29.090855 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4e02b467-b71b-4000-9540-34840bc15c48 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:29.359703 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-4e02b467-b71b-4000-9540-34840bc15c48 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:29.375040 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-4e02b467-b71b-4000-9540-34840bc15c48 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1298 microversion: 2.1 time: 0.315774 May 24 15:20:29.375593 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 37/74] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:29 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1298 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:20:29.384888 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-2f95991b-fd11-499f-b3bd-49c582f5fa08 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:29.390088 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-2f95991b-fd11-499f-b3bd-49c582f5fa08 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:29.403647 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2f95991b-fd11-499f-b3bd-49c582f5fa08 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:29.405703 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2f95991b-fd11-499f-b3bd-49c582f5fa08 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:29.406640 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2f95991b-fd11-499f-b3bd-49c582f5fa08 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:29.407688 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2f95991b-fd11-499f-b3bd-49c582f5fa08 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:29.455652 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-b9c5c7e6-4987-450f-b047-bd529014192b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:29.466749 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-b9c5c7e6-4987-450f-b047-bd529014192b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f" status: 200 len: 1322 microversion: 2.1 time: 0.561440 May 24 15:20:29.468191 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 38/75] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:28 2022] GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f => generated 1322 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:20:29.481805 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-ad62e0b2-e235-43c9-af12-065354643e77 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:29.482685 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-ad62e0b2-e235-43c9-af12-065354643e77 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] [instance: 445c11ea-3365-4eb1-a467-bde08bb9ad98] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:29.499801 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ad62e0b2-e235-43c9-af12-065354643e77 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:29.502847 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ad62e0b2-e235-43c9-af12-065354643e77 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:29.503882 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ad62e0b2-e235-43c9-af12-065354643e77 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:29.504832 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ad62e0b2-e235-43c9-af12-065354643e77 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:29.583977 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-2f95991b-fd11-499f-b3bd-49c582f5fa08 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:29.627248 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-2f95991b-fd11-499f-b3bd-49c582f5fa08 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:29.638276 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-2f95991b-fd11-499f-b3bd-49c582f5fa08 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:29.642474 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-2f95991b-fd11-499f-b3bd-49c582f5fa08 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1277 microversion: 2.20 time: 0.262204 May 24 15:20:29.644682 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 38/76] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:20:29 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1277 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:20:29.798163 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ad62e0b2-e235-43c9-af12-065354643e77 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc17670edbb4cc797103b0d41835bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b175a657eab24493b2adbec405cbd515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:29.814359 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-ad62e0b2-e235-43c9-af12-065354643e77 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] 10.222.0.45 "GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98" status: 200 len: 1314 microversion: 2.1 time: 0.340096 May 24 15:20:29.816562 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 39/77] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:29 2022] GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98 => generated 1314 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:20:30.395981 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d2e67346-b9c8-473f-8495-df0709bbde67 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:30.397538 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d2e67346-b9c8-473f-8495-df0709bbde67 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:30.413821 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d2e67346-b9c8-473f-8495-df0709bbde67 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:30.415125 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d2e67346-b9c8-473f-8495-df0709bbde67 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:30.418448 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d2e67346-b9c8-473f-8495-df0709bbde67 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:30.421145 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d2e67346-b9c8-473f-8495-df0709bbde67 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:30.458318 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [req-39a09127-8d22-4b3f-805f-c78772e34d9f req-71baeb51-a9d8-4145-a59a-2f8ce34b524f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "445c11ea-3365-4eb1-a467-bde08bb9ad98", "name": "network-vif-plugged", "status": "completed", "tag": "f5fc33b3-50b8-454b-88ce-6680c8fd2e16"}]} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:20:30.478572 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-39a09127-8d22-4b3f-805f-c78772e34d9f req-71baeb51-a9d8-4145-a59a-2f8ce34b524f service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:30.479046 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-39a09127-8d22-4b3f-805f-c78772e34d9f req-71baeb51-a9d8-4145-a59a-2f8ce34b524f service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:30.503040 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.compute.server_external_events [req-39a09127-8d22-4b3f-805f-c78772e34d9f req-71baeb51-a9d8-4145-a59a-2f8ce34b524f service nova] Creating event network-vif-plugged:f5fc33b3-50b8-454b-88ce-6680c8fd2e16 for instance 445c11ea-3365-4eb1-a467-bde08bb9ad98 on hv-cinder-84315 May 24 15:20:30.518411 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [req-39a09127-8d22-4b3f-805f-c78772e34d9f req-71baeb51-a9d8-4145-a59a-2f8ce34b524f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.463497 May 24 15:20:30.519026 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 39/78] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:20:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:20:30.524243 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-b814dfae-b5fc-4500-be96-19a354aab9d3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:30.531924 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-b814dfae-b5fc-4500-be96-19a354aab9d3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: baacc852-cde4-4e1a-ade9-183a97312b6f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:30.548701 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b814dfae-b5fc-4500-be96-19a354aab9d3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:30.552666 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b814dfae-b5fc-4500-be96-19a354aab9d3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:30.553724 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b814dfae-b5fc-4500-be96-19a354aab9d3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:30.554387 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b814dfae-b5fc-4500-be96-19a354aab9d3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:30.994064 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-d2e67346-b9c8-473f-8495-df0709bbde67 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:31.006929 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d2e67346-b9c8-473f-8495-df0709bbde67 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1296 microversion: 2.1 time: 0.613339 May 24 15:20:31.008774 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 40/79] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:30 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1296 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:20:31.023402 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-1a6b7b47-e5a3-4d52-95aa-0865802090ce tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:31.028873 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-1a6b7b47-e5a3-4d52-95aa-0865802090ce tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:31.041664 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1a6b7b47-e5a3-4d52-95aa-0865802090ce tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:31.045635 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1a6b7b47-e5a3-4d52-95aa-0865802090ce tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:31.046680 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1a6b7b47-e5a3-4d52-95aa-0865802090ce tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:31.048074 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1a6b7b47-e5a3-4d52-95aa-0865802090ce tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:31.255921 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-1a6b7b47-e5a3-4d52-95aa-0865802090ce tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:31.270257 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-1a6b7b47-e5a3-4d52-95aa-0865802090ce tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:31.279590 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-1a6b7b47-e5a3-4d52-95aa-0865802090ce tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:31.281268 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-1a6b7b47-e5a3-4d52-95aa-0865802090ce tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1339 microversion: 2.20 time: 0.265191 May 24 15:20:31.283956 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 41/80] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:20:31 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1339 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:20:31.302194 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-b814dfae-b5fc-4500-be96-19a354aab9d3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:31.304167 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-3d688860-0328-424c-be81-0275b8d38310 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:31.305046 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-3d688860-0328-424c-be81-0275b8d38310 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] [instance: 445c11ea-3365-4eb1-a467-bde08bb9ad98] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:31.314435 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-b814dfae-b5fc-4500-be96-19a354aab9d3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f" status: 200 len: 1322 microversion: 2.1 time: 0.792810 May 24 15:20:31.316289 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 40/81] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:30 2022] GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f => generated 1322 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:20:31.324943 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3d688860-0328-424c-be81-0275b8d38310 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:31.324943 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3d688860-0328-424c-be81-0275b8d38310 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:31.324943 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3d688860-0328-424c-be81-0275b8d38310 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:31.324943 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3d688860-0328-424c-be81-0275b8d38310 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:31.795879 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-3d688860-0328-424c-be81-0275b8d38310 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc17670edbb4cc797103b0d41835bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b175a657eab24493b2adbec405cbd515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:31.810444 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-3d688860-0328-424c-be81-0275b8d38310 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] 10.222.0.45 "GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98" status: 200 len: 1314 microversion: 2.1 time: 0.519878 May 24 15:20:31.811309 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 42/82] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:31 2022] GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98 => generated 1314 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:20:32.028705 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d76316fb-af73-45ce-8d97-d60a80f314a5 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:32.029995 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d76316fb-af73-45ce-8d97-d60a80f314a5 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:32.038940 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d76316fb-af73-45ce-8d97-d60a80f314a5 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:32.039403 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d76316fb-af73-45ce-8d97-d60a80f314a5 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:32.040171 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d76316fb-af73-45ce-8d97-d60a80f314a5 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:32.040634 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d76316fb-af73-45ce-8d97-d60a80f314a5 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:32.327044 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-dec18dd6-3a48-469b-80b7-eef27a84dfbc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:32.331528 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-dec18dd6-3a48-469b-80b7-eef27a84dfbc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:32.380706 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dec18dd6-3a48-469b-80b7-eef27a84dfbc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:32.385134 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dec18dd6-3a48-469b-80b7-eef27a84dfbc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:32.388904 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dec18dd6-3a48-469b-80b7-eef27a84dfbc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:32.393215 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dec18dd6-3a48-469b-80b7-eef27a84dfbc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:32.773973 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-dec18dd6-3a48-469b-80b7-eef27a84dfbc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:32.785541 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-d76316fb-af73-45ce-8d97-d60a80f314a5 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:32.803937 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d76316fb-af73-45ce-8d97-d60a80f314a5 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1363 microversion: 2.1 time: 0.779329 May 24 15:20:32.813881 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-dec18dd6-3a48-469b-80b7-eef27a84dfbc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:32.826772 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 41/83] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:32 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1363 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:20:32.836382 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-945d3cec-e9d3-4c42-863e-129b4659dac9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:32.838065 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-945d3cec-e9d3-4c42-863e-129b4659dac9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: baacc852-cde4-4e1a-ade9-183a97312b6f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:32.849865 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-945d3cec-e9d3-4c42-863e-129b4659dac9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:32.850883 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-945d3cec-e9d3-4c42-863e-129b4659dac9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:32.853792 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-945d3cec-e9d3-4c42-863e-129b4659dac9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:32.854557 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-dec18dd6-3a48-469b-80b7-eef27a84dfbc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:32.859201 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-945d3cec-e9d3-4c42-863e-129b4659dac9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:32.866363 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-dec18dd6-3a48-469b-80b7-eef27a84dfbc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1339 microversion: 2.20 time: 0.565583 May 24 15:20:32.875338 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 43/84] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:20:32 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1339 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:20:32.917706 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d57dadbf-b9bf-46ad-90aa-1fe393d4bf8b tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:32.925305 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d57dadbf-b9bf-46ad-90aa-1fe393d4bf8b tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] [instance: 445c11ea-3365-4eb1-a467-bde08bb9ad98] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:32.968913 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d57dadbf-b9bf-46ad-90aa-1fe393d4bf8b tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:32.972215 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d57dadbf-b9bf-46ad-90aa-1fe393d4bf8b tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:32.978389 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d57dadbf-b9bf-46ad-90aa-1fe393d4bf8b tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:32.982550 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d57dadbf-b9bf-46ad-90aa-1fe393d4bf8b tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:33.524254 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-d57dadbf-b9bf-46ad-90aa-1fe393d4bf8b tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc17670edbb4cc797103b0d41835bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b175a657eab24493b2adbec405cbd515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:33.537500 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d57dadbf-b9bf-46ad-90aa-1fe393d4bf8b tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] 10.222.0.45 "GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98" status: 200 len: 1314 microversion: 2.1 time: 0.654948 May 24 15:20:33.541308 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 44/85] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:32 2022] GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98 => generated 1314 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:20:33.555246 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [req-de7835e2-9ac3-4eb8-bb7a-7f2cc156ce29 req-f0c4c046-8edd-4f52-a7d7-964c8e3f360c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baacc852-cde4-4e1a-ade9-183a97312b6f", "name": "network-vif-plugged", "status": "completed", "tag": "8ddee3e5-269b-490f-9155-2edef63bd8a9"}]} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:20:33.574527 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-de7835e2-9ac3-4eb8-bb7a-7f2cc156ce29 req-f0c4c046-8edd-4f52-a7d7-964c8e3f360c service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:33.574980 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-de7835e2-9ac3-4eb8-bb7a-7f2cc156ce29 req-f0c4c046-8edd-4f52-a7d7-964c8e3f360c service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:33.587765 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.compute.server_external_events [req-de7835e2-9ac3-4eb8-bb7a-7f2cc156ce29 req-f0c4c046-8edd-4f52-a7d7-964c8e3f360c service nova] Creating event network-vif-plugged:8ddee3e5-269b-490f-9155-2edef63bd8a9 for instance baacc852-cde4-4e1a-ade9-183a97312b6f on hv-cinder-84315 May 24 15:20:33.603447 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-945d3cec-e9d3-4c42-863e-129b4659dac9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:33.621928 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [req-de7835e2-9ac3-4eb8-bb7a-7f2cc156ce29 req-f0c4c046-8edd-4f52-a7d7-964c8e3f360c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078562 May 24 15:20:33.626824 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-945d3cec-e9d3-4c42-863e-129b4659dac9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f" status: 200 len: 1322 microversion: 2.1 time: 0.796163 May 24 15:20:33.627896 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 42/86] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:32 2022] GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f => generated 1322 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:20:33.628355 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 45/87] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:20:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:20:33.655794 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [req-a8b11d2c-9f83-45d6-9569-2a91e57130bd req-686a18be-2bef-4bf8-b7e8-66a37481b3ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4aeb46b7-2550-490d-b4a1-f393d14133fa", "tag": "36441b98-6b49-49ee-b389-faf88d9ea47c"}]} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:20:33.683399 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-a8b11d2c-9f83-45d6-9569-2a91e57130bd req-686a18be-2bef-4bf8-b7e8-66a37481b3ee service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:33.683777 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-a8b11d2c-9f83-45d6-9569-2a91e57130bd req-686a18be-2bef-4bf8-b7e8-66a37481b3ee service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:33.706229 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.compute.server_external_events [req-a8b11d2c-9f83-45d6-9569-2a91e57130bd req-686a18be-2bef-4bf8-b7e8-66a37481b3ee service nova] Creating event network-changed:36441b98-6b49-49ee-b389-faf88d9ea47c for instance 4aeb46b7-2550-490d-b4a1-f393d14133fa on hv-cinder-84315 May 24 15:20:33.714871 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [req-a8b11d2c-9f83-45d6-9569-2a91e57130bd req-686a18be-2bef-4bf8-b7e8-66a37481b3ee service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064135 May 24 15:20:33.715456 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 43/88] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:20:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:20:33.838423 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c776d3bf-a472-4a1e-8cdd-95fbdadd9003 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:33.840395 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-c776d3bf-a472-4a1e-8cdd-95fbdadd9003 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:33.848443 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c776d3bf-a472-4a1e-8cdd-95fbdadd9003 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:33.849209 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c776d3bf-a472-4a1e-8cdd-95fbdadd9003 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:33.850184 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c776d3bf-a472-4a1e-8cdd-95fbdadd9003 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:33.851408 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c776d3bf-a472-4a1e-8cdd-95fbdadd9003 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:33.897342 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-84613d2c-0be7-44a1-acdf-5991e42797de tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:33.898299 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-84613d2c-0be7-44a1-acdf-5991e42797de tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:33.912694 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-84613d2c-0be7-44a1-acdf-5991e42797de tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:33.912694 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-84613d2c-0be7-44a1-acdf-5991e42797de tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:33.912694 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-84613d2c-0be7-44a1-acdf-5991e42797de tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:33.912694 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-84613d2c-0be7-44a1-acdf-5991e42797de tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:34.147888 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-c776d3bf-a472-4a1e-8cdd-95fbdadd9003 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:34.156904 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-c776d3bf-a472-4a1e-8cdd-95fbdadd9003 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1363 microversion: 2.1 time: 0.326808 May 24 15:20:34.157998 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 46/89] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:33 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1363 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:20:34.306329 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-84613d2c-0be7-44a1-acdf-5991e42797de tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:34.315984 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-84613d2c-0be7-44a1-acdf-5991e42797de tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:34.320917 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-84613d2c-0be7-44a1-acdf-5991e42797de tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:34.322075 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-84613d2c-0be7-44a1-acdf-5991e42797de tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1407 microversion: 2.20 time: 0.433051 May 24 15:20:34.334811 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 44/90] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:20:33 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1407 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:20:34.558569 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-2d3cf319-7cf3-4ef5-8d9f-e311c3a9abb2 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:34.559208 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-2d3cf319-7cf3-4ef5-8d9f-e311c3a9abb2 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] [instance: 445c11ea-3365-4eb1-a467-bde08bb9ad98] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:34.573478 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2d3cf319-7cf3-4ef5-8d9f-e311c3a9abb2 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:34.573926 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2d3cf319-7cf3-4ef5-8d9f-e311c3a9abb2 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:34.574704 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2d3cf319-7cf3-4ef5-8d9f-e311c3a9abb2 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:34.575136 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2d3cf319-7cf3-4ef5-8d9f-e311c3a9abb2 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:34.645906 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-893443bc-9653-475d-ac03-20c774e8209c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:34.646516 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-893443bc-9653-475d-ac03-20c774e8209c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: baacc852-cde4-4e1a-ade9-183a97312b6f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:34.656558 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-893443bc-9653-475d-ac03-20c774e8209c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:34.657497 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-893443bc-9653-475d-ac03-20c774e8209c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:34.658712 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-893443bc-9653-475d-ac03-20c774e8209c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:34.659331 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-893443bc-9653-475d-ac03-20c774e8209c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:34.994999 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-2d3cf319-7cf3-4ef5-8d9f-e311c3a9abb2 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc17670edbb4cc797103b0d41835bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b175a657eab24493b2adbec405cbd515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:35.006755 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-2d3cf319-7cf3-4ef5-8d9f-e311c3a9abb2 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] 10.222.0.45 "GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98" status: 200 len: 1500 microversion: 2.1 time: 0.452740 May 24 15:20:35.007955 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 47/91] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:34 2022] GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98 => generated 1500 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:20:35.024533 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-893443bc-9653-475d-ac03-20c774e8209c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:35.037804 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-893443bc-9653-475d-ac03-20c774e8209c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f" status: 200 len: 1322 microversion: 2.1 time: 0.396174 May 24 15:20:35.039432 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 45/92] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:34 2022] GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f => generated 1322 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:20:35.159983 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [req-57abd62e-52a1-465d-8e84-9a45bb005da8 req-254dba3f-6bc3-4869-8ef2-a82a046bceb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c54fc3c-070c-4cab-b181-081d80eeb078", "tag": "17e61d65-8da4-4259-8227-bdbecc4fa610"}]} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:20:35.174037 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f051e6d5-11ea-41c0-b7cc-a05f5b1377c0 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:35.174692 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f051e6d5-11ea-41c0-b7cc-a05f5b1377c0 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:35.187114 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f051e6d5-11ea-41c0-b7cc-a05f5b1377c0 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:35.187571 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f051e6d5-11ea-41c0-b7cc-a05f5b1377c0 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:35.188374 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f051e6d5-11ea-41c0-b7cc-a05f5b1377c0 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:35.188814 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f051e6d5-11ea-41c0-b7cc-a05f5b1377c0 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:35.194468 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-57abd62e-52a1-465d-8e84-9a45bb005da8 req-254dba3f-6bc3-4869-8ef2-a82a046bceb4 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:35.195026 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-57abd62e-52a1-465d-8e84-9a45bb005da8 req-254dba3f-6bc3-4869-8ef2-a82a046bceb4 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:35.226406 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.compute.server_external_events [req-57abd62e-52a1-465d-8e84-9a45bb005da8 req-254dba3f-6bc3-4869-8ef2-a82a046bceb4 service nova] Creating event network-changed:17e61d65-8da4-4259-8227-bdbecc4fa610 for instance 6c54fc3c-070c-4cab-b181-081d80eeb078 on hv-cinder-84315 May 24 15:20:35.239602 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [req-57abd62e-52a1-465d-8e84-9a45bb005da8 req-254dba3f-6bc3-4869-8ef2-a82a046bceb4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083955 May 24 15:20:35.241888 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 48/93] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:20:35.345312 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-7b8f2dbd-b7ea-4082-9d39-a37147221674 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:35.346039 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-7b8f2dbd-b7ea-4082-9d39-a37147221674 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:35.356701 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7b8f2dbd-b7ea-4082-9d39-a37147221674 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:35.357483 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7b8f2dbd-b7ea-4082-9d39-a37147221674 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:35.359049 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7b8f2dbd-b7ea-4082-9d39-a37147221674 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:35.359752 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7b8f2dbd-b7ea-4082-9d39-a37147221674 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:35.478535 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-f051e6d5-11ea-41c0-b7cc-a05f5b1377c0 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:35.490280 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f051e6d5-11ea-41c0-b7cc-a05f5b1377c0 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1363 microversion: 2.1 time: 0.320237 May 24 15:20:35.493528 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 46/94] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:35 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1363 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:20:35.640354 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [req-7dc792f0-ab66-4dec-a5c9-44219930329d req-2f106a64-f9bf-431a-ae52-3467c8decf68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d01bc80d-033e-4940-a604-b4f34ee070a9", "name": "network-vif-plugged", "status": "completed", "tag": "3906dca3-c361-4161-9d8e-61cd5fe92161"}]} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:20:35.655270 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-7dc792f0-ab66-4dec-a5c9-44219930329d req-2f106a64-f9bf-431a-ae52-3467c8decf68 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:35.655813 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-7dc792f0-ab66-4dec-a5c9-44219930329d req-2f106a64-f9bf-431a-ae52-3467c8decf68 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:35.699362 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.compute.server_external_events [req-7dc792f0-ab66-4dec-a5c9-44219930329d req-2f106a64-f9bf-431a-ae52-3467c8decf68 service nova] Creating event network-vif-plugged:3906dca3-c361-4161-9d8e-61cd5fe92161 for instance d01bc80d-033e-4940-a604-b4f34ee070a9 on hv-cinder-84315 May 24 15:20:35.706484 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [req-7dc792f0-ab66-4dec-a5c9-44219930329d req-2f106a64-f9bf-431a-ae52-3467c8decf68 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069721 May 24 15:20:35.709305 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 47/95] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:20:35.747911 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-7b8f2dbd-b7ea-4082-9d39-a37147221674 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:35.761057 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-7b8f2dbd-b7ea-4082-9d39-a37147221674 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:35.762667 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-7b8f2dbd-b7ea-4082-9d39-a37147221674 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:35.764000 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-7b8f2dbd-b7ea-4082-9d39-a37147221674 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1407 microversion: 2.20 time: 0.425441 May 24 15:20:35.779206 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 49/96] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:20:35 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1407 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:20:36.056339 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-7ca45263-c358-4a28-b44a-7ba87d23083f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:36.057211 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-7ca45263-c358-4a28-b44a-7ba87d23083f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: baacc852-cde4-4e1a-ade9-183a97312b6f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:36.071499 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7ca45263-c358-4a28-b44a-7ba87d23083f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:36.072093 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7ca45263-c358-4a28-b44a-7ba87d23083f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:36.073621 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7ca45263-c358-4a28-b44a-7ba87d23083f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:36.073875 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7ca45263-c358-4a28-b44a-7ba87d23083f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:36.226575 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-7ca45263-c358-4a28-b44a-7ba87d23083f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:36.234176 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-7ca45263-c358-4a28-b44a-7ba87d23083f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f" status: 200 len: 1322 microversion: 2.1 time: 0.182614 May 24 15:20:36.234955 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 48/97] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:36 2022] GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:20:36.512589 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-b297dc83-421b-4a27-9559-5c7dcfe6c79d tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:36.526779 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-b297dc83-421b-4a27-9559-5c7dcfe6c79d tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:36.566100 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell0:SELECT=4 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:20:36.573381 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b297dc83-421b-4a27-9559-5c7dcfe6c79d tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:36.576895 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b297dc83-421b-4a27-9559-5c7dcfe6c79d tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:36.577948 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b297dc83-421b-4a27-9559-5c7dcfe6c79d tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:36.582155 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b297dc83-421b-4a27-9559-5c7dcfe6c79d tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:36.781378 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-70e6bc7a-03c8-46ed-b174-1ec937fc10ed tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b151257a-be2e-4939-84d5-41fc1e6ae777"}} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:20:36.782423 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-70e6bc7a-03c8-46ed-b174-1ec937fc10ed tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] [instance: 445c11ea-3365-4eb1-a467-bde08bb9ad98] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:36.793815 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-70e6bc7a-03c8-46ed-b174-1ec937fc10ed tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:36.794261 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-70e6bc7a-03c8-46ed-b174-1ec937fc10ed tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:36.795012 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-70e6bc7a-03c8-46ed-b174-1ec937fc10ed tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:36.795450 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-70e6bc7a-03c8-46ed-b174-1ec937fc10ed tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:36.818329 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-b297dc83-421b-4a27-9559-5c7dcfe6c79d tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:36.828025 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-b297dc83-421b-4a27-9559-5c7dcfe6c79d tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1363 microversion: 2.1 time: 0.320512 May 24 15:20:36.828640 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 50/98] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:36 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1363 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:20:36.844803 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-f47c2636-df7b-4a64-bd4b-030dbaa409b2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:36.845666 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-f47c2636-df7b-4a64-bd4b-030dbaa409b2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:36.866096 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f47c2636-df7b-4a64-bd4b-030dbaa409b2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:36.866917 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f47c2636-df7b-4a64-bd4b-030dbaa409b2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:36.867702 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f47c2636-df7b-4a64-bd4b-030dbaa409b2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:36.868817 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f47c2636-df7b-4a64-bd4b-030dbaa409b2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:36.910370 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:20:37.038386 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-f47c2636-df7b-4a64-bd4b-030dbaa409b2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:37.050024 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-f47c2636-df7b-4a64-bd4b-030dbaa409b2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:37.058459 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-f47c2636-df7b-4a64-bd4b-030dbaa409b2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:37.059620 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-f47c2636-df7b-4a64-bd4b-030dbaa409b2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1407 microversion: 2.20 time: 0.218511 May 24 15:20:37.062665 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 51/99] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:20:36 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1407 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:20:37.253253 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-f6d299c3-4f38-4552-92ce-952e2144bf68 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:37.254560 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-f6d299c3-4f38-4552-92ce-952e2144bf68 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: baacc852-cde4-4e1a-ade9-183a97312b6f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:37.267513 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f6d299c3-4f38-4552-92ce-952e2144bf68 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:37.269408 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f6d299c3-4f38-4552-92ce-952e2144bf68 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:37.271508 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f6d299c3-4f38-4552-92ce-952e2144bf68 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:37.273498 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f6d299c3-4f38-4552-92ce-952e2144bf68 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:37.517661 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-f6d299c3-4f38-4552-92ce-952e2144bf68 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:37.525282 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:20:37.528078 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-f6d299c3-4f38-4552-92ce-952e2144bf68 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f" status: 200 len: 1516 microversion: 2.1 time: 0.280324 May 24 15:20:37.529817 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 52/100] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:37 2022] GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f => generated 1516 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:20:37.552545 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-afe53a25-2083-4578-a767-d6ade9b785c1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:20:37.553675 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-afe53a25-2083-4578-a767-d6ade9b785c1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: baacc852-cde4-4e1a-ade9-183a97312b6f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:37.566017 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-afe53a25-2083-4578-a767-d6ade9b785c1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:37.566546 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-afe53a25-2083-4578-a767-d6ade9b785c1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:37.567505 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-afe53a25-2083-4578-a767-d6ade9b785c1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:37.568275 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-afe53a25-2083-4578-a767-d6ade9b785c1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:37.638172 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.objects.instance [None req-afe53a25-2083-4578-a767-d6ade9b785c1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lazy-loading 'flavor' on Instance uuid baacc852-cde4-4e1a-ade9-183a97312b6f {{(pid=117698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 15:20:37.783251 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-afe53a25-2083-4578-a767-d6ade9b785c1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "POST /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f/action" status: 200 len: 32 microversion: 2.1 time: 0.235006 May 24 15:20:37.783867 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 53/101] 10.222.0.45 () {60 vars in 1277 bytes} [Tue May 24 15:20:37 2022] POST /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f/action => generated 32 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 24 15:20:37.793653 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-3e4051c8-0604-4c97-a934-f5648263a951 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:37.794392 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-3e4051c8-0604-4c97-a934-f5648263a951 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: baacc852-cde4-4e1a-ade9-183a97312b6f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:37.804385 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3e4051c8-0604-4c97-a934-f5648263a951 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:37.804871 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3e4051c8-0604-4c97-a934-f5648263a951 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:37.805677 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3e4051c8-0604-4c97-a934-f5648263a951 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:37.806121 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3e4051c8-0604-4c97-a934-f5648263a951 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:37.877083 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell0:SELECT=4 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:20:37.913966 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell0:SELECT=8 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:20:37.952006 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-3e4051c8-0604-4c97-a934-f5648263a951 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:37.959581 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-3e4051c8-0604-4c97-a934-f5648263a951 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f" status: 200 len: 1522 microversion: 2.1 time: 0.170382 May 24 15:20:37.960154 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 54/102] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:37 2022] GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:20:37.975978 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-b633200a-b33e-4462-9514-00f5b223796b tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:37.976627 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-b633200a-b33e-4462-9514-00f5b223796b tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:37.983487 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b633200a-b33e-4462-9514-00f5b223796b tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:37.984358 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b633200a-b33e-4462-9514-00f5b223796b tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:37.985162 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b633200a-b33e-4462-9514-00f5b223796b tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:37.985597 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b633200a-b33e-4462-9514-00f5b223796b tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:38.245216 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell0:SELECT=8 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:20:38.278181 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-b633200a-b33e-4462-9514-00f5b223796b tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:38.287128 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-b633200a-b33e-4462-9514-00f5b223796b tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1363 microversion: 2.1 time: 0.314805 May 24 15:20:38.287672 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 55/103] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:37 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1363 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:20:38.304521 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-5d35bab9-c2a8-43da-bc78-2588eb5f561d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:38.305145 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-5d35bab9-c2a8-43da-bc78-2588eb5f561d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:38.311342 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5d35bab9-c2a8-43da-bc78-2588eb5f561d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:38.311986 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5d35bab9-c2a8-43da-bc78-2588eb5f561d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:38.312882 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5d35bab9-c2a8-43da-bc78-2588eb5f561d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:38.313470 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5d35bab9-c2a8-43da-bc78-2588eb5f561d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:38.546403 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-5d35bab9-c2a8-43da-bc78-2588eb5f561d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:38.561535 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-5d35bab9-c2a8-43da-bc78-2588eb5f561d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:38.566090 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-5d35bab9-c2a8-43da-bc78-2588eb5f561d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:38.568016 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-5d35bab9-c2a8-43da-bc78-2588eb5f561d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1407 microversion: 2.20 time: 0.278712 May 24 15:20:38.569012 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 56/104] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:20:38 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1407 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:20:38.750440 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-70e6bc7a-03c8-46ed-b174-1ec937fc10ed tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] 10.222.0.45 "POST /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.973076 May 24 15:20:38.751564 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 49/105] 10.222.0.45 () {60 vars in 1322 bytes} [Tue May 24 15:20:36 2022] POST /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98/os-volume_attachments => generated 194 bytes in 1976 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:20:38.989640 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-950206ad-f1ff-429b-946b-eed881746552 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:38.990261 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-950206ad-f1ff-429b-946b-eed881746552 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: baacc852-cde4-4e1a-ade9-183a97312b6f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:38.996868 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-950206ad-f1ff-429b-946b-eed881746552 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:38.997483 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-950206ad-f1ff-429b-946b-eed881746552 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:38.998492 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-950206ad-f1ff-429b-946b-eed881746552 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:38.998985 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-950206ad-f1ff-429b-946b-eed881746552 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:39.314553 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-b4284c55-bef3-44e5-b127-f55bb60eb86c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:39.316034 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-b4284c55-bef3-44e5-b127-f55bb60eb86c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:39.336258 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b4284c55-bef3-44e5-b127-f55bb60eb86c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:39.337083 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b4284c55-bef3-44e5-b127-f55bb60eb86c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:39.339777 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b4284c55-bef3-44e5-b127-f55bb60eb86c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:39.341338 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b4284c55-bef3-44e5-b127-f55bb60eb86c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:39.515997 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-950206ad-f1ff-429b-946b-eed881746552 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:39.530179 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-950206ad-f1ff-429b-946b-eed881746552 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f" status: 200 len: 1522 microversion: 2.1 time: 0.548545 May 24 15:20:39.531186 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 57/106] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:38 2022] GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f => generated 1522 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:20:39.586985 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-190fb56c-5df6-450c-a897-3047a9d17e90 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:39.587650 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-190fb56c-5df6-450c-a897-3047a9d17e90 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:39.600176 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-190fb56c-5df6-450c-a897-3047a9d17e90 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:39.601020 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-190fb56c-5df6-450c-a897-3047a9d17e90 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:39.601953 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-190fb56c-5df6-450c-a897-3047a9d17e90 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:39.602631 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-190fb56c-5df6-450c-a897-3047a9d17e90 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:39.657897 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-b4284c55-bef3-44e5-b127-f55bb60eb86c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:39.667552 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-b4284c55-bef3-44e5-b127-f55bb60eb86c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1363 microversion: 2.1 time: 0.366526 May 24 15:20:39.668866 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 50/107] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:39 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1363 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:20:39.854095 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-190fb56c-5df6-450c-a897-3047a9d17e90 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:39.865137 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-190fb56c-5df6-450c-a897-3047a9d17e90 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:39.866632 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-190fb56c-5df6-450c-a897-3047a9d17e90 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:39.867728 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-190fb56c-5df6-450c-a897-3047a9d17e90 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1407 microversion: 2.20 time: 0.284638 May 24 15:20:39.868429 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 58/108] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:20:39 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1407 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:20:40.548091 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d77a6d1c-d7f3-4512-b6dd-2faa4cd619e4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:40.548751 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d77a6d1c-d7f3-4512-b6dd-2faa4cd619e4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: baacc852-cde4-4e1a-ade9-183a97312b6f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:40.555095 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d77a6d1c-d7f3-4512-b6dd-2faa4cd619e4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:40.555544 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d77a6d1c-d7f3-4512-b6dd-2faa4cd619e4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:40.556326 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d77a6d1c-d7f3-4512-b6dd-2faa4cd619e4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:40.557002 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d77a6d1c-d7f3-4512-b6dd-2faa4cd619e4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:40.688449 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-ba604407-c851-465d-8a13-07e2e46d4c37 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:40.689750 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-ba604407-c851-465d-8a13-07e2e46d4c37 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:40.702403 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ba604407-c851-465d-8a13-07e2e46d4c37 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:40.703023 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ba604407-c851-465d-8a13-07e2e46d4c37 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:40.705092 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ba604407-c851-465d-8a13-07e2e46d4c37 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:40.705701 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ba604407-c851-465d-8a13-07e2e46d4c37 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:40.773665 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-d77a6d1c-d7f3-4512-b6dd-2faa4cd619e4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:40.790284 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d77a6d1c-d7f3-4512-b6dd-2faa4cd619e4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f" status: 200 len: 1522 microversion: 2.1 time: 0.245791 May 24 15:20:40.792085 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 51/109] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:40 2022] GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:20:40.864747 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [req-13b3a98d-6e14-40c6-9ef8-930e0986360a req-19029c05-c5f3-4891-b4d3-a98bc091b9a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aeb46b7-2550-490d-b4a1-f393d14133fa", "name": "network-vif-plugged", "status": "completed", "tag": "36441b98-6b49-49ee-b389-faf88d9ea47c"}]} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:20:40.892979 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-13b3a98d-6e14-40c6-9ef8-930e0986360a req-19029c05-c5f3-4891-b4d3-a98bc091b9a8 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:40.893546 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-13b3a98d-6e14-40c6-9ef8-930e0986360a req-19029c05-c5f3-4891-b4d3-a98bc091b9a8 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:40.943486 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.compute.server_external_events [req-13b3a98d-6e14-40c6-9ef8-930e0986360a req-19029c05-c5f3-4891-b4d3-a98bc091b9a8 service nova] Creating event network-vif-plugged:36441b98-6b49-49ee-b389-faf88d9ea47c for instance 4aeb46b7-2550-490d-b4a1-f393d14133fa on hv-cinder-84315 May 24 15:20:40.949113 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [req-13b3a98d-6e14-40c6-9ef8-930e0986360a req-19029c05-c5f3-4891-b4d3-a98bc091b9a8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088859 May 24 15:20:40.949844 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 52/110] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:20:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:20:40.956429 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-2987e771-7f81-4112-8a67-1f6208a016b0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:40.957482 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-2987e771-7f81-4112-8a67-1f6208a016b0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:40.965483 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2987e771-7f81-4112-8a67-1f6208a016b0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:40.966400 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2987e771-7f81-4112-8a67-1f6208a016b0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:40.967352 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2987e771-7f81-4112-8a67-1f6208a016b0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:40.967842 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2987e771-7f81-4112-8a67-1f6208a016b0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:41.022313 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ba604407-c851-465d-8a13-07e2e46d4c37 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:41.039611 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-ba604407-c851-465d-8a13-07e2e46d4c37 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1363 microversion: 2.1 time: 0.358749 May 24 15:20:41.040515 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 59/111] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:40 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1363 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:20:41.139715 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-2987e771-7f81-4112-8a67-1f6208a016b0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:41.148935 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-2987e771-7f81-4112-8a67-1f6208a016b0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:41.150277 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-2987e771-7f81-4112-8a67-1f6208a016b0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:41.152150 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-2987e771-7f81-4112-8a67-1f6208a016b0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1407 microversion: 2.20 time: 0.200978 May 24 15:20:41.152725 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 53/112] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:20:40 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1407 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:20:41.806902 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-a1a9bae5-befc-4c17-9cab-1bf2c5774312 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:41.807514 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-a1a9bae5-befc-4c17-9cab-1bf2c5774312 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: baacc852-cde4-4e1a-ade9-183a97312b6f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:41.813652 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a1a9bae5-befc-4c17-9cab-1bf2c5774312 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:41.814256 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a1a9bae5-befc-4c17-9cab-1bf2c5774312 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:41.815033 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a1a9bae5-befc-4c17-9cab-1bf2c5774312 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:41.815495 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a1a9bae5-befc-4c17-9cab-1bf2c5774312 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:41.952637 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-a1a9bae5-befc-4c17-9cab-1bf2c5774312 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:41.961174 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-a1a9bae5-befc-4c17-9cab-1bf2c5774312 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f" status: 200 len: 1522 microversion: 2.1 time: 0.158027 May 24 15:20:41.961781 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 60/113] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:41 2022] GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:20:42.057182 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-75721bab-5799-4ab4-8973-92e11f085315 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:42.057790 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-75721bab-5799-4ab4-8973-92e11f085315 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:42.064199 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-75721bab-5799-4ab4-8973-92e11f085315 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:42.064684 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-75721bab-5799-4ab4-8973-92e11f085315 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:42.065444 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-75721bab-5799-4ab4-8973-92e11f085315 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:42.065882 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-75721bab-5799-4ab4-8973-92e11f085315 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:42.171631 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-78d52b1f-c330-4a5d-b2db-ac30507318cf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:42.174312 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-78d52b1f-c330-4a5d-b2db-ac30507318cf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:42.194325 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-78d52b1f-c330-4a5d-b2db-ac30507318cf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:42.194807 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-78d52b1f-c330-4a5d-b2db-ac30507318cf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:42.195599 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-78d52b1f-c330-4a5d-b2db-ac30507318cf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:42.196033 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-78d52b1f-c330-4a5d-b2db-ac30507318cf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:42.381768 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-75721bab-5799-4ab4-8973-92e11f085315 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:42.391586 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-75721bab-5799-4ab4-8973-92e11f085315 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1363 microversion: 2.1 time: 0.337470 May 24 15:20:42.393457 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 54/114] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:42 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1363 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:20:42.399405 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-78d52b1f-c330-4a5d-b2db-ac30507318cf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:42.408740 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-78d52b1f-c330-4a5d-b2db-ac30507318cf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:42.410238 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-78d52b1f-c330-4a5d-b2db-ac30507318cf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:42.411515 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-78d52b1f-c330-4a5d-b2db-ac30507318cf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1407 microversion: 2.20 time: 0.244155 May 24 15:20:42.412393 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 61/115] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:20:42 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1407 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:20:42.985905 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-364c9cba-934b-4af2-bdae-078cef9579f9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:42.986731 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-364c9cba-934b-4af2-bdae-078cef9579f9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: baacc852-cde4-4e1a-ade9-183a97312b6f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:42.996808 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-364c9cba-934b-4af2-bdae-078cef9579f9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:42.998077 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-364c9cba-934b-4af2-bdae-078cef9579f9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:42.999615 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-364c9cba-934b-4af2-bdae-078cef9579f9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:43.000508 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-364c9cba-934b-4af2-bdae-078cef9579f9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:43.156536 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-364c9cba-934b-4af2-bdae-078cef9579f9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:43.165685 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-364c9cba-934b-4af2-bdae-078cef9579f9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f" status: 200 len: 1522 microversion: 2.1 time: 0.188594 May 24 15:20:43.167074 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 55/116] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:42 2022] GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:20:43.409490 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-1fb7767d-3b7e-4d56-9184-cde92fe4134d tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:43.410806 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-1fb7767d-3b7e-4d56-9184-cde92fe4134d tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:43.422813 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1fb7767d-3b7e-4d56-9184-cde92fe4134d tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:43.423460 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1fb7767d-3b7e-4d56-9184-cde92fe4134d tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:43.429647 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-8dac6d65-6dd7-4b7c-b89e-3d1c1c2dfc99 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:43.430503 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-8dac6d65-6dd7-4b7c-b89e-3d1c1c2dfc99 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:43.436082 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1fb7767d-3b7e-4d56-9184-cde92fe4134d tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:43.439073 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8dac6d65-6dd7-4b7c-b89e-3d1c1c2dfc99 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:43.440431 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1fb7767d-3b7e-4d56-9184-cde92fe4134d tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:43.444914 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8dac6d65-6dd7-4b7c-b89e-3d1c1c2dfc99 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:43.446012 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8dac6d65-6dd7-4b7c-b89e-3d1c1c2dfc99 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:43.446637 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8dac6d65-6dd7-4b7c-b89e-3d1c1c2dfc99 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:43.626480 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-8dac6d65-6dd7-4b7c-b89e-3d1c1c2dfc99 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:43.640932 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-8dac6d65-6dd7-4b7c-b89e-3d1c1c2dfc99 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:43.642861 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-8dac6d65-6dd7-4b7c-b89e-3d1c1c2dfc99 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:43.644994 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-8dac6d65-6dd7-4b7c-b89e-3d1c1c2dfc99 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1407 microversion: 2.20 time: 0.219239 May 24 15:20:43.645869 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 56/117] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:20:43 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1407 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:20:43.699367 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-1fb7767d-3b7e-4d56-9184-cde92fe4134d tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:43.707193 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-1fb7767d-3b7e-4d56-9184-cde92fe4134d tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1549 microversion: 2.1 time: 0.302077 May 24 15:20:43.709620 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 62/118] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:43 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1549 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:20:43.730844 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-fc684c3b-8378-4acf-a650-eb01e2569096 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:43.735166 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-fc684c3b-8378-4acf-a650-eb01e2569096 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:43.738525 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fc684c3b-8378-4acf-a650-eb01e2569096 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:43.739226 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fc684c3b-8378-4acf-a650-eb01e2569096 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:43.740185 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fc684c3b-8378-4acf-a650-eb01e2569096 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:43.740826 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fc684c3b-8378-4acf-a650-eb01e2569096 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:43.870476 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-fc684c3b-8378-4acf-a650-eb01e2569096 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.147366 May 24 15:20:43.872931 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 57/119] 10.222.0.45 () {58 vars in 1274 bytes} [Tue May 24 15:20:43 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa/os-interface => generated 285 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:20:44.183334 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-104e6817-a5d4-42e2-b646-743893144e70 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:44.183944 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-104e6817-a5d4-42e2-b646-743893144e70 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: baacc852-cde4-4e1a-ade9-183a97312b6f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:44.189931 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-104e6817-a5d4-42e2-b646-743893144e70 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:44.190651 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-104e6817-a5d4-42e2-b646-743893144e70 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:44.191661 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-104e6817-a5d4-42e2-b646-743893144e70 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:44.192178 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-104e6817-a5d4-42e2-b646-743893144e70 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:44.448516 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-104e6817-a5d4-42e2-b646-743893144e70 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:44.460075 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-104e6817-a5d4-42e2-b646-743893144e70 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f" status: 200 len: 1522 microversion: 2.1 time: 0.280750 May 24 15:20:44.460762 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 63/120] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:44 2022] GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f => generated 1522 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:20:44.665276 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f8c82a41-cd87-4a28-8afd-73b5b83e6a91 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:44.667221 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f8c82a41-cd87-4a28-8afd-73b5b83e6a91 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:44.682168 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f8c82a41-cd87-4a28-8afd-73b5b83e6a91 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:44.683155 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f8c82a41-cd87-4a28-8afd-73b5b83e6a91 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:44.685493 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f8c82a41-cd87-4a28-8afd-73b5b83e6a91 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:44.687148 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f8c82a41-cd87-4a28-8afd-73b5b83e6a91 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:44.894343 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [req-7115e8b8-4c08-4ffc-8c4f-ae22e45ff719 req-45c1e0af-432d-42ee-8bae-f9e0a64ae757 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c54fc3c-070c-4cab-b181-081d80eeb078", "name": "network-vif-plugged", "status": "completed", "tag": "17e61d65-8da4-4259-8227-bdbecc4fa610"}]} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:20:44.913740 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-7115e8b8-4c08-4ffc-8c4f-ae22e45ff719 req-45c1e0af-432d-42ee-8bae-f9e0a64ae757 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:44.914304 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-7115e8b8-4c08-4ffc-8c4f-ae22e45ff719 req-45c1e0af-432d-42ee-8bae-f9e0a64ae757 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:44.943306 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.compute.server_external_events [req-7115e8b8-4c08-4ffc-8c4f-ae22e45ff719 req-45c1e0af-432d-42ee-8bae-f9e0a64ae757 service nova] Creating event network-vif-plugged:17e61d65-8da4-4259-8227-bdbecc4fa610 for instance 6c54fc3c-070c-4cab-b181-081d80eeb078 on hv-cinder-84315 May 24 15:20:44.954100 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [req-7115e8b8-4c08-4ffc-8c4f-ae22e45ff719 req-45c1e0af-432d-42ee-8bae-f9e0a64ae757 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063225 May 24 15:20:44.955186 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 64/121] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:20:45.388617 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-f8c82a41-cd87-4a28-8afd-73b5b83e6a91 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:45.401434 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-f8c82a41-cd87-4a28-8afd-73b5b83e6a91 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:45.403216 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-f8c82a41-cd87-4a28-8afd-73b5b83e6a91 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:45.407283 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f8c82a41-cd87-4a28-8afd-73b5b83e6a91 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1407 microversion: 2.20 time: 0.747915 May 24 15:20:45.412514 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 58/122] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:20:44 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1407 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:20:45.483400 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c350e731-d902-420b-b3d8-8cb142a96f1c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:45.484111 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-c350e731-d902-420b-b3d8-8cb142a96f1c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: baacc852-cde4-4e1a-ade9-183a97312b6f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:45.492930 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c350e731-d902-420b-b3d8-8cb142a96f1c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:45.493439 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c350e731-d902-420b-b3d8-8cb142a96f1c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:45.494839 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c350e731-d902-420b-b3d8-8cb142a96f1c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:45.495519 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c350e731-d902-420b-b3d8-8cb142a96f1c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:45.730692 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-c350e731-d902-420b-b3d8-8cb142a96f1c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:45.743651 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-c350e731-d902-420b-b3d8-8cb142a96f1c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f" status: 200 len: 1522 microversion: 2.1 time: 0.266378 May 24 15:20:45.756281 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 65/123] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:45 2022] GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:20:46.058225 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [req-f70f7e44-3f5a-458e-ad62-8712c04b0681 req-bc23c6da-7f8c-4800-a54e-d7df9aaa8106 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4aeb46b7-2550-490d-b4a1-f393d14133fa", "tag": "36441b98-6b49-49ee-b389-faf88d9ea47c"}]} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:20:46.069706 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-f70f7e44-3f5a-458e-ad62-8712c04b0681 req-bc23c6da-7f8c-4800-a54e-d7df9aaa8106 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:46.070717 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-f70f7e44-3f5a-458e-ad62-8712c04b0681 req-bc23c6da-7f8c-4800-a54e-d7df9aaa8106 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:46.089354 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.compute.server_external_events [req-f70f7e44-3f5a-458e-ad62-8712c04b0681 req-bc23c6da-7f8c-4800-a54e-d7df9aaa8106 service nova] Creating event network-changed:36441b98-6b49-49ee-b389-faf88d9ea47c for instance 4aeb46b7-2550-490d-b4a1-f393d14133fa on hv-cinder-84315 May 24 15:20:46.101137 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [req-f70f7e44-3f5a-458e-ad62-8712c04b0681 req-bc23c6da-7f8c-4800-a54e-d7df9aaa8106 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047817 May 24 15:20:46.105060 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 59/124] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:20:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:20:46.443156 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e3a3777b-bb5d-4dfb-a74c-724c43d25856 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:46.446271 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e3a3777b-bb5d-4dfb-a74c-724c43d25856 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:46.454959 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e3a3777b-bb5d-4dfb-a74c-724c43d25856 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:46.457027 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e3a3777b-bb5d-4dfb-a74c-724c43d25856 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:46.458148 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e3a3777b-bb5d-4dfb-a74c-724c43d25856 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:46.458565 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e3a3777b-bb5d-4dfb-a74c-724c43d25856 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:46.663618 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e3a3777b-bb5d-4dfb-a74c-724c43d25856 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:46.673442 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e3a3777b-bb5d-4dfb-a74c-724c43d25856 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:46.674964 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e3a3777b-bb5d-4dfb-a74c-724c43d25856 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:46.676683 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e3a3777b-bb5d-4dfb-a74c-724c43d25856 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1407 microversion: 2.20 time: 0.248155 May 24 15:20:46.687981 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 66/125] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:20:46 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1407 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:20:46.765289 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-7f5b763b-7fdc-41d3-925d-65b9bdd9bb7b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:46.765988 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-7f5b763b-7fdc-41d3-925d-65b9bdd9bb7b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: baacc852-cde4-4e1a-ade9-183a97312b6f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:46.772803 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7f5b763b-7fdc-41d3-925d-65b9bdd9bb7b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:46.773046 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7f5b763b-7fdc-41d3-925d-65b9bdd9bb7b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:46.773818 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7f5b763b-7fdc-41d3-925d-65b9bdd9bb7b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:46.774245 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7f5b763b-7fdc-41d3-925d-65b9bdd9bb7b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:46.962741 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-7f5b763b-7fdc-41d3-925d-65b9bdd9bb7b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:46.984008 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-7f5b763b-7fdc-41d3-925d-65b9bdd9bb7b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f" status: 200 len: 1522 microversion: 2.1 time: 0.224114 May 24 15:20:46.993067 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 60/126] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:46 2022] GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:20:47.700698 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-bf5eb762-d6b4-49c8-bd2b-d5c2bdec3869 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:47.701543 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-bf5eb762-d6b4-49c8-bd2b-d5c2bdec3869 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:47.719796 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bf5eb762-d6b4-49c8-bd2b-d5c2bdec3869 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:47.724178 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bf5eb762-d6b4-49c8-bd2b-d5c2bdec3869 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:47.725059 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bf5eb762-d6b4-49c8-bd2b-d5c2bdec3869 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:47.733381 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bf5eb762-d6b4-49c8-bd2b-d5c2bdec3869 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:47.891410 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-bf5eb762-d6b4-49c8-bd2b-d5c2bdec3869 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:47.901682 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-bf5eb762-d6b4-49c8-bd2b-d5c2bdec3869 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:47.903215 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-bf5eb762-d6b4-49c8-bd2b-d5c2bdec3869 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:47.904458 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-bf5eb762-d6b4-49c8-bd2b-d5c2bdec3869 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1407 microversion: 2.20 time: 0.207846 May 24 15:20:47.905400 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 67/127] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:20:47 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1407 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:20:48.005226 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-cf111e5b-7cd1-4c40-85fa-d106d4bf92aa tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:48.006022 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-cf111e5b-7cd1-4c40-85fa-d106d4bf92aa tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: baacc852-cde4-4e1a-ade9-183a97312b6f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:48.013909 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cf111e5b-7cd1-4c40-85fa-d106d4bf92aa tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:48.014530 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cf111e5b-7cd1-4c40-85fa-d106d4bf92aa tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:48.015305 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cf111e5b-7cd1-4c40-85fa-d106d4bf92aa tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:48.015817 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cf111e5b-7cd1-4c40-85fa-d106d4bf92aa tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:48.159640 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-cf111e5b-7cd1-4c40-85fa-d106d4bf92aa tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:48.176223 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-cf111e5b-7cd1-4c40-85fa-d106d4bf92aa tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f" status: 200 len: 1522 microversion: 2.1 time: 0.175348 May 24 15:20:48.176779 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 61/128] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:47 2022] GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:20:48.922161 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-1b855cd8-e909-459d-abb3-4bb7331061d3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:48.922760 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-1b855cd8-e909-459d-abb3-4bb7331061d3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:48.929833 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1b855cd8-e909-459d-abb3-4bb7331061d3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:48.930292 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1b855cd8-e909-459d-abb3-4bb7331061d3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:48.931228 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1b855cd8-e909-459d-abb3-4bb7331061d3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:48.931710 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1b855cd8-e909-459d-abb3-4bb7331061d3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:48.935814 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:20:49.094115 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-1b855cd8-e909-459d-abb3-4bb7331061d3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:49.105853 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-1b855cd8-e909-459d-abb3-4bb7331061d3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:49.107790 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-1b855cd8-e909-459d-abb3-4bb7331061d3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:49.109346 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-1b855cd8-e909-459d-abb3-4bb7331061d3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1600 microversion: 2.20 time: 0.191175 May 24 15:20:49.109998 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 68/129] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:20:48 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1600 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:20:49.137326 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-c068cf09-0cd0-4e8e-a445-468caba5603b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:49.137326 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-c068cf09-0cd0-4e8e-a445-468caba5603b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:49.139280 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c068cf09-0cd0-4e8e-a445-468caba5603b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:49.139819 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c068cf09-0cd0-4e8e-a445-468caba5603b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:49.140712 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c068cf09-0cd0-4e8e-a445-468caba5603b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:49.141232 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c068cf09-0cd0-4e8e-a445-468caba5603b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:49.192828 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-0940d27e-9ff6-4064-96e4-d92382caf25b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:49.193441 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-0940d27e-9ff6-4064-96e4-d92382caf25b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: baacc852-cde4-4e1a-ade9-183a97312b6f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:49.200846 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0940d27e-9ff6-4064-96e4-d92382caf25b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:49.201291 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0940d27e-9ff6-4064-96e4-d92382caf25b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:49.202063 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0940d27e-9ff6-4064-96e4-d92382caf25b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:49.202496 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0940d27e-9ff6-4064-96e4-d92382caf25b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:49.236618 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-c068cf09-0cd0-4e8e-a445-468caba5603b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.112152 May 24 15:20:49.237810 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 62/130] 10.222.0.45 () {60 vars in 1315 bytes} [Tue May 24 15:20:49 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-interface => generated 285 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:20:49.397989 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-0940d27e-9ff6-4064-96e4-d92382caf25b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:49.405989 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-0940d27e-9ff6-4064-96e4-d92382caf25b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f" status: 200 len: 1522 microversion: 2.1 time: 0.217080 May 24 15:20:49.406571 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 69/131] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:49 2022] GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:20:50.124562 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-7c85716b-9b37-46b6-a61e-9af58c9d86d0 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:50.124720 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-7c85716b-9b37-46b6-a61e-9af58c9d86d0 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] [instance: 445c11ea-3365-4eb1-a467-bde08bb9ad98] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:50.136935 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7c85716b-9b37-46b6-a61e-9af58c9d86d0 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:50.137650 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7c85716b-9b37-46b6-a61e-9af58c9d86d0 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:50.140735 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7c85716b-9b37-46b6-a61e-9af58c9d86d0 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:50.142190 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7c85716b-9b37-46b6-a61e-9af58c9d86d0 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:50.181470 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-7c85716b-9b37-46b6-a61e-9af58c9d86d0 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] [instance: 445c11ea-3365-4eb1-a467-bde08bb9ad98] Going to try to terminate instance {{(pid=117699) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 15:20:50.401256 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-7c85716b-9b37-46b6-a61e-9af58c9d86d0 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] 10.222.0.45 "DELETE /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98" status: 204 len: 0 microversion: 2.1 time: 0.273517 May 24 15:20:50.401920 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 63/132] 10.222.0.45 () {58 vars in 1238 bytes} [Tue May 24 15:20:50 2022] DELETE /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 15:20:50.412128 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-968fa0a2-f68c-457e-914b-2e4421977f45 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:50.413917 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-968fa0a2-f68c-457e-914b-2e4421977f45 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] [instance: 445c11ea-3365-4eb1-a467-bde08bb9ad98] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:50.423940 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-968fa0a2-f68c-457e-914b-2e4421977f45 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:50.424885 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-968fa0a2-f68c-457e-914b-2e4421977f45 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:50.426514 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-968fa0a2-f68c-457e-914b-2e4421977f45 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:50.427231 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-968fa0a2-f68c-457e-914b-2e4421977f45 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:50.437602 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-cc6aaac0-4383-4074-b2ed-d2f63924d1ae tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:50.439936 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-cc6aaac0-4383-4074-b2ed-d2f63924d1ae tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: baacc852-cde4-4e1a-ade9-183a97312b6f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:50.452963 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cc6aaac0-4383-4074-b2ed-d2f63924d1ae tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:50.454868 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cc6aaac0-4383-4074-b2ed-d2f63924d1ae tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:50.455850 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cc6aaac0-4383-4074-b2ed-d2f63924d1ae tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:50.457091 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cc6aaac0-4383-4074-b2ed-d2f63924d1ae tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:50.695230 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-968fa0a2-f68c-457e-914b-2e4421977f45 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc17670edbb4cc797103b0d41835bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b175a657eab24493b2adbec405cbd515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:50.705163 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-968fa0a2-f68c-457e-914b-2e4421977f45 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] 10.222.0.45 "GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98" status: 200 len: 1552 microversion: 2.1 time: 0.299037 May 24 15:20:50.706072 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 70/133] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:50 2022] GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98 => generated 1552 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:20:50.753743 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-cc6aaac0-4383-4074-b2ed-d2f63924d1ae tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:50.761927 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-cc6aaac0-4383-4074-b2ed-d2f63924d1ae tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f" status: 200 len: 1522 microversion: 2.1 time: 0.341806 May 24 15:20:50.778248 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 64/134] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:50 2022] GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f => generated 1522 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:20:51.506995 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [req-534452bd-c647-4e24-ab23-a99502e08bfb req-fd6fbfad-ae95-444b-9332-dc99df2cac11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c54fc3c-070c-4cab-b181-081d80eeb078", "tag": "17e61d65-8da4-4259-8227-bdbecc4fa610"}]} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:20:51.517944 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-534452bd-c647-4e24-ab23-a99502e08bfb req-fd6fbfad-ae95-444b-9332-dc99df2cac11 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:51.518692 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-534452bd-c647-4e24-ab23-a99502e08bfb req-fd6fbfad-ae95-444b-9332-dc99df2cac11 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:51.537183 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.compute.server_external_events [req-534452bd-c647-4e24-ab23-a99502e08bfb req-fd6fbfad-ae95-444b-9332-dc99df2cac11 service nova] Creating event network-changed:17e61d65-8da4-4259-8227-bdbecc4fa610 for instance 6c54fc3c-070c-4cab-b181-081d80eeb078 on hv-cinder-84315 May 24 15:20:51.544906 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [req-534452bd-c647-4e24-ab23-a99502e08bfb req-fd6fbfad-ae95-444b-9332-dc99df2cac11 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041221 May 24 15:20:51.546203 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 71/135] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:20:51.724705 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-65d0f410-62fd-48a7-b13e-dff9163c9232 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:51.726245 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-65d0f410-62fd-48a7-b13e-dff9163c9232 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] [instance: 445c11ea-3365-4eb1-a467-bde08bb9ad98] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:51.734114 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-65d0f410-62fd-48a7-b13e-dff9163c9232 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:51.734851 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-65d0f410-62fd-48a7-b13e-dff9163c9232 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:51.735989 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-65d0f410-62fd-48a7-b13e-dff9163c9232 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:51.736674 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-65d0f410-62fd-48a7-b13e-dff9163c9232 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:51.760653 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:20:51.784692 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-2d8a7207-55bc-4ed3-a9e2-8c2205586f5f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:51.785689 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-2d8a7207-55bc-4ed3-a9e2-8c2205586f5f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: baacc852-cde4-4e1a-ade9-183a97312b6f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:51.797196 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2d8a7207-55bc-4ed3-a9e2-8c2205586f5f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:51.798068 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2d8a7207-55bc-4ed3-a9e2-8c2205586f5f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:51.799073 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2d8a7207-55bc-4ed3-a9e2-8c2205586f5f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:51.799832 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2d8a7207-55bc-4ed3-a9e2-8c2205586f5f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:51.933691 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-65d0f410-62fd-48a7-b13e-dff9163c9232 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc17670edbb4cc797103b0d41835bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b175a657eab24493b2adbec405cbd515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:51.945691 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-65d0f410-62fd-48a7-b13e-dff9163c9232 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] 10.222.0.45 "GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98" status: 200 len: 1552 microversion: 2.1 time: 0.224764 May 24 15:20:51.949476 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 65/136] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:51 2022] GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98 => generated 1552 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:20:52.042272 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-2d8a7207-55bc-4ed3-a9e2-8c2205586f5f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:52.050353 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-2d8a7207-55bc-4ed3-a9e2-8c2205586f5f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f" status: 200 len: 1522 microversion: 2.1 time: 0.270048 May 24 15:20:52.052569 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 72/137] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:51 2022] GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:20:52.965867 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-75b1d88b-c143-4d35-97df-73daa67be91e tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:52.966489 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-75b1d88b-c143-4d35-97df-73daa67be91e tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] [instance: 445c11ea-3365-4eb1-a467-bde08bb9ad98] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:52.972285 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:20:52.973949 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-75b1d88b-c143-4d35-97df-73daa67be91e tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:52.974599 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-75b1d88b-c143-4d35-97df-73daa67be91e tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:52.975517 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-75b1d88b-c143-4d35-97df-73daa67be91e tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:52.976099 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-75b1d88b-c143-4d35-97df-73daa67be91e tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:53.068569 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-b230e3b8-44dc-46ef-bf5b-e82d715045e7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:53.069129 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-b230e3b8-44dc-46ef-bf5b-e82d715045e7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: baacc852-cde4-4e1a-ade9-183a97312b6f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:53.075639 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b230e3b8-44dc-46ef-bf5b-e82d715045e7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:53.077939 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b230e3b8-44dc-46ef-bf5b-e82d715045e7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:53.081647 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b230e3b8-44dc-46ef-bf5b-e82d715045e7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:53.082095 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b230e3b8-44dc-46ef-bf5b-e82d715045e7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:53.151991 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-75b1d88b-c143-4d35-97df-73daa67be91e tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc17670edbb4cc797103b0d41835bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b175a657eab24493b2adbec405cbd515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:53.162085 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-75b1d88b-c143-4d35-97df-73daa67be91e tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] 10.222.0.45 "GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98" status: 200 len: 1552 microversion: 2.1 time: 0.199252 May 24 15:20:53.163361 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 66/138] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:52 2022] GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98 => generated 1552 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:20:53.246393 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-b230e3b8-44dc-46ef-bf5b-e82d715045e7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:53.254531 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-b230e3b8-44dc-46ef-bf5b-e82d715045e7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f" status: 200 len: 1522 microversion: 2.1 time: 0.190008 May 24 15:20:53.264638 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 73/139] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:53 2022] GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:20:54.180651 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-0b41bd6f-1f1e-4d1f-bb63-9176186b8500 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:54.181825 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-0b41bd6f-1f1e-4d1f-bb63-9176186b8500 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] [instance: 445c11ea-3365-4eb1-a467-bde08bb9ad98] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:54.190320 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0b41bd6f-1f1e-4d1f-bb63-9176186b8500 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:54.191444 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0b41bd6f-1f1e-4d1f-bb63-9176186b8500 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:54.192738 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0b41bd6f-1f1e-4d1f-bb63-9176186b8500 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:54.193313 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0b41bd6f-1f1e-4d1f-bb63-9176186b8500 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:54.271807 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-9de818f7-0b05-4aed-9e7a-20ab1e2ff1a2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:54.272972 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-9de818f7-0b05-4aed-9e7a-20ab1e2ff1a2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: baacc852-cde4-4e1a-ade9-183a97312b6f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:54.288437 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:20:54.296538 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9de818f7-0b05-4aed-9e7a-20ab1e2ff1a2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:54.297276 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9de818f7-0b05-4aed-9e7a-20ab1e2ff1a2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:54.298408 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9de818f7-0b05-4aed-9e7a-20ab1e2ff1a2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:54.299002 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9de818f7-0b05-4aed-9e7a-20ab1e2ff1a2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:54.380575 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-0b41bd6f-1f1e-4d1f-bb63-9176186b8500 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc17670edbb4cc797103b0d41835bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b175a657eab24493b2adbec405cbd515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:54.394164 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-0b41bd6f-1f1e-4d1f-bb63-9176186b8500 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] 10.222.0.45 "GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98" status: 200 len: 1552 microversion: 2.1 time: 0.216569 May 24 15:20:54.397237 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 67/140] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:54 2022] GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98 => generated 1552 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:20:54.495330 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-9de818f7-0b05-4aed-9e7a-20ab1e2ff1a2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:54.503381 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-9de818f7-0b05-4aed-9e7a-20ab1e2ff1a2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f" status: 200 len: 1522 microversion: 2.1 time: 0.235790 May 24 15:20:54.504088 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 74/141] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:54 2022] GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:20:55.413727 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-3bcadfd9-598d-413c-bf63-a56c0827b4f8 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:55.414331 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-3bcadfd9-598d-413c-bf63-a56c0827b4f8 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] [instance: 445c11ea-3365-4eb1-a467-bde08bb9ad98] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:55.421468 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3bcadfd9-598d-413c-bf63-a56c0827b4f8 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:55.421911 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3bcadfd9-598d-413c-bf63-a56c0827b4f8 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:55.422658 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3bcadfd9-598d-413c-bf63-a56c0827b4f8 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:55.423089 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3bcadfd9-598d-413c-bf63-a56c0827b4f8 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:55.521858 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-aac24a13-5956-4bfb-81b2-11664089056e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:55.524273 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-aac24a13-5956-4bfb-81b2-11664089056e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: baacc852-cde4-4e1a-ade9-183a97312b6f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:55.535060 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-aac24a13-5956-4bfb-81b2-11664089056e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:55.536982 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-aac24a13-5956-4bfb-81b2-11664089056e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:55.542571 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-aac24a13-5956-4bfb-81b2-11664089056e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:55.543040 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-aac24a13-5956-4bfb-81b2-11664089056e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:55.647577 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-3bcadfd9-598d-413c-bf63-a56c0827b4f8 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc17670edbb4cc797103b0d41835bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b175a657eab24493b2adbec405cbd515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:55.658570 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-3bcadfd9-598d-413c-bf63-a56c0827b4f8 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] 10.222.0.45 "GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98" status: 200 len: 1552 microversion: 2.1 time: 0.248520 May 24 15:20:55.659225 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 68/142] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:55 2022] GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98 => generated 1552 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:20:55.838383 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-aac24a13-5956-4bfb-81b2-11664089056e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:55.847015 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-aac24a13-5956-4bfb-81b2-11664089056e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f" status: 200 len: 1522 microversion: 2.1 time: 0.330109 May 24 15:20:55.856755 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 75/143] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:55 2022] GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f => generated 1522 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:20:56.269110 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [req-55863146-2497-4322-990b-2d7fc6e743e1 req-e72c5f5b-cea5-490c-b682-89e36b24775d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "445c11ea-3365-4eb1-a467-bde08bb9ad98", "name": "network-vif-deleted", "tag": "f5fc33b3-50b8-454b-88ce-6680c8fd2e16"}]} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:20:56.279434 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-55863146-2497-4322-990b-2d7fc6e743e1 req-e72c5f5b-cea5-490c-b682-89e36b24775d service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:56.280065 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-55863146-2497-4322-990b-2d7fc6e743e1 req-e72c5f5b-cea5-490c-b682-89e36b24775d service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:56.292686 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.compute.server_external_events [req-55863146-2497-4322-990b-2d7fc6e743e1 req-e72c5f5b-cea5-490c-b682-89e36b24775d service nova] Creating event network-vif-deleted:f5fc33b3-50b8-454b-88ce-6680c8fd2e16 for instance 445c11ea-3365-4eb1-a467-bde08bb9ad98 on hv-cinder-84315 May 24 15:20:56.298646 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [req-55863146-2497-4322-990b-2d7fc6e743e1 req-e72c5f5b-cea5-490c-b682-89e36b24775d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033151 May 24 15:20:56.299254 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 69/144] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:20:56.676221 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-1e51c533-f6a0-44a6-8703-b153b08ec067 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:56.676917 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-1e51c533-f6a0-44a6-8703-b153b08ec067 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] [instance: 445c11ea-3365-4eb1-a467-bde08bb9ad98] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:56.684859 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1e51c533-f6a0-44a6-8703-b153b08ec067 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:56.685328 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1e51c533-f6a0-44a6-8703-b153b08ec067 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:56.686115 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1e51c533-f6a0-44a6-8703-b153b08ec067 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:56.686718 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1e51c533-f6a0-44a6-8703-b153b08ec067 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:56.753663 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-1e51c533-f6a0-44a6-8703-b153b08ec067 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc17670edbb4cc797103b0d41835bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b175a657eab24493b2adbec405cbd515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:56.762100 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-1e51c533-f6a0-44a6-8703-b153b08ec067 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] 10.222.0.45 "GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98" status: 200 len: 1345 microversion: 2.1 time: 0.089909 May 24 15:20:56.762684 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 76/145] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:56 2022] GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98 => generated 1345 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:20:56.865801 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d493840c-a3f8-413d-8c9f-389508763ac8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:56.866498 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d493840c-a3f8-413d-8c9f-389508763ac8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: baacc852-cde4-4e1a-ade9-183a97312b6f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:56.872738 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d493840c-a3f8-413d-8c9f-389508763ac8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:56.873184 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d493840c-a3f8-413d-8c9f-389508763ac8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:56.873946 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d493840c-a3f8-413d-8c9f-389508763ac8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:56.874373 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d493840c-a3f8-413d-8c9f-389508763ac8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:56.998926 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-d493840c-a3f8-413d-8c9f-389508763ac8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:57.006387 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d493840c-a3f8-413d-8c9f-389508763ac8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f" status: 200 len: 1522 microversion: 2.1 time: 0.145920 May 24 15:20:57.006953 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 70/146] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:56 2022] GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:20:57.778746 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-25580cd6-5584-485a-a22e-fec5cb8f1d72 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:57.779366 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-25580cd6-5584-485a-a22e-fec5cb8f1d72 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] [instance: 445c11ea-3365-4eb1-a467-bde08bb9ad98] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:57.785712 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-25580cd6-5584-485a-a22e-fec5cb8f1d72 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:57.786159 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-25580cd6-5584-485a-a22e-fec5cb8f1d72 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:57.786924 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-25580cd6-5584-485a-a22e-fec5cb8f1d72 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:57.787358 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-25580cd6-5584-485a-a22e-fec5cb8f1d72 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:57.847675 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-25580cd6-5584-485a-a22e-fec5cb8f1d72 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc17670edbb4cc797103b0d41835bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b175a657eab24493b2adbec405cbd515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:57.856126 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-25580cd6-5584-485a-a22e-fec5cb8f1d72 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] 10.222.0.45 "GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98" status: 200 len: 1345 microversion: 2.1 time: 0.081109 May 24 15:20:57.856680 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 77/147] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:57 2022] GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98 => generated 1345 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:20:58.023338 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-57ba79b1-2ee5-4e85-b34b-8f87697a3fc2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:58.023956 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-57ba79b1-2ee5-4e85-b34b-8f87697a3fc2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: baacc852-cde4-4e1a-ade9-183a97312b6f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:58.030645 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-57ba79b1-2ee5-4e85-b34b-8f87697a3fc2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:58.031092 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-57ba79b1-2ee5-4e85-b34b-8f87697a3fc2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:58.031856 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-57ba79b1-2ee5-4e85-b34b-8f87697a3fc2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:58.032290 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-57ba79b1-2ee5-4e85-b34b-8f87697a3fc2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:58.162617 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-57ba79b1-2ee5-4e85-b34b-8f87697a3fc2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:58.170670 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-57ba79b1-2ee5-4e85-b34b-8f87697a3fc2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f" status: 200 len: 1522 microversion: 2.1 time: 0.151284 May 24 15:20:58.171235 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 71/148] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:58 2022] GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:20:58.873478 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-81fdd818-00f4-40a1-9324-7d2495044d1f tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:58.874081 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-81fdd818-00f4-40a1-9324-7d2495044d1f tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] [instance: 445c11ea-3365-4eb1-a467-bde08bb9ad98] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:58.880045 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-81fdd818-00f4-40a1-9324-7d2495044d1f tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:58.880519 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-81fdd818-00f4-40a1-9324-7d2495044d1f tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:58.881267 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-81fdd818-00f4-40a1-9324-7d2495044d1f tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:58.881699 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-81fdd818-00f4-40a1-9324-7d2495044d1f tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:58.942304 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-81fdd818-00f4-40a1-9324-7d2495044d1f tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc17670edbb4cc797103b0d41835bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b175a657eab24493b2adbec405cbd515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:58.951248 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-81fdd818-00f4-40a1-9324-7d2495044d1f tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] 10.222.0.45 "GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98" status: 200 len: 1345 microversion: 2.1 time: 0.082031 May 24 15:20:58.951810 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 78/149] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:58 2022] GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98 => generated 1345 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:20:59.187823 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-91882b50-9949-4156-a1db-8cc9e0f30f31 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:59.188466 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-91882b50-9949-4156-a1db-8cc9e0f30f31 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: baacc852-cde4-4e1a-ade9-183a97312b6f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:59.194928 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-91882b50-9949-4156-a1db-8cc9e0f30f31 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:59.195370 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-91882b50-9949-4156-a1db-8cc9e0f30f31 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:59.196126 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-91882b50-9949-4156-a1db-8cc9e0f30f31 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:59.196587 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-91882b50-9949-4156-a1db-8cc9e0f30f31 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:59.323320 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-91882b50-9949-4156-a1db-8cc9e0f30f31 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:20:59.330665 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-91882b50-9949-4156-a1db-8cc9e0f30f31 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f" status: 200 len: 1522 microversion: 2.1 time: 0.146694 May 24 15:20:59.331211 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 72/150] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:59 2022] GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:20:59.967253 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-8f184849-2714-42a1-a430-ccdad042804a tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:20:59.968598 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-8f184849-2714-42a1-a430-ccdad042804a tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] [instance: 445c11ea-3365-4eb1-a467-bde08bb9ad98] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:20:59.974649 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8f184849-2714-42a1-a430-ccdad042804a tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:59.975100 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8f184849-2714-42a1-a430-ccdad042804a tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:20:59.975880 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8f184849-2714-42a1-a430-ccdad042804a tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:20:59.976331 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8f184849-2714-42a1-a430-ccdad042804a tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:00.040479 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-8f184849-2714-42a1-a430-ccdad042804a tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc17670edbb4cc797103b0d41835bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b175a657eab24493b2adbec405cbd515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:00.048459 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-8f184849-2714-42a1-a430-ccdad042804a tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] 10.222.0.45 "GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98" status: 200 len: 1345 microversion: 2.1 time: 0.085537 May 24 15:21:00.049031 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 79/151] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:20:59 2022] GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98 => generated 1345 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:21:00.347021 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-399f7a40-5777-4a4a-a01f-209a08dca6c4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:00.347699 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-399f7a40-5777-4a4a-a01f-209a08dca6c4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: baacc852-cde4-4e1a-ade9-183a97312b6f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:00.354248 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-399f7a40-5777-4a4a-a01f-209a08dca6c4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:00.355008 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-399f7a40-5777-4a4a-a01f-209a08dca6c4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:00.357120 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-399f7a40-5777-4a4a-a01f-209a08dca6c4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:00.357602 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-399f7a40-5777-4a4a-a01f-209a08dca6c4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:00.500686 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-399f7a40-5777-4a4a-a01f-209a08dca6c4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:00.511563 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-399f7a40-5777-4a4a-a01f-209a08dca6c4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f" status: 200 len: 1522 microversion: 2.1 time: 0.167918 May 24 15:21:00.512407 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 73/152] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:21:00 2022] GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:21:01.066876 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-a0f41f37-1661-4c95-9227-a760e5d5f9f1 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:01.068012 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-a0f41f37-1661-4c95-9227-a760e5d5f9f1 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] [instance: 445c11ea-3365-4eb1-a467-bde08bb9ad98] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:01.079529 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a0f41f37-1661-4c95-9227-a760e5d5f9f1 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:01.080175 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a0f41f37-1661-4c95-9227-a760e5d5f9f1 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:01.081704 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a0f41f37-1661-4c95-9227-a760e5d5f9f1 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:01.082822 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a0f41f37-1661-4c95-9227-a760e5d5f9f1 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:01.102228 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.wsgi [None req-a0f41f37-1661-4c95-9227-a760e5d5f9f1 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] HTTP exception thrown: Instance 445c11ea-3365-4eb1-a467-bde08bb9ad98 could not be found. May 24 15:21:01.119391 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-a0f41f37-1661-4c95-9227-a760e5d5f9f1 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Request method failure captured: May 24 15:21:01.119391 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: request: GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98 HTTP/1.1 May 24 15:21:01.119391 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Accept: application/json May 24 15:21:01.119391 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Accept-Encoding: identity May 24 15:21:01.119391 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Connection: close May 24 15:21:01.119391 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Content-Length: 0 May 24 15:21:01.119391 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Content-Type: application/json May 24 15:21:01.119391 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Host: 10.222.0.45 May 24 15:21:01.119391 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Openstack-System-Scope: None May 24 15:21:01.119391 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: User-Agent: python-urllib3/1.26.9 May 24 15:21:01.119391 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Auth-Token: gAAAAABijPeb-8Sk1qPZNQ2-pJvHSlazVPobSG1JFXe5_Vw7fT9HAVg1P8GLGo1VLLW4ExDDgqffuQLgdmB0JUJJR-THrEyg8coZ7np-fQ4mwXLTfldPYcDHboBnc3OqtSyTPdQ--tNcBae-s8Xye4JYLuehHRLyXx2ZYRPtH8V2CkZBznf3QRs May 24 15:21:01.119391 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Domain-Id: None May 24 15:21:01.119391 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Domain-Name: None May 24 15:21:01.119391 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Identity-Status: Confirmed May 24 15:21:01.119391 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Is-Admin-Project: True May 24 15:21:01.119391 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Domain-Id: default May 24 15:21:01.119391 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Domain-Name: Default May 24 15:21:01.119391 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Id: b175a657eab24493b2adbec405cbd515 May 24 15:21:01.119391 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Name: tempest-DeleteServersTestJSON-311486216 May 24 15:21:01.119391 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Role: reader,member May 24 15:21:01.119391 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Roles: reader,member May 24 15:21:01.121828 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b175a657eab24493b2adbec405cbd515"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b175a657eab24493b2adbec405cbd515"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/b175a657eab24493b2adbec405cbd515"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_b175a657eab24493b2adbec405cbd515"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 24 15:21:01.121828 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Tenant: tempest-DeleteServersTestJSON-311486216 May 24 15:21:01.121828 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Tenant-Id: b175a657eab24493b2adbec405cbd515 May 24 15:21:01.121828 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Tenant-Name: tempest-DeleteServersTestJSON-311486216 May 24 15:21:01.121828 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User: tempest-DeleteServersTestJSON-311486216-project May 24 15:21:01.121828 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Domain-Id: default May 24 15:21:01.121828 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Domain-Name: Default May 24 15:21:01.121828 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Id: 0dc17670edbb4cc797103b0d41835bf9 May 24 15:21:01.121828 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Name: tempest-DeleteServersTestJSON-311486216-project May 24 15:21:01.121828 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: method: > May 24 15:21:01.121828 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: exception: Instance 445c11ea-3365-4eb1-a467-bde08bb9ad98 could not be found. May 24 15:21:01.121828 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: action_args: {'id': '445c11ea-3365-4eb1-a467-bde08bb9ad98'} May 24 15:21:01.122922 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:21:01.122922 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:21:01.122922 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:21:01.122922 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:21:01.122922 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:21:01.122922 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:21:01.122922 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:21:01.122922 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:21:01.122922 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:21:01.122922 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:21:01.122922 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 445c11ea-3365-4eb1-a467-bde08bb9ad98 could not be found. May 24 15:21:01.122922 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:21:01.122922 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:21:01.122922 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:21:01.122922 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:21:01.122922 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:21:01.122922 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:21:01.122922 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:21:01.122922 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:21:01.122922 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:21:01.124460 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:21:01.124460 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 15:21:01.124460 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 15:21:01.124460 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:21:01.124460 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:21:01.124460 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:21:01.124460 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:21:01.124460 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 445c11ea-3365-4eb1-a467-bde08bb9ad98 could not be found. May 24 15:21:01.124460 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:21:01.124460 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:21:01.124460 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:21:01.124460 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:21:01.124460 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:21:01.124460 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:21:01.124460 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:21:01.124460 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:21:01.124460 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 445c11ea-3365-4eb1-a467-bde08bb9ad98 could not be found. May 24 15:21:01.124460 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:21:01.125675 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-a0f41f37-1661-4c95-9227-a760e5d5f9f1 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Returning 404 to user: Instance 445c11ea-3365-4eb1-a467-bde08bb9ad98 could not be found. {{(pid=117698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:21:01.125675 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-a0f41f37-1661-4c95-9227-a760e5d5f9f1 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] 10.222.0.45 "GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98" status: 404 len: 111 microversion: 2.1 time: 0.061484 May 24 15:21:01.125675 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 80/153] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:21:01 2022] GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:21:01.264693 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d018deed-3414-42c8-b3cd-b647a4ebacad tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:01.265935 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d018deed-3414-42c8-b3cd-b647a4ebacad tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] [instance: 445c11ea-3365-4eb1-a467-bde08bb9ad98] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:01.273125 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d018deed-3414-42c8-b3cd-b647a4ebacad tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:01.273962 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d018deed-3414-42c8-b3cd-b647a4ebacad tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:01.275100 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d018deed-3414-42c8-b3cd-b647a4ebacad tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:01.275596 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d018deed-3414-42c8-b3cd-b647a4ebacad tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:01.296971 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.wsgi [None req-d018deed-3414-42c8-b3cd-b647a4ebacad tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] HTTP exception thrown: Instance 445c11ea-3365-4eb1-a467-bde08bb9ad98 could not be found. May 24 15:21:01.303081 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d018deed-3414-42c8-b3cd-b647a4ebacad tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Request method failure captured: May 24 15:21:01.303081 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: request: GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98/os-volume_attachments HTTP/1.1 May 24 15:21:01.303081 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Accept: application/json May 24 15:21:01.303081 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Accept-Encoding: identity May 24 15:21:01.303081 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Connection: close May 24 15:21:01.303081 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Content-Length: 0 May 24 15:21:01.303081 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Content-Type: application/json May 24 15:21:01.303081 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Host: 10.222.0.45 May 24 15:21:01.303081 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Openstack-System-Scope: None May 24 15:21:01.303081 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: User-Agent: python-urllib3/1.26.9 May 24 15:21:01.303081 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Auth-Token: gAAAAABijPeb-8Sk1qPZNQ2-pJvHSlazVPobSG1JFXe5_Vw7fT9HAVg1P8GLGo1VLLW4ExDDgqffuQLgdmB0JUJJR-THrEyg8coZ7np-fQ4mwXLTfldPYcDHboBnc3OqtSyTPdQ--tNcBae-s8Xye4JYLuehHRLyXx2ZYRPtH8V2CkZBznf3QRs May 24 15:21:01.303081 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Domain-Id: None May 24 15:21:01.303081 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Domain-Name: None May 24 15:21:01.303081 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Identity-Status: Confirmed May 24 15:21:01.303081 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Is-Admin-Project: True May 24 15:21:01.303081 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Domain-Id: default May 24 15:21:01.303081 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Domain-Name: Default May 24 15:21:01.303081 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Id: b175a657eab24493b2adbec405cbd515 May 24 15:21:01.303081 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Name: tempest-DeleteServersTestJSON-311486216 May 24 15:21:01.303081 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Role: reader,member May 24 15:21:01.303081 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Roles: reader,member May 24 15:21:01.305055 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b175a657eab24493b2adbec405cbd515"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b175a657eab24493b2adbec405cbd515"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/b175a657eab24493b2adbec405cbd515"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_b175a657eab24493b2adbec405cbd515"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 24 15:21:01.305055 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant: tempest-DeleteServersTestJSON-311486216 May 24 15:21:01.305055 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant-Id: b175a657eab24493b2adbec405cbd515 May 24 15:21:01.305055 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant-Name: tempest-DeleteServersTestJSON-311486216 May 24 15:21:01.305055 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User: tempest-DeleteServersTestJSON-311486216-project May 24 15:21:01.305055 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Domain-Id: default May 24 15:21:01.305055 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Domain-Name: Default May 24 15:21:01.305055 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Id: 0dc17670edbb4cc797103b0d41835bf9 May 24 15:21:01.305055 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Name: tempest-DeleteServersTestJSON-311486216-project May 24 15:21:01.305055 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: method: > May 24 15:21:01.305055 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: exception: Instance 445c11ea-3365-4eb1-a467-bde08bb9ad98 could not be found. May 24 15:21:01.305055 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: action_args: {'server_id': '445c11ea-3365-4eb1-a467-bde08bb9ad98'} May 24 15:21:01.305841 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:21:01.305841 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:21:01.305841 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:21:01.305841 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:21:01.305841 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:21:01.305841 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:21:01.305841 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:21:01.305841 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:21:01.305841 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:21:01.305841 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:21:01.305841 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 445c11ea-3365-4eb1-a467-bde08bb9ad98 could not be found. May 24 15:21:01.305841 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:21:01.305841 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:21:01.305841 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:21:01.305841 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:21:01.305841 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:21:01.305841 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:21:01.305841 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:21:01.305841 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:21:01.305841 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:21:01.307095 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:21:01.307095 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 24 15:21:01.307095 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 24 15:21:01.307095 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 24 15:21:01.307095 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 24 15:21:01.307095 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 24 15:21:01.307095 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 24 15:21:01.307095 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:21:01.307095 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:21:01.307095 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 445c11ea-3365-4eb1-a467-bde08bb9ad98 could not be found. May 24 15:21:01.307095 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:21:01.307095 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:21:01.307095 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:21:01.307095 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:21:01.307095 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:21:01.307095 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:21:01.307095 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:21:01.307095 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:21:01.307095 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 445c11ea-3365-4eb1-a467-bde08bb9ad98 could not be found. May 24 15:21:01.307095 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:21:01.309219 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d018deed-3414-42c8-b3cd-b647a4ebacad tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Returning 404 to user: Instance 445c11ea-3365-4eb1-a467-bde08bb9ad98 could not be found. {{(pid=117699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:21:01.310097 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d018deed-3414-42c8-b3cd-b647a4ebacad tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] 10.222.0.45 "GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.050398 May 24 15:21:01.310952 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 74/154] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:21:01 2022] GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98/os-volume_attachments => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:21:01.528484 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-ace9ce7a-f685-4655-8e0a-1f4890452f1c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:01.529456 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-ace9ce7a-f685-4655-8e0a-1f4890452f1c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: baacc852-cde4-4e1a-ade9-183a97312b6f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:01.535933 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ace9ce7a-f685-4655-8e0a-1f4890452f1c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:01.536520 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ace9ce7a-f685-4655-8e0a-1f4890452f1c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:01.537510 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ace9ce7a-f685-4655-8e0a-1f4890452f1c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:01.538029 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ace9ce7a-f685-4655-8e0a-1f4890452f1c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:01.804408 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ace9ce7a-f685-4655-8e0a-1f4890452f1c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:01.817405 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-ace9ce7a-f685-4655-8e0a-1f4890452f1c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f" status: 200 len: 1522 microversion: 2.1 time: 0.292619 May 24 15:21:01.818281 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 81/155] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:21:01 2022] GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f => generated 1522 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:21:02.534434 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-00e9ffd9-811c-4f3e-904a-7da540c21eb2 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:02.536939 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-00e9ffd9-811c-4f3e-904a-7da540c21eb2 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] [instance: 445c11ea-3365-4eb1-a467-bde08bb9ad98] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:02.552040 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-00e9ffd9-811c-4f3e-904a-7da540c21eb2 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:02.552537 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-00e9ffd9-811c-4f3e-904a-7da540c21eb2 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:02.553324 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-00e9ffd9-811c-4f3e-904a-7da540c21eb2 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:02.553758 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-00e9ffd9-811c-4f3e-904a-7da540c21eb2 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:02.580402 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.wsgi [None req-00e9ffd9-811c-4f3e-904a-7da540c21eb2 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] HTTP exception thrown: Instance 445c11ea-3365-4eb1-a467-bde08bb9ad98 could not be found. May 24 15:21:02.584099 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-00e9ffd9-811c-4f3e-904a-7da540c21eb2 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Request method failure captured: May 24 15:21:02.584099 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: request: DELETE /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98 HTTP/1.1 May 24 15:21:02.584099 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Accept: application/json May 24 15:21:02.584099 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Accept-Encoding: identity May 24 15:21:02.584099 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Connection: close May 24 15:21:02.584099 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Content-Length: 0 May 24 15:21:02.584099 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Content-Type: application/json May 24 15:21:02.584099 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Host: 10.222.0.45 May 24 15:21:02.584099 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Openstack-System-Scope: None May 24 15:21:02.584099 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: User-Agent: python-urllib3/1.26.9 May 24 15:21:02.584099 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Auth-Token: gAAAAABijPeb-8Sk1qPZNQ2-pJvHSlazVPobSG1JFXe5_Vw7fT9HAVg1P8GLGo1VLLW4ExDDgqffuQLgdmB0JUJJR-THrEyg8coZ7np-fQ4mwXLTfldPYcDHboBnc3OqtSyTPdQ--tNcBae-s8Xye4JYLuehHRLyXx2ZYRPtH8V2CkZBznf3QRs May 24 15:21:02.584099 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Domain-Id: None May 24 15:21:02.584099 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Domain-Name: None May 24 15:21:02.584099 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Identity-Status: Confirmed May 24 15:21:02.584099 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Is-Admin-Project: True May 24 15:21:02.584099 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Domain-Id: default May 24 15:21:02.584099 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Domain-Name: Default May 24 15:21:02.584099 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Id: b175a657eab24493b2adbec405cbd515 May 24 15:21:02.584099 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Name: tempest-DeleteServersTestJSON-311486216 May 24 15:21:02.584099 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Role: reader,member May 24 15:21:02.584099 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Roles: reader,member May 24 15:21:02.585342 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b175a657eab24493b2adbec405cbd515"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b175a657eab24493b2adbec405cbd515"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/b175a657eab24493b2adbec405cbd515"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_b175a657eab24493b2adbec405cbd515"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 24 15:21:02.585342 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant: tempest-DeleteServersTestJSON-311486216 May 24 15:21:02.585342 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant-Id: b175a657eab24493b2adbec405cbd515 May 24 15:21:02.585342 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant-Name: tempest-DeleteServersTestJSON-311486216 May 24 15:21:02.585342 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User: tempest-DeleteServersTestJSON-311486216-project May 24 15:21:02.585342 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Domain-Id: default May 24 15:21:02.585342 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Domain-Name: Default May 24 15:21:02.585342 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Id: 0dc17670edbb4cc797103b0d41835bf9 May 24 15:21:02.585342 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Name: tempest-DeleteServersTestJSON-311486216-project May 24 15:21:02.585342 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: method: > May 24 15:21:02.585342 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: exception: Instance 445c11ea-3365-4eb1-a467-bde08bb9ad98 could not be found. May 24 15:21:02.585342 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: action_args: {'id': '445c11ea-3365-4eb1-a467-bde08bb9ad98'} May 24 15:21:02.586149 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:21:02.586149 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:21:02.586149 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:21:02.586149 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:21:02.586149 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:21:02.586149 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:21:02.586149 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:21:02.586149 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:21:02.586149 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:21:02.586149 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:21:02.586149 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 445c11ea-3365-4eb1-a467-bde08bb9ad98 could not be found. May 24 15:21:02.586149 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:21:02.586149 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:21:02.586149 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:21:02.586149 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:21:02.586149 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:21:02.586149 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:21:02.586149 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:21:02.586149 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:21:02.586149 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:21:02.587181 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:21:02.587181 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 24 15:21:02.587181 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 24 15:21:02.587181 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 24 15:21:02.587181 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 24 15:21:02.587181 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:21:02.587181 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:21:02.587181 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:21:02.587181 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:21:02.587181 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 445c11ea-3365-4eb1-a467-bde08bb9ad98 could not be found. May 24 15:21:02.587181 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:21:02.587181 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:21:02.587181 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:21:02.587181 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:21:02.587181 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:21:02.587181 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:21:02.587181 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:21:02.587181 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:21:02.587181 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 445c11ea-3365-4eb1-a467-bde08bb9ad98 could not be found. May 24 15:21:02.587181 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:21:02.591138 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-00e9ffd9-811c-4f3e-904a-7da540c21eb2 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Returning 404 to user: Instance 445c11ea-3365-4eb1-a467-bde08bb9ad98 could not be found. {{(pid=117699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:21:02.592600 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-00e9ffd9-811c-4f3e-904a-7da540c21eb2 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] 10.222.0.45 "DELETE /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98" status: 404 len: 111 microversion: 2.1 time: 0.062437 May 24 15:21:02.593582 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 75/156] 10.222.0.45 () {58 vars in 1238 bytes} [Tue May 24 15:21:02 2022] DELETE /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:21:02.602979 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-2954f941-bbd6-49df-839f-fb10eab118e1 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:02.603716 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-2954f941-bbd6-49df-839f-fb10eab118e1 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] [instance: 445c11ea-3365-4eb1-a467-bde08bb9ad98] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:02.612656 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2954f941-bbd6-49df-839f-fb10eab118e1 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:02.613230 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2954f941-bbd6-49df-839f-fb10eab118e1 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:02.614210 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2954f941-bbd6-49df-839f-fb10eab118e1 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:02.615587 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2954f941-bbd6-49df-839f-fb10eab118e1 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:02.633829 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.wsgi [None req-2954f941-bbd6-49df-839f-fb10eab118e1 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] HTTP exception thrown: Instance 445c11ea-3365-4eb1-a467-bde08bb9ad98 could not be found. May 24 15:21:02.636790 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-2954f941-bbd6-49df-839f-fb10eab118e1 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Request method failure captured: May 24 15:21:02.636790 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: request: GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98 HTTP/1.1 May 24 15:21:02.636790 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Accept: application/json May 24 15:21:02.636790 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Accept-Encoding: identity May 24 15:21:02.636790 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Connection: close May 24 15:21:02.636790 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Content-Length: 0 May 24 15:21:02.636790 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Content-Type: application/json May 24 15:21:02.636790 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Host: 10.222.0.45 May 24 15:21:02.636790 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Openstack-System-Scope: None May 24 15:21:02.636790 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: User-Agent: python-urllib3/1.26.9 May 24 15:21:02.636790 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Auth-Token: gAAAAABijPeb-8Sk1qPZNQ2-pJvHSlazVPobSG1JFXe5_Vw7fT9HAVg1P8GLGo1VLLW4ExDDgqffuQLgdmB0JUJJR-THrEyg8coZ7np-fQ4mwXLTfldPYcDHboBnc3OqtSyTPdQ--tNcBae-s8Xye4JYLuehHRLyXx2ZYRPtH8V2CkZBznf3QRs May 24 15:21:02.636790 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Domain-Id: None May 24 15:21:02.636790 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Domain-Name: None May 24 15:21:02.636790 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Identity-Status: Confirmed May 24 15:21:02.636790 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Is-Admin-Project: True May 24 15:21:02.636790 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Domain-Id: default May 24 15:21:02.636790 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Domain-Name: Default May 24 15:21:02.636790 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Id: b175a657eab24493b2adbec405cbd515 May 24 15:21:02.636790 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Name: tempest-DeleteServersTestJSON-311486216 May 24 15:21:02.636790 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Role: reader,member May 24 15:21:02.636790 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Roles: reader,member May 24 15:21:02.637957 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b175a657eab24493b2adbec405cbd515"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b175a657eab24493b2adbec405cbd515"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/b175a657eab24493b2adbec405cbd515"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_b175a657eab24493b2adbec405cbd515"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 24 15:21:02.637957 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Tenant: tempest-DeleteServersTestJSON-311486216 May 24 15:21:02.637957 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Tenant-Id: b175a657eab24493b2adbec405cbd515 May 24 15:21:02.637957 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Tenant-Name: tempest-DeleteServersTestJSON-311486216 May 24 15:21:02.637957 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User: tempest-DeleteServersTestJSON-311486216-project May 24 15:21:02.637957 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Domain-Id: default May 24 15:21:02.637957 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Domain-Name: Default May 24 15:21:02.637957 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Id: 0dc17670edbb4cc797103b0d41835bf9 May 24 15:21:02.637957 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Name: tempest-DeleteServersTestJSON-311486216-project May 24 15:21:02.637957 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: method: > May 24 15:21:02.637957 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: exception: Instance 445c11ea-3365-4eb1-a467-bde08bb9ad98 could not be found. May 24 15:21:02.637957 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: action_args: {'id': '445c11ea-3365-4eb1-a467-bde08bb9ad98'} May 24 15:21:02.638692 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:21:02.638692 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:21:02.638692 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:21:02.638692 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:21:02.638692 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:21:02.638692 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:21:02.638692 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:21:02.638692 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:21:02.638692 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:21:02.638692 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:21:02.638692 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 445c11ea-3365-4eb1-a467-bde08bb9ad98 could not be found. May 24 15:21:02.638692 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:21:02.638692 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:21:02.638692 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:21:02.638692 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:21:02.638692 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:21:02.638692 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:21:02.638692 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:21:02.638692 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:21:02.638692 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:21:02.639729 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:21:02.639729 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 15:21:02.639729 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 15:21:02.639729 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:21:02.639729 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:21:02.639729 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:21:02.639729 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:21:02.639729 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 445c11ea-3365-4eb1-a467-bde08bb9ad98 could not be found. May 24 15:21:02.639729 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:21:02.639729 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:21:02.639729 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:21:02.639729 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:21:02.639729 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:21:02.639729 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:21:02.639729 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:21:02.639729 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:21:02.639729 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 445c11ea-3365-4eb1-a467-bde08bb9ad98 could not be found. May 24 15:21:02.639729 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:21:02.642057 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-2954f941-bbd6-49df-839f-fb10eab118e1 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] Returning 404 to user: Instance 445c11ea-3365-4eb1-a467-bde08bb9ad98 could not be found. {{(pid=117698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:21:02.643558 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-2954f941-bbd6-49df-839f-fb10eab118e1 tempest-DeleteServersTestJSON-311486216 tempest-DeleteServersTestJSON-311486216-project] 10.222.0.45 "GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98" status: 404 len: 111 microversion: 2.1 time: 0.045613 May 24 15:21:02.644120 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 82/157] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:21:02 2022] GET /compute/v2.1/servers/445c11ea-3365-4eb1-a467-bde08bb9ad98 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 24 15:21:02.834459 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-439166c2-c5ad-4b55-8401-a749d7437da3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:02.835314 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-439166c2-c5ad-4b55-8401-a749d7437da3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: baacc852-cde4-4e1a-ade9-183a97312b6f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:02.843387 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-439166c2-c5ad-4b55-8401-a749d7437da3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:02.844172 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-439166c2-c5ad-4b55-8401-a749d7437da3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:02.845208 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-439166c2-c5ad-4b55-8401-a749d7437da3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:02.845854 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-439166c2-c5ad-4b55-8401-a749d7437da3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:03.023805 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-439166c2-c5ad-4b55-8401-a749d7437da3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:03.041944 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-439166c2-c5ad-4b55-8401-a749d7437da3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f" status: 200 len: 1522 microversion: 2.1 time: 0.211232 May 24 15:21:03.043289 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 76/158] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:21:02 2022] GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:21:04.060965 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-61e768f7-8d53-4ebd-b660-141ff43cdebe tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:04.061703 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-61e768f7-8d53-4ebd-b660-141ff43cdebe tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: baacc852-cde4-4e1a-ade9-183a97312b6f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:04.071437 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-61e768f7-8d53-4ebd-b660-141ff43cdebe tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:04.080908 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-61e768f7-8d53-4ebd-b660-141ff43cdebe tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:04.080908 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-61e768f7-8d53-4ebd-b660-141ff43cdebe tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:04.080908 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-61e768f7-8d53-4ebd-b660-141ff43cdebe tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:04.376143 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-61e768f7-8d53-4ebd-b660-141ff43cdebe tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:04.385227 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-61e768f7-8d53-4ebd-b660-141ff43cdebe tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f" status: 200 len: 1522 microversion: 2.1 time: 0.330149 May 24 15:21:04.386305 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 83/159] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:21:04 2022] GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f => generated 1522 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:21:05.405932 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-3858aa0f-adc0-430a-9869-5fa7902fb5c8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:05.406819 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-3858aa0f-adc0-430a-9869-5fa7902fb5c8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: baacc852-cde4-4e1a-ade9-183a97312b6f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:05.414126 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3858aa0f-adc0-430a-9869-5fa7902fb5c8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:05.414706 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3858aa0f-adc0-430a-9869-5fa7902fb5c8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:05.417968 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3858aa0f-adc0-430a-9869-5fa7902fb5c8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:05.418618 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3858aa0f-adc0-430a-9869-5fa7902fb5c8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:05.574855 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-3858aa0f-adc0-430a-9869-5fa7902fb5c8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:05.583158 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-3858aa0f-adc0-430a-9869-5fa7902fb5c8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f" status: 200 len: 1522 microversion: 2.1 time: 0.184061 May 24 15:21:05.584247 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 77/160] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:21:05 2022] GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:21:06.601574 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-6e431125-b4ea-4b94-ad87-fafce62e3cdf tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:06.602875 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-6e431125-b4ea-4b94-ad87-fafce62e3cdf tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: baacc852-cde4-4e1a-ade9-183a97312b6f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:06.613495 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6e431125-b4ea-4b94-ad87-fafce62e3cdf tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:06.614680 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6e431125-b4ea-4b94-ad87-fafce62e3cdf tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:06.615979 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6e431125-b4ea-4b94-ad87-fafce62e3cdf tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:06.616490 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6e431125-b4ea-4b94-ad87-fafce62e3cdf tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:06.773121 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-6e431125-b4ea-4b94-ad87-fafce62e3cdf tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:06.781606 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-6e431125-b4ea-4b94-ad87-fafce62e3cdf tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f" status: 200 len: 1522 microversion: 2.1 time: 0.185152 May 24 15:21:06.782381 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 84/161] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:21:06 2022] GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:21:07.798668 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-6a03b3f0-8ae3-4e5f-8a47-0276a826efc8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:07.800162 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-6a03b3f0-8ae3-4e5f-8a47-0276a826efc8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: baacc852-cde4-4e1a-ade9-183a97312b6f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:07.808328 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6a03b3f0-8ae3-4e5f-8a47-0276a826efc8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:07.808782 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6a03b3f0-8ae3-4e5f-8a47-0276a826efc8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:07.809547 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6a03b3f0-8ae3-4e5f-8a47-0276a826efc8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:07.809975 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6a03b3f0-8ae3-4e5f-8a47-0276a826efc8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:07.983355 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-6a03b3f0-8ae3-4e5f-8a47-0276a826efc8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:07.991852 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-6a03b3f0-8ae3-4e5f-8a47-0276a826efc8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f" status: 200 len: 1522 microversion: 2.1 time: 0.196994 May 24 15:21:07.992981 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 78/162] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:21:07 2022] GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:21:09.010687 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-248cfbea-6ddb-4e16-ba7a-355c5194222b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:09.011449 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-248cfbea-6ddb-4e16-ba7a-355c5194222b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: baacc852-cde4-4e1a-ade9-183a97312b6f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:09.017781 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-248cfbea-6ddb-4e16-ba7a-355c5194222b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:09.018324 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-248cfbea-6ddb-4e16-ba7a-355c5194222b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:09.019153 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-248cfbea-6ddb-4e16-ba7a-355c5194222b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:09.019651 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-248cfbea-6ddb-4e16-ba7a-355c5194222b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:09.235587 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-248cfbea-6ddb-4e16-ba7a-355c5194222b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:09.245597 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-248cfbea-6ddb-4e16-ba7a-355c5194222b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f" status: 200 len: 1522 microversion: 2.1 time: 0.238895 May 24 15:21:09.246508 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 85/163] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:21:09 2022] GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:21:10.263632 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-5d45078b-e48c-4a8a-94b6-ec5d6d27aaa2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:10.264078 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-5d45078b-e48c-4a8a-94b6-ec5d6d27aaa2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: baacc852-cde4-4e1a-ade9-183a97312b6f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:10.270933 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5d45078b-e48c-4a8a-94b6-ec5d6d27aaa2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:10.271277 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5d45078b-e48c-4a8a-94b6-ec5d6d27aaa2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:10.272122 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5d45078b-e48c-4a8a-94b6-ec5d6d27aaa2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:10.272702 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5d45078b-e48c-4a8a-94b6-ec5d6d27aaa2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:10.403685 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-5d45078b-e48c-4a8a-94b6-ec5d6d27aaa2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:10.412553 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-5d45078b-e48c-4a8a-94b6-ec5d6d27aaa2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f" status: 200 len: 1522 microversion: 2.1 time: 0.153564 May 24 15:21:10.413120 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 79/164] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:21:10 2022] GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:21:11.429048 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-5e1ef34b-e334-45d3-8597-67e87d309429 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:11.429651 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-5e1ef34b-e334-45d3-8597-67e87d309429 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: baacc852-cde4-4e1a-ade9-183a97312b6f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:11.436553 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5e1ef34b-e334-45d3-8597-67e87d309429 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:11.437118 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5e1ef34b-e334-45d3-8597-67e87d309429 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:11.438062 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5e1ef34b-e334-45d3-8597-67e87d309429 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:11.438655 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5e1ef34b-e334-45d3-8597-67e87d309429 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:11.580992 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-5e1ef34b-e334-45d3-8597-67e87d309429 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:11.583067 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:21:11.590107 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-5e1ef34b-e334-45d3-8597-67e87d309429 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f" status: 200 len: 1522 microversion: 2.1 time: 0.164848 May 24 15:21:11.590678 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 86/165] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:21:11 2022] GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:21:12.606602 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e08d7e3c-5bbd-43b6-9dcd-70e6d0be269f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:12.607218 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-e08d7e3c-5bbd-43b6-9dcd-70e6d0be269f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: baacc852-cde4-4e1a-ade9-183a97312b6f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:12.614009 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e08d7e3c-5bbd-43b6-9dcd-70e6d0be269f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:12.614469 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e08d7e3c-5bbd-43b6-9dcd-70e6d0be269f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:12.615208 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e08d7e3c-5bbd-43b6-9dcd-70e6d0be269f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:12.615642 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e08d7e3c-5bbd-43b6-9dcd-70e6d0be269f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:12.739008 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-e08d7e3c-5bbd-43b6-9dcd-70e6d0be269f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:12.747069 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-e08d7e3c-5bbd-43b6-9dcd-70e6d0be269f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f" status: 200 len: 1522 microversion: 2.1 time: 0.144339 May 24 15:21:12.747732 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 80/166] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:21:12 2022] GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:21:13.764101 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-21f8a3b8-561f-4f7c-9894-f92171bc6f1b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:13.764816 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-21f8a3b8-561f-4f7c-9894-f92171bc6f1b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: baacc852-cde4-4e1a-ade9-183a97312b6f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:13.771019 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-21f8a3b8-561f-4f7c-9894-f92171bc6f1b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:13.771462 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-21f8a3b8-561f-4f7c-9894-f92171bc6f1b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:13.772218 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-21f8a3b8-561f-4f7c-9894-f92171bc6f1b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:13.772674 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-21f8a3b8-561f-4f7c-9894-f92171bc6f1b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:13.902796 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-21f8a3b8-561f-4f7c-9894-f92171bc6f1b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:13.910276 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-21f8a3b8-561f-4f7c-9894-f92171bc6f1b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f" status: 200 len: 1522 microversion: 2.1 time: 0.150520 May 24 15:21:13.910889 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 87/167] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:21:13 2022] GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:21:14.927089 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-cb8ea2d6-b2df-43bb-9b88-a7003f362bd1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:14.927599 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-cb8ea2d6-b2df-43bb-9b88-a7003f362bd1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: baacc852-cde4-4e1a-ade9-183a97312b6f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:14.934150 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cb8ea2d6-b2df-43bb-9b88-a7003f362bd1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:14.934592 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cb8ea2d6-b2df-43bb-9b88-a7003f362bd1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:14.935347 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cb8ea2d6-b2df-43bb-9b88-a7003f362bd1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:14.935780 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cb8ea2d6-b2df-43bb-9b88-a7003f362bd1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:15.079088 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-cb8ea2d6-b2df-43bb-9b88-a7003f362bd1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:15.086790 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-cb8ea2d6-b2df-43bb-9b88-a7003f362bd1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f" status: 200 len: 1522 microversion: 2.1 time: 0.163695 May 24 15:21:15.087373 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 81/168] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:21:14 2022] GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:21:16.104070 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-f2bee4fd-26e4-47c7-89d5-c58674b44e06 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:16.104743 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-f2bee4fd-26e4-47c7-89d5-c58674b44e06 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: baacc852-cde4-4e1a-ade9-183a97312b6f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:16.111292 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f2bee4fd-26e4-47c7-89d5-c58674b44e06 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:16.111859 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f2bee4fd-26e4-47c7-89d5-c58674b44e06 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:16.112874 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f2bee4fd-26e4-47c7-89d5-c58674b44e06 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:16.113397 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f2bee4fd-26e4-47c7-89d5-c58674b44e06 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:16.251867 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-f2bee4fd-26e4-47c7-89d5-c58674b44e06 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:16.259667 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-f2bee4fd-26e4-47c7-89d5-c58674b44e06 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f" status: 200 len: 1522 microversion: 2.1 time: 0.159532 May 24 15:21:16.260378 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 88/169] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:21:16 2022] GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:21:17.276445 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-c9e80a73-68de-4769-81b4-0b80fe115e9a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:17.277055 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-c9e80a73-68de-4769-81b4-0b80fe115e9a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: baacc852-cde4-4e1a-ade9-183a97312b6f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:17.283593 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c9e80a73-68de-4769-81b4-0b80fe115e9a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:17.284042 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c9e80a73-68de-4769-81b4-0b80fe115e9a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:17.284847 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c9e80a73-68de-4769-81b4-0b80fe115e9a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:17.285284 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c9e80a73-68de-4769-81b4-0b80fe115e9a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:17.410821 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-c9e80a73-68de-4769-81b4-0b80fe115e9a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:17.418780 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-c9e80a73-68de-4769-81b4-0b80fe115e9a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f" status: 200 len: 1522 microversion: 2.1 time: 0.146177 May 24 15:21:17.419344 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 82/170] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:21:17 2022] GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:21:18.435923 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-189daf19-e4dc-43d2-a612-aee573f502bd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:18.435923 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-189daf19-e4dc-43d2-a612-aee573f502bd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: baacc852-cde4-4e1a-ade9-183a97312b6f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:18.441644 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-189daf19-e4dc-43d2-a612-aee573f502bd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:18.442093 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-189daf19-e4dc-43d2-a612-aee573f502bd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:18.442893 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-189daf19-e4dc-43d2-a612-aee573f502bd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:18.443324 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-189daf19-e4dc-43d2-a612-aee573f502bd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:18.576180 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-189daf19-e4dc-43d2-a612-aee573f502bd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:18.583582 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-189daf19-e4dc-43d2-a612-aee573f502bd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f" status: 200 len: 1522 microversion: 2.1 time: 0.152584 May 24 15:21:18.584145 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 89/171] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:21:18 2022] GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:21:19.601094 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-ee17d11c-4f4f-46c6-a3e4-bf1e0638a2a3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:19.601719 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-ee17d11c-4f4f-46c6-a3e4-bf1e0638a2a3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: baacc852-cde4-4e1a-ade9-183a97312b6f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:19.609205 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ee17d11c-4f4f-46c6-a3e4-bf1e0638a2a3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:19.609864 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ee17d11c-4f4f-46c6-a3e4-bf1e0638a2a3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:19.610715 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ee17d11c-4f4f-46c6-a3e4-bf1e0638a2a3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:19.611152 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ee17d11c-4f4f-46c6-a3e4-bf1e0638a2a3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:19.772715 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-ee17d11c-4f4f-46c6-a3e4-bf1e0638a2a3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:19.778048 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:21:19.783411 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-ee17d11c-4f4f-46c6-a3e4-bf1e0638a2a3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f" status: 200 len: 1522 microversion: 2.1 time: 0.186775 May 24 15:21:19.784954 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 83/172] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:21:19 2022] GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:21:20.802535 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-6834e83e-0fcd-4793-bec0-8f3c6f99173a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:20.803183 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-6834e83e-0fcd-4793-bec0-8f3c6f99173a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: baacc852-cde4-4e1a-ade9-183a97312b6f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:20.809315 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6834e83e-0fcd-4793-bec0-8f3c6f99173a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:20.809741 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6834e83e-0fcd-4793-bec0-8f3c6f99173a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:20.810693 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6834e83e-0fcd-4793-bec0-8f3c6f99173a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:20.811113 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6834e83e-0fcd-4793-bec0-8f3c6f99173a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:21.041315 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-6834e83e-0fcd-4793-bec0-8f3c6f99173a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:21.053581 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-6834e83e-0fcd-4793-bec0-8f3c6f99173a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f" status: 200 len: 1522 microversion: 2.1 time: 0.255483 May 24 15:21:21.054265 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 90/173] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:21:20 2022] GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:21:22.083509 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-2b5e733e-bb3f-44b7-a3a9-5f4922dd15ee tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:22.085943 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-2b5e733e-bb3f-44b7-a3a9-5f4922dd15ee tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: baacc852-cde4-4e1a-ade9-183a97312b6f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:22.102393 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2b5e733e-bb3f-44b7-a3a9-5f4922dd15ee tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:22.103119 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2b5e733e-bb3f-44b7-a3a9-5f4922dd15ee tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:22.104599 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2b5e733e-bb3f-44b7-a3a9-5f4922dd15ee tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:22.104911 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2b5e733e-bb3f-44b7-a3a9-5f4922dd15ee tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:22.449170 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-2b5e733e-bb3f-44b7-a3a9-5f4922dd15ee tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:22.461917 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-2b5e733e-bb3f-44b7-a3a9-5f4922dd15ee tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f" status: 200 len: 1502 microversion: 2.1 time: 0.394684 May 24 15:21:22.474376 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 84/174] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:21:22 2022] GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f => generated 1502 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:21:22.491757 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-13c4540c-47a7-4746-b035-28234eb91761 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:22.493117 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-13c4540c-47a7-4746-b035-28234eb91761 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: d01bc80d-033e-4940-a604-b4f34ee070a9] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:22.503752 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-13c4540c-47a7-4746-b035-28234eb91761 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:22.504627 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-13c4540c-47a7-4746-b035-28234eb91761 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:22.505843 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-13c4540c-47a7-4746-b035-28234eb91761 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:22.506526 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-13c4540c-47a7-4746-b035-28234eb91761 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:22.762708 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-13c4540c-47a7-4746-b035-28234eb91761 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:22.770766 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-13c4540c-47a7-4746-b035-28234eb91761 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9" status: 200 len: 1514 microversion: 2.1 time: 0.284806 May 24 15:21:22.771955 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 91/175] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:21:22 2022] GET /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9 => generated 1514 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:21:24.518398 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e2c5713f-919f-4f15-a629-38f7ced6f640 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:21:24.521168 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-e2c5713f-919f-4f15-a629-38f7ced6f640 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: d01bc80d-033e-4940-a604-b4f34ee070a9] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:24.533887 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_api:SELECT=38 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:21:24.542201 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e2c5713f-919f-4f15-a629-38f7ced6f640 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:24.542797 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e2c5713f-919f-4f15-a629-38f7ced6f640 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:24.543974 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e2c5713f-919f-4f15-a629-38f7ced6f640 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:24.545946 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e2c5713f-919f-4f15-a629-38f7ced6f640 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:24.576511 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.objects.instance [None req-e2c5713f-919f-4f15-a629-38f7ced6f640 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lazy-loading 'flavor' on Instance uuid d01bc80d-033e-4940-a604-b4f34ee070a9 {{(pid=117699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 15:21:24.806806 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-e2c5713f-919f-4f15-a629-38f7ced6f640 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "POST /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9/action" status: 200 len: 32 microversion: 2.1 time: 0.301762 May 24 15:21:24.807983 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 85/176] 10.222.0.45 () {60 vars in 1277 bytes} [Tue May 24 15:21:24 2022] POST /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9/action => generated 32 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 24 15:21:24.818963 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-4a45d9bb-5646-4ac1-8dc4-f17ce2f2dd6c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:24.820391 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-4a45d9bb-5646-4ac1-8dc4-f17ce2f2dd6c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: d01bc80d-033e-4940-a604-b4f34ee070a9] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:24.836240 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_api:SELECT=36 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:21:24.841617 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4a45d9bb-5646-4ac1-8dc4-f17ce2f2dd6c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:24.842092 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4a45d9bb-5646-4ac1-8dc4-f17ce2f2dd6c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:24.843715 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4a45d9bb-5646-4ac1-8dc4-f17ce2f2dd6c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:24.844121 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4a45d9bb-5646-4ac1-8dc4-f17ce2f2dd6c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:25.093499 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-4a45d9bb-5646-4ac1-8dc4-f17ce2f2dd6c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:25.104400 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-4a45d9bb-5646-4ac1-8dc4-f17ce2f2dd6c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9" status: 200 len: 1520 microversion: 2.1 time: 0.290017 May 24 15:21:25.106120 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 92/177] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:21:24 2022] GET /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9 => generated 1520 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:21:26.123388 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-8cd6bf10-eac9-45cf-924c-4e8975ebd102 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:26.124102 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-8cd6bf10-eac9-45cf-924c-4e8975ebd102 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: d01bc80d-033e-4940-a604-b4f34ee070a9] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:26.134172 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8cd6bf10-eac9-45cf-924c-4e8975ebd102 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:26.135072 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8cd6bf10-eac9-45cf-924c-4e8975ebd102 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:26.136036 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8cd6bf10-eac9-45cf-924c-4e8975ebd102 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:26.136659 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8cd6bf10-eac9-45cf-924c-4e8975ebd102 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:26.401489 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-8cd6bf10-eac9-45cf-924c-4e8975ebd102 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:26.409695 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-8cd6bf10-eac9-45cf-924c-4e8975ebd102 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9" status: 200 len: 1520 microversion: 2.1 time: 0.291294 May 24 15:21:26.410460 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 86/178] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:21:26 2022] GET /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9 => generated 1520 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:21:27.427782 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-9c6f53d7-9901-4c31-9e57-f7ab6b1b8ddc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:27.428504 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-9c6f53d7-9901-4c31-9e57-f7ab6b1b8ddc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: d01bc80d-033e-4940-a604-b4f34ee070a9] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:27.439575 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9c6f53d7-9901-4c31-9e57-f7ab6b1b8ddc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:27.440120 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9c6f53d7-9901-4c31-9e57-f7ab6b1b8ddc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:27.440987 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9c6f53d7-9901-4c31-9e57-f7ab6b1b8ddc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:27.441630 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9c6f53d7-9901-4c31-9e57-f7ab6b1b8ddc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:27.600585 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-9c6f53d7-9901-4c31-9e57-f7ab6b1b8ddc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:27.609217 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-9c6f53d7-9901-4c31-9e57-f7ab6b1b8ddc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9" status: 200 len: 1520 microversion: 2.1 time: 0.186049 May 24 15:21:27.619911 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 93/179] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:21:27 2022] GET /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9 => generated 1520 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:21:28.626981 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-52266a6d-f8a9-4ab2-9ab8-8714d42ffed9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:28.627925 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-52266a6d-f8a9-4ab2-9ab8-8714d42ffed9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: d01bc80d-033e-4940-a604-b4f34ee070a9] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:28.642325 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-52266a6d-f8a9-4ab2-9ab8-8714d42ffed9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:28.642648 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-52266a6d-f8a9-4ab2-9ab8-8714d42ffed9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:28.643433 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-52266a6d-f8a9-4ab2-9ab8-8714d42ffed9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:28.643859 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-52266a6d-f8a9-4ab2-9ab8-8714d42ffed9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:28.850906 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-52266a6d-f8a9-4ab2-9ab8-8714d42ffed9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:28.867265 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-52266a6d-f8a9-4ab2-9ab8-8714d42ffed9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9" status: 200 len: 1520 microversion: 2.1 time: 0.244300 May 24 15:21:28.868485 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 87/180] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:21:28 2022] GET /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9 => generated 1520 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:21:29.888068 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-ab02c607-fd97-4f4e-a493-afb381fbe060 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:29.889492 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-ab02c607-fd97-4f4e-a493-afb381fbe060 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: d01bc80d-033e-4940-a604-b4f34ee070a9] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:29.902778 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ab02c607-fd97-4f4e-a493-afb381fbe060 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:29.903790 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ab02c607-fd97-4f4e-a493-afb381fbe060 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:29.904984 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ab02c607-fd97-4f4e-a493-afb381fbe060 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:29.906241 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ab02c607-fd97-4f4e-a493-afb381fbe060 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:30.114346 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ab02c607-fd97-4f4e-a493-afb381fbe060 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:30.123616 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-ab02c607-fd97-4f4e-a493-afb381fbe060 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9" status: 200 len: 1520 microversion: 2.1 time: 0.241760 May 24 15:21:30.125337 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 94/181] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:21:29 2022] GET /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9 => generated 1520 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:21:31.142018 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-19ab2c43-ab7c-46b3-9700-ba2fa235b10e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:31.142619 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-19ab2c43-ab7c-46b3-9700-ba2fa235b10e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: d01bc80d-033e-4940-a604-b4f34ee070a9] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:31.153451 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-19ab2c43-ab7c-46b3-9700-ba2fa235b10e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:31.153818 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-19ab2c43-ab7c-46b3-9700-ba2fa235b10e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:31.167591 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-19ab2c43-ab7c-46b3-9700-ba2fa235b10e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:31.168101 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-19ab2c43-ab7c-46b3-9700-ba2fa235b10e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:31.512829 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-19ab2c43-ab7c-46b3-9700-ba2fa235b10e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:31.530067 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-19ab2c43-ab7c-46b3-9700-ba2fa235b10e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9" status: 200 len: 1520 microversion: 2.1 time: 0.391929 May 24 15:21:31.531218 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 88/182] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:21:31 2022] GET /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9 => generated 1520 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:21:32.547409 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-ec9f0369-4a56-41ad-99b7-6d62de4ebced tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:32.548198 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-ec9f0369-4a56-41ad-99b7-6d62de4ebced tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: d01bc80d-033e-4940-a604-b4f34ee070a9] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:32.572292 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ec9f0369-4a56-41ad-99b7-6d62de4ebced tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:32.572853 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ec9f0369-4a56-41ad-99b7-6d62de4ebced tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:32.573680 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ec9f0369-4a56-41ad-99b7-6d62de4ebced tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:32.574113 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ec9f0369-4a56-41ad-99b7-6d62de4ebced tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:33.290533 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ec9f0369-4a56-41ad-99b7-6d62de4ebced tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:33.305156 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-ec9f0369-4a56-41ad-99b7-6d62de4ebced tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9" status: 200 len: 1520 microversion: 2.1 time: 0.761459 May 24 15:21:33.305993 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 95/183] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:21:32 2022] GET /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9 => generated 1520 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:21:34.326085 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-bc0b498c-20a4-460a-8893-d98f42968c3e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:34.327460 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-bc0b498c-20a4-460a-8893-d98f42968c3e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: d01bc80d-033e-4940-a604-b4f34ee070a9] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:34.352242 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bc0b498c-20a4-460a-8893-d98f42968c3e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:34.352242 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bc0b498c-20a4-460a-8893-d98f42968c3e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:34.352242 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bc0b498c-20a4-460a-8893-d98f42968c3e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:34.352242 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bc0b498c-20a4-460a-8893-d98f42968c3e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:34.680255 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-bc0b498c-20a4-460a-8893-d98f42968c3e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:34.688977 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-bc0b498c-20a4-460a-8893-d98f42968c3e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9" status: 200 len: 1520 microversion: 2.1 time: 0.370532 May 24 15:21:34.700198 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 89/184] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:21:34 2022] GET /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9 => generated 1520 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:21:35.706878 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-925ea645-fdb0-4862-aded-2fde5eace6d0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:35.707486 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-925ea645-fdb0-4862-aded-2fde5eace6d0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: d01bc80d-033e-4940-a604-b4f34ee070a9] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:35.714118 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-925ea645-fdb0-4862-aded-2fde5eace6d0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:35.714565 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-925ea645-fdb0-4862-aded-2fde5eace6d0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:35.715332 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-925ea645-fdb0-4862-aded-2fde5eace6d0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:35.716198 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-925ea645-fdb0-4862-aded-2fde5eace6d0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:35.850981 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-925ea645-fdb0-4862-aded-2fde5eace6d0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:35.858722 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-925ea645-fdb0-4862-aded-2fde5eace6d0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9" status: 200 len: 1520 microversion: 2.1 time: 0.155784 May 24 15:21:35.859285 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 96/185] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:21:35 2022] GET /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:21:36.070290 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-ba56e199-9b4a-499d-b9df-cff5aa078cdc tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1182858318", "imageRef": "f921f75e-bbd1-4d99-ab1e-5cce2d895148", "flavorRef": "452", "networks": [{"uuid": "723319e7-0003-40d4-b31a-e8bfdc78ea04"}]}} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:21:36.875445 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-1076b580-8635-4deb-9fbc-fcde9b1a4083 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:36.876162 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-1076b580-8635-4deb-9fbc-fcde9b1a4083 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: d01bc80d-033e-4940-a604-b4f34ee070a9] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:36.882674 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1076b580-8635-4deb-9fbc-fcde9b1a4083 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:36.883117 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1076b580-8635-4deb-9fbc-fcde9b1a4083 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:36.884111 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1076b580-8635-4deb-9fbc-fcde9b1a4083 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:36.885295 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1076b580-8635-4deb-9fbc-fcde9b1a4083 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:37.082819 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-1076b580-8635-4deb-9fbc-fcde9b1a4083 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:37.093657 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-1076b580-8635-4deb-9fbc-fcde9b1a4083 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9" status: 200 len: 1520 microversion: 2.1 time: 0.221969 May 24 15:21:37.094651 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 97/186] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:21:36 2022] GET /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9 => generated 1520 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:21:38.120644 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-4f843e6c-21d6-4a2b-8030-2841e9e0ec43 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:38.121251 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-4f843e6c-21d6-4a2b-8030-2841e9e0ec43 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: d01bc80d-033e-4940-a604-b4f34ee070a9] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:38.127358 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4f843e6c-21d6-4a2b-8030-2841e9e0ec43 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:38.127808 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4f843e6c-21d6-4a2b-8030-2841e9e0ec43 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:38.128653 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4f843e6c-21d6-4a2b-8030-2841e9e0ec43 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:38.129089 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4f843e6c-21d6-4a2b-8030-2841e9e0ec43 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:38.267326 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-4f843e6c-21d6-4a2b-8030-2841e9e0ec43 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:38.276328 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-4f843e6c-21d6-4a2b-8030-2841e9e0ec43 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9" status: 200 len: 1520 microversion: 2.1 time: 0.159323 May 24 15:21:38.277325 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 98/187] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:21:38 2022] GET /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:21:38.747909 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c8e32e1c-c23a-410e-af2f-ca8ca9959ca9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:38.748440 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-c8e32e1c-c23a-410e-af2f-ca8ca9959ca9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:38.754472 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c8e32e1c-c23a-410e-af2f-ca8ca9959ca9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:38.754917 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c8e32e1c-c23a-410e-af2f-ca8ca9959ca9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:38.755668 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c8e32e1c-c23a-410e-af2f-ca8ca9959ca9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:38.756099 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c8e32e1c-c23a-410e-af2f-ca8ca9959ca9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:38.779140 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-c8e32e1c-c23a-410e-af2f-ca8ca9959ca9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/ips" status: 200 len: 152 microversion: 2.20 time: 0.035669 May 24 15:21:38.779715 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 99/188] 10.222.0.45 () {60 vars in 1288 bytes} [Tue May 24 15:21:38 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/ips => generated 152 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 15:21:39.294072 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-effa70bc-0635-4f07-8648-af95a0f0a01d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:39.294680 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-effa70bc-0635-4f07-8648-af95a0f0a01d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: d01bc80d-033e-4940-a604-b4f34ee070a9] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:39.300681 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-effa70bc-0635-4f07-8648-af95a0f0a01d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:39.301125 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-effa70bc-0635-4f07-8648-af95a0f0a01d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:39.301878 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-effa70bc-0635-4f07-8648-af95a0f0a01d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:39.302308 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-effa70bc-0635-4f07-8648-af95a0f0a01d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:39.632126 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-effa70bc-0635-4f07-8648-af95a0f0a01d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:39.640173 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-effa70bc-0635-4f07-8648-af95a0f0a01d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9" status: 200 len: 1520 microversion: 2.1 time: 0.349996 May 24 15:21:39.640757 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 100/189] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:21:39 2022] GET /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9 => generated 1520 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:21:40.657484 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-89710b30-41f5-426d-a815-1a4ad0ebf663 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:40.658142 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-89710b30-41f5-426d-a815-1a4ad0ebf663 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: d01bc80d-033e-4940-a604-b4f34ee070a9] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:40.664122 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-89710b30-41f5-426d-a815-1a4ad0ebf663 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:40.664607 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-89710b30-41f5-426d-a815-1a4ad0ebf663 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:40.665354 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-89710b30-41f5-426d-a815-1a4ad0ebf663 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:40.665778 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-89710b30-41f5-426d-a815-1a4ad0ebf663 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:40.790795 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-89710b30-41f5-426d-a815-1a4ad0ebf663 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:40.799053 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-89710b30-41f5-426d-a815-1a4ad0ebf663 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9" status: 200 len: 1520 microversion: 2.1 time: 0.145294 May 24 15:21:40.799767 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 101/190] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:21:40 2022] GET /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9 => generated 1520 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:21:41.389518 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-7fd975c7-6a26-4647-aa19-5663a14d1041 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:21:41.390052 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-7fd975c7-6a26-4647-aa19-5663a14d1041 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:41.396130 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7fd975c7-6a26-4647-aa19-5663a14d1041 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:41.396611 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7fd975c7-6a26-4647-aa19-5663a14d1041 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:41.397368 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7fd975c7-6a26-4647-aa19-5663a14d1041 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:41.397828 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7fd975c7-6a26-4647-aa19-5663a14d1041 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:41.422024 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.objects.instance [None req-7fd975c7-6a26-4647-aa19-5663a14d1041 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lazy-loading 'flavor' on Instance uuid 6c54fc3c-070c-4cab-b181-081d80eeb078 {{(pid=117698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 15:21:41.458040 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:21:44.685756 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:21:46.084371 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_api:SELECT=11 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:21:47.141828 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.network.neutron [None req-ba56e199-9b4a-499d-b9df-cff5aa078cdc tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] validate_networks() for [('723319e7-0003-40d4-b31a-e8bfdc78ea04', None, None, None, None, None)] {{(pid=117699) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 15:21:47.253642 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-7fd975c7-6a26-4647-aa19-5663a14d1041 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "POST /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/action" status: 202 len: 0 microversion: 2.20 time: 5.867138 May 24 15:21:47.255516 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 102/191] 10.222.0.45 () {62 vars in 1318 bytes} [Tue May 24 15:21:41 2022] POST /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/action => generated 0 bytes in 5870 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 24 15:21:47.265407 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-0feb8a7b-037b-41e7-9602-2a3aceec3950 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:47.266472 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-0feb8a7b-037b-41e7-9602-2a3aceec3950 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:47.276143 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0feb8a7b-037b-41e7-9602-2a3aceec3950 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:47.277162 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0feb8a7b-037b-41e7-9602-2a3aceec3950 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:47.278523 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0feb8a7b-037b-41e7-9602-2a3aceec3950 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:47.279438 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0feb8a7b-037b-41e7-9602-2a3aceec3950 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:47.316929 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-0feb8a7b-037b-41e7-9602-2a3aceec3950 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa/ips" status: 200 len: 146 microversion: 2.1 time: 0.059610 May 24 15:21:47.317919 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 103/192] 10.222.0.45 () {58 vars in 1247 bytes} [Tue May 24 15:21:47 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa/ips => generated 146 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:21:47.323739 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-af4d331a-01d5-45d2-9c3d-635cf19c7864 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:47.325308 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-af4d331a-01d5-45d2-9c3d-635cf19c7864 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: d01bc80d-033e-4940-a604-b4f34ee070a9] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:47.333820 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-af4d331a-01d5-45d2-9c3d-635cf19c7864 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:47.335203 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-af4d331a-01d5-45d2-9c3d-635cf19c7864 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:47.336740 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-af4d331a-01d5-45d2-9c3d-635cf19c7864 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:47.337580 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-af4d331a-01d5-45d2-9c3d-635cf19c7864 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:47.522725 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-af4d331a-01d5-45d2-9c3d-635cf19c7864 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:47.532371 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-af4d331a-01d5-45d2-9c3d-635cf19c7864 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9" status: 200 len: 1520 microversion: 2.1 time: 0.213106 May 24 15:21:47.532918 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 104/193] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:21:47 2022] GET /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9 => generated 1520 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:21:47.539444 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c859879c-1e5f-4318-956f-e08184491b32 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:47.540331 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-c859879c-1e5f-4318-956f-e08184491b32 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:47.553426 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c859879c-1e5f-4318-956f-e08184491b32 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:47.553874 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c859879c-1e5f-4318-956f-e08184491b32 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:47.554664 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c859879c-1e5f-4318-956f-e08184491b32 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:47.555099 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c859879c-1e5f-4318-956f-e08184491b32 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:47.796762 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-c859879c-1e5f-4318-956f-e08184491b32 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:47.803944 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-c859879c-1e5f-4318-956f-e08184491b32 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:47.805479 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-c859879c-1e5f-4318-956f-e08184491b32 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:47.807647 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-c859879c-1e5f-4318-956f-e08184491b32 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1724 microversion: 2.20 time: 0.272796 May 24 15:21:47.809127 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 105/194] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:21:47 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1724 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:21:47.887935 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.virt.hardware [None req-ba56e199-9b4a-499d-b9df-cff5aa078cdc tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Flavor limits 0:0:0 {{(pid=117699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 15:21:47.889396 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.virt.hardware [None req-ba56e199-9b4a-499d-b9df-cff5aa078cdc tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Image limits 0:0:0 {{(pid=117699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 15:21:47.889396 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.virt.hardware [None req-ba56e199-9b4a-499d-b9df-cff5aa078cdc tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Flavor pref 0:0:0 {{(pid=117699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 15:21:47.890782 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.virt.hardware [None req-ba56e199-9b4a-499d-b9df-cff5aa078cdc tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Image pref 0:0:0 {{(pid=117699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 15:21:47.892250 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.virt.hardware [None req-ba56e199-9b4a-499d-b9df-cff5aa078cdc tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 15:21:47.907015 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ba56e199-9b4a-499d-b9df-cff5aa078cdc tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:47.907558 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ba56e199-9b4a-499d-b9df-cff5aa078cdc tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:47.908458 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ba56e199-9b4a-499d-b9df-cff5aa078cdc tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:47.908956 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ba56e199-9b4a-499d-b9df-cff5aa078cdc tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:47.930227 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.quota [None req-ba56e199-9b4a-499d-b9df-cff5aa078cdc tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Getting quotas for project f7c8c75b264644b7af9831e14cbf7841. Resources: {'instances', 'ram', 'cores'} {{(pid=117699) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 15:21:47.935163 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.quota [None req-ba56e199-9b4a-499d-b9df-cff5aa078cdc tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Getting quotas for user 2b27ee7d15ca42bca6a09dd18751f01e and project f7c8c75b264644b7af9831e14cbf7841. Resources: {'instances', 'ram', 'cores'} {{(pid=117699) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 15:21:47.948568 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-ba56e199-9b4a-499d-b9df-cff5aa078cdc tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Going to run 1 instances... {{(pid=117699) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 15:21:47.951479 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-ba56e199-9b4a-499d-b9df-cff5aa078cdc tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] [instance: e2d4b4da-3b00-41c0-a0ac-21477f232931] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f921f75e-bbd1-4d99-ab1e-5cce2d895148',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 15:21:48.023519 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-ba56e199-9b4a-499d-b9df-cff5aa078cdc tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 11.957009 May 24 15:21:48.025572 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 90/195] 10.222.0.45 () {60 vars in 1146 bytes} [Tue May 24 15:21:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 11960 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 15:21:48.038731 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-714201ca-b1eb-46c1-b0ff-d694d87213e7 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:48.039342 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-714201ca-b1eb-46c1-b0ff-d694d87213e7 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] [instance: e2d4b4da-3b00-41c0-a0ac-21477f232931] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:48.116184 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-714201ca-b1eb-46c1-b0ff-d694d87213e7 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b27ee7d15ca42bca6a09dd18751f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c8c75b264644b7af9831e14cbf7841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:48.124484 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-714201ca-b1eb-46c1-b0ff-d694d87213e7 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] 10.222.0.45 "GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931" status: 200 len: 1214 microversion: 2.1 time: 0.092050 May 24 15:21:48.125488 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 106/196] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:21:48 2022] GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931 => generated 1214 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:21:48.550764 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-4ffea5f2-6fe2-497c-8ab1-587bafcd8963 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:48.551654 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-4ffea5f2-6fe2-497c-8ab1-587bafcd8963 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: d01bc80d-033e-4940-a604-b4f34ee070a9] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:48.560990 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4ffea5f2-6fe2-497c-8ab1-587bafcd8963 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:48.562343 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4ffea5f2-6fe2-497c-8ab1-587bafcd8963 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:48.567196 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4ffea5f2-6fe2-497c-8ab1-587bafcd8963 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:48.567683 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4ffea5f2-6fe2-497c-8ab1-587bafcd8963 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:48.727109 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-4ffea5f2-6fe2-497c-8ab1-587bafcd8963 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:48.744417 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-4ffea5f2-6fe2-497c-8ab1-587bafcd8963 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9" status: 200 len: 1520 microversion: 2.1 time: 0.198601 May 24 15:21:48.745041 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 91/197] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:21:48 2022] GET /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9 => generated 1520 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:21:48.835490 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-394d94fd-5fe4-4497-90db-69d59224c59c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:48.836288 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-394d94fd-5fe4-4497-90db-69d59224c59c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:48.843189 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-394d94fd-5fe4-4497-90db-69d59224c59c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:48.843627 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-394d94fd-5fe4-4497-90db-69d59224c59c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:48.844776 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-394d94fd-5fe4-4497-90db-69d59224c59c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:48.845550 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-394d94fd-5fe4-4497-90db-69d59224c59c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:48.997260 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-394d94fd-5fe4-4497-90db-69d59224c59c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:49.007848 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-394d94fd-5fe4-4497-90db-69d59224c59c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:49.009372 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-394d94fd-5fe4-4497-90db-69d59224c59c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:49.010781 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-394d94fd-5fe4-4497-90db-69d59224c59c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1724 microversion: 2.20 time: 0.179548 May 24 15:21:49.012394 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 107/198] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:21:48 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:21:49.142762 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-7e95c13e-197b-46aa-bb27-df5a4051e460 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:49.144617 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-7e95c13e-197b-46aa-bb27-df5a4051e460 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] [instance: e2d4b4da-3b00-41c0-a0ac-21477f232931] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:49.156836 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7e95c13e-197b-46aa-bb27-df5a4051e460 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:49.157522 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7e95c13e-197b-46aa-bb27-df5a4051e460 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:49.158915 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7e95c13e-197b-46aa-bb27-df5a4051e460 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:49.162577 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7e95c13e-197b-46aa-bb27-df5a4051e460 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:49.251043 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-7e95c13e-197b-46aa-bb27-df5a4051e460 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b27ee7d15ca42bca6a09dd18751f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c8c75b264644b7af9831e14cbf7841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:49.258686 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-7e95c13e-197b-46aa-bb27-df5a4051e460 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] 10.222.0.45 "GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931" status: 200 len: 1218 microversion: 2.1 time: 0.121076 May 24 15:21:49.259513 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 92/199] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:21:49 2022] GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931 => generated 1218 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:21:49.571516 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-857d7ae0-6901-4729-a94c-7ace862015c6 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3feff41f-366d-45da-a249-196342605aca"}} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:21:49.572848 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-857d7ae0-6901-4729-a94c-7ace862015c6 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:49.579582 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-857d7ae0-6901-4729-a94c-7ace862015c6 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:49.580027 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-857d7ae0-6901-4729-a94c-7ace862015c6 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:49.580842 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-857d7ae0-6901-4729-a94c-7ace862015c6 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:49.581274 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-857d7ae0-6901-4729-a94c-7ace862015c6 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:49.766142 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-304f8bf8-3af6-4f10-a9b9-94dca0116615 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:49.767662 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-304f8bf8-3af6-4f10-a9b9-94dca0116615 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: d01bc80d-033e-4940-a604-b4f34ee070a9] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:49.780441 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-304f8bf8-3af6-4f10-a9b9-94dca0116615 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:49.784381 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-304f8bf8-3af6-4f10-a9b9-94dca0116615 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:49.788747 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-304f8bf8-3af6-4f10-a9b9-94dca0116615 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:49.789528 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-304f8bf8-3af6-4f10-a9b9-94dca0116615 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:49.963328 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-304f8bf8-3af6-4f10-a9b9-94dca0116615 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:49.972121 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-304f8bf8-3af6-4f10-a9b9-94dca0116615 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9" status: 200 len: 1520 microversion: 2.1 time: 0.210871 May 24 15:21:49.982496 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 93/200] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:21:49 2022] GET /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9 => generated 1520 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:21:50.030238 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d0eb4d5f-8677-4912-9dd6-b1c92216f6e3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:50.030883 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d0eb4d5f-8677-4912-9dd6-b1c92216f6e3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:50.039842 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d0eb4d5f-8677-4912-9dd6-b1c92216f6e3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:50.040586 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d0eb4d5f-8677-4912-9dd6-b1c92216f6e3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:50.041351 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d0eb4d5f-8677-4912-9dd6-b1c92216f6e3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:50.041785 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d0eb4d5f-8677-4912-9dd6-b1c92216f6e3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:50.198498 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-d0eb4d5f-8677-4912-9dd6-b1c92216f6e3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:50.207233 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-d0eb4d5f-8677-4912-9dd6-b1c92216f6e3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:50.212107 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-d0eb4d5f-8677-4912-9dd6-b1c92216f6e3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:50.213363 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d0eb4d5f-8677-4912-9dd6-b1c92216f6e3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1724 microversion: 2.20 time: 0.187725 May 24 15:21:50.214232 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 94/201] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:21:50 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:21:50.278476 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-7a84c5c1-275d-41a7-a3b0-8b5d7175456e tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:50.279204 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-7a84c5c1-275d-41a7-a3b0-8b5d7175456e tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] [instance: e2d4b4da-3b00-41c0-a0ac-21477f232931] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:50.285558 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7a84c5c1-275d-41a7-a3b0-8b5d7175456e tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:50.286068 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7a84c5c1-275d-41a7-a3b0-8b5d7175456e tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:50.289587 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7a84c5c1-275d-41a7-a3b0-8b5d7175456e tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:50.290299 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7a84c5c1-275d-41a7-a3b0-8b5d7175456e tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:50.358120 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-7a84c5c1-275d-41a7-a3b0-8b5d7175456e tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b27ee7d15ca42bca6a09dd18751f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c8c75b264644b7af9831e14cbf7841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:50.367716 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-7a84c5c1-275d-41a7-a3b0-8b5d7175456e tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] 10.222.0.45 "GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931" status: 200 len: 1266 microversion: 2.1 time: 0.094193 May 24 15:21:50.368331 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 95/202] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:21:50 2022] GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931 => generated 1266 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:21:50.745562 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-857d7ae0-6901-4729-a94c-7ace862015c6 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "POST /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.177860 May 24 15:21:50.751044 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 108/203] 10.222.0.45 () {60 vars in 1322 bytes} [Tue May 24 15:21:49 2022] POST /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa/os-volume_attachments => generated 194 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:21:50.992934 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-8f2fc1b7-4a0f-44fa-95fb-b36323244b69 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:50.994354 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-8f2fc1b7-4a0f-44fa-95fb-b36323244b69 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: d01bc80d-033e-4940-a604-b4f34ee070a9] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:51.003643 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8f2fc1b7-4a0f-44fa-95fb-b36323244b69 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:51.004496 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8f2fc1b7-4a0f-44fa-95fb-b36323244b69 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:51.005535 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8f2fc1b7-4a0f-44fa-95fb-b36323244b69 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:51.006163 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8f2fc1b7-4a0f-44fa-95fb-b36323244b69 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:51.167985 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-8f2fc1b7-4a0f-44fa-95fb-b36323244b69 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:51.176629 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-8f2fc1b7-4a0f-44fa-95fb-b36323244b69 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9" status: 200 len: 1500 microversion: 2.1 time: 0.191009 May 24 15:21:51.177455 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 96/204] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:21:50 2022] GET /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9 => generated 1500 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:21:51.193755 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-779d94ca-987a-4470-b464-89b120383851 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "41d9268b-bae4-4e22-83c8-c02084d2e1ec"}} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:21:51.194994 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-779d94ca-987a-4470-b464-89b120383851 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: d01bc80d-033e-4940-a604-b4f34ee070a9] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:51.202629 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-779d94ca-987a-4470-b464-89b120383851 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:51.203072 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-779d94ca-987a-4470-b464-89b120383851 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:51.203845 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-779d94ca-987a-4470-b464-89b120383851 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:51.204278 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-779d94ca-987a-4470-b464-89b120383851 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:51.228925 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.wsgi [None req-779d94ca-987a-4470-b464-89b120383851 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] HTTP exception thrown: Cannot 'attach_volume' instance d01bc80d-033e-4940-a604-b4f34ee070a9 while it is in vm_state rescued May 24 15:21:51.230629 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-779d94ca-987a-4470-b464-89b120383851 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Request method failure captured: May 24 15:21:51.230629 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: request: POST /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9/os-volume_attachments HTTP/1.1 May 24 15:21:51.230629 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Accept: application/json May 24 15:21:51.230629 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Accept-Encoding: identity May 24 15:21:51.230629 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Connection: close May 24 15:21:51.230629 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Content-Length: 74 May 24 15:21:51.230629 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Content-Type: application/json May 24 15:21:51.230629 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Host: 10.222.0.45 May 24 15:21:51.230629 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Openstack-System-Scope: None May 24 15:21:51.230629 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: User-Agent: python-urllib3/1.26.9 May 24 15:21:51.230629 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Auth-Token: gAAAAABijPekO_FEqvEt__l4I8WEGx17L4yqtzpCAeEc3y4CnbJAHyL1DySC4YIlKQDTV1hsPFcvsVRhAbutvBRf9w65KzCkRaS-QYMp5wOBtVk4LwevMnKVJp-p3Ycug9G9UYw2xMBk2TmyRPXhISTuFKrt-_kc3sLkHf7ee14Z1I5hnTaBDlA May 24 15:21:51.230629 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Domain-Id: None May 24 15:21:51.230629 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Domain-Name: None May 24 15:21:51.230629 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Identity-Status: Confirmed May 24 15:21:51.230629 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Is-Admin-Project: True May 24 15:21:51.230629 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Domain-Id: default May 24 15:21:51.230629 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Domain-Name: Default May 24 15:21:51.230629 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Id: e8d86717f1954ab7a59cdef0cf13556c May 24 15:21:51.230629 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1254703915 May 24 15:21:51.230629 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Role: reader,member May 24 15:21:51.230629 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Roles: reader,member May 24 15:21:51.231847 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e8d86717f1954ab7a59cdef0cf13556c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e8d86717f1954ab7a59cdef0cf13556c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e8d86717f1954ab7a59cdef0cf13556c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e8d86717f1954ab7a59cdef0cf13556c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 24 15:21:51.231847 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1254703915 May 24 15:21:51.231847 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Tenant-Id: e8d86717f1954ab7a59cdef0cf13556c May 24 15:21:51.231847 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1254703915 May 24 15:21:51.231847 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User: tempest-ServerRescueNegativeTestJSON-1254703915-project May 24 15:21:51.231847 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Domain-Id: default May 24 15:21:51.231847 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Domain-Name: Default May 24 15:21:51.231847 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Id: 2d8a7414fd254ec981d35b417dc373cd May 24 15:21:51.231847 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1254703915-project May 24 15:21:51.231847 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: May 24 15:21:51.231847 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: {"volumeAttachment": {"volumeId": "41d9268b-bae4-4e22-83c8-c02084d2e1ec"}} May 24 15:21:51.231847 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: method: > May 24 15:21:51.232597 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: exception: Cannot 'attach_volume' instance d01bc80d-033e-4940-a604-b4f34ee070a9 while it is in vm_state rescued May 24 15:21:51.232597 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: action_args: {'server_id': 'd01bc80d-033e-4940-a604-b4f34ee070a9', 'body': {'volumeAttachment': {'volumeId': '41d9268b-bae4-4e22-83c8-c02084d2e1ec'}}} May 24 15:21:51.232597 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:21:51.232597 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:21:51.232597 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 24 15:21:51.232597 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 24 15:21:51.232597 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 24 15:21:51.232597 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 24 15:21:51.232597 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 24 15:21:51.232597 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 24 15:21:51.232597 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d01bc80d-033e-4940-a604-b4f34ee070a9 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 24 15:21:51.232597 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:21:51.232597 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:21:51.232597 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:21:51.232597 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:21:51.232597 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:21:51.232597 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:21:51.232597 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:21:51.232597 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:21:51.234011 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:21:51.234011 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:21:51.234011 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 24 15:21:51.234011 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 24 15:21:51.234011 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 24 15:21:51.234011 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 24 15:21:51.234011 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 24 15:21:51.234011 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 24 15:21:51.234011 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 24 15:21:51.234011 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 24 15:21:51.234011 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 24 15:21:51.234011 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 24 15:21:51.234011 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance d01bc80d-033e-4940-a604-b4f34ee070a9 while it is in vm_state rescued May 24 15:21:51.234011 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:21:51.234011 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:21:51.234011 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:21:51.234011 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:21:51.234011 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:21:51.234011 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:21:51.235964 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:21:51.235964 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:21:51.235964 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance d01bc80d-033e-4940-a604-b4f34ee070a9 while it is in vm_state rescued May 24 15:21:51.235964 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:21:51.235964 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-779d94ca-987a-4470-b464-89b120383851 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Returning 409 to user: Cannot 'attach_volume' instance d01bc80d-033e-4940-a604-b4f34ee070a9 while it is in vm_state rescued {{(pid=117698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:21:51.236537 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-03af1f51-43ee-4088-93eb-d26df6a196aa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:51.236660 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-779d94ca-987a-4470-b464-89b120383851 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "POST /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042736 May 24 15:21:51.236660 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 109/205] 10.222.0.45 () {60 vars in 1322 bytes} [Tue May 24 15:21:51 2022] POST /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 24 15:21:51.236820 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-03af1f51-43ee-4088-93eb-d26df6a196aa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:51.241785 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-03af1f51-43ee-4088-93eb-d26df6a196aa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:51.242387 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-03af1f51-43ee-4088-93eb-d26df6a196aa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:51.243376 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-375e742f-32b5-445d-b102-47e6c89f2b0a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:21:51.243501 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-03af1f51-43ee-4088-93eb-d26df6a196aa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:51.243911 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-375e742f-32b5-445d-b102-47e6c89f2b0a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: d01bc80d-033e-4940-a604-b4f34ee070a9] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:51.244090 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-03af1f51-43ee-4088-93eb-d26df6a196aa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:51.260417 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-375e742f-32b5-445d-b102-47e6c89f2b0a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:51.260798 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-375e742f-32b5-445d-b102-47e6c89f2b0a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:51.264488 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-375e742f-32b5-445d-b102-47e6c89f2b0a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:51.264937 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-375e742f-32b5-445d-b102-47e6c89f2b0a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:51.356994 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-375e742f-32b5-445d-b102-47e6c89f2b0a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "POST /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9/action" status: 202 len: 0 microversion: 2.1 time: 0.116906 May 24 15:21:51.358040 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 110/206] 10.222.0.45 () {60 vars in 1277 bytes} [Tue May 24 15:21:51 2022] POST /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 15:21:51.370467 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-bd638164-c9e6-4cfa-a843-aa384f9f4a9c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:51.372400 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-bd638164-c9e6-4cfa-a843-aa384f9f4a9c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: d01bc80d-033e-4940-a604-b4f34ee070a9] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:51.383705 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bd638164-c9e6-4cfa-a843-aa384f9f4a9c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:51.384480 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bd638164-c9e6-4cfa-a843-aa384f9f4a9c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:51.386094 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bd638164-c9e6-4cfa-a843-aa384f9f4a9c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:51.387539 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bd638164-c9e6-4cfa-a843-aa384f9f4a9c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:51.412474 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-03af1f51-43ee-4088-93eb-d26df6a196aa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:51.420962 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-03af1f51-43ee-4088-93eb-d26df6a196aa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:51.422467 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-03af1f51-43ee-4088-93eb-d26df6a196aa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:51.423646 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-03af1f51-43ee-4088-93eb-d26df6a196aa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1724 microversion: 2.20 time: 0.196084 May 24 15:21:51.424214 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 97/207] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:21:51 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:21:51.431901 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-47d7f9b2-868d-4730-944b-bf091c9c4c31 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:51.432631 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-47d7f9b2-868d-4730-944b-bf091c9c4c31 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] [instance: e2d4b4da-3b00-41c0-a0ac-21477f232931] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:51.439657 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-47d7f9b2-868d-4730-944b-bf091c9c4c31 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:51.440204 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-47d7f9b2-868d-4730-944b-bf091c9c4c31 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:51.441225 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-47d7f9b2-868d-4730-944b-bf091c9c4c31 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:51.441851 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-47d7f9b2-868d-4730-944b-bf091c9c4c31 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:51.505447 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-47d7f9b2-868d-4730-944b-bf091c9c4c31 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b27ee7d15ca42bca6a09dd18751f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c8c75b264644b7af9831e14cbf7841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:51.513554 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-47d7f9b2-868d-4730-944b-bf091c9c4c31 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] 10.222.0.45 "GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931" status: 200 len: 1274 microversion: 2.1 time: 0.088110 May 24 15:21:51.514124 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 98/208] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:21:51 2022] GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931 => generated 1274 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:21:51.518509 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-3e578144-72bc-4d07-9f72-e7683fb5dc79 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Action: 'create', calling method: .version_select at 0x7f2dd2f8e820>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-891689507", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5z5H7Tehyek4XqdlasoiEDRMsIrgoihrTFQvV4bbCAlyRKzAvmjbkF9h3fuZR63kCp5YFT3U6bsLqdnS6HcJ98+YrRQsNNWvBfp4aOJYx8JODow7oaTUIQ+nsWTkzP/g=="}} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:21:51.530742 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-bd638164-c9e6-4cfa-a843-aa384f9f4a9c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:51.531923 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.quota [None req-3e578144-72bc-4d07-9f72-e7683fb5dc79 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Getting quotas for project cb659dae6f4b4f26a2d869138f573561. Resources: {'key_pairs'} {{(pid=117699) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 15:21:51.535810 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.quota [None req-3e578144-72bc-4d07-9f72-e7683fb5dc79 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Getting quotas for user 927951dcdbb348d6ac8d467753c55d61 and project cb659dae6f4b4f26a2d869138f573561. Resources: {'key_pairs'} {{(pid=117699) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 15:21:51.538275 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-bd638164-c9e6-4cfa-a843-aa384f9f4a9c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9" status: 200 len: 1508 microversion: 2.1 time: 0.175327 May 24 15:21:51.538842 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 111/209] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:21:51 2022] GET /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9 => generated 1508 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:21:51.562782 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-3e578144-72bc-4d07-9f72-e7683fb5dc79 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.047635 May 24 15:21:51.563486 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 99/210] 10.222.0.45 () {60 vars in 1158 bytes} [Tue May 24 15:21:51 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:21:51.659460 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-0668ee6d-3d96-40c1-8be0-715f1f2a8eb9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-985986373", "imageRef": "49ef0e96-ae1a-44d4-bdfb-b5423e46e199", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-891689507", "networks": [{"uuid": "3e6568dc-65f3-4bb2-b636-42f469c28b55"}]}} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:21:51.709777 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.network.neutron [None req-0668ee6d-3d96-40c1-8be0-715f1f2a8eb9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] validate_networks() for [('3e6568dc-65f3-4bb2-b636-42f469c28b55', None, None, None, None, None)] {{(pid=117698) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 15:21:52.310815 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.virt.hardware [None req-0668ee6d-3d96-40c1-8be0-715f1f2a8eb9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Flavor limits 0:0:0 {{(pid=117698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 15:21:52.311424 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.virt.hardware [None req-0668ee6d-3d96-40c1-8be0-715f1f2a8eb9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Image limits 0:0:0 {{(pid=117698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 15:21:52.311701 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.virt.hardware [None req-0668ee6d-3d96-40c1-8be0-715f1f2a8eb9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Flavor pref 0:0:0 {{(pid=117698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 15:21:52.312649 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.virt.hardware [None req-0668ee6d-3d96-40c1-8be0-715f1f2a8eb9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Image pref 0:0:0 {{(pid=117698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 15:21:52.313146 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.virt.hardware [None req-0668ee6d-3d96-40c1-8be0-715f1f2a8eb9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 15:21:52.322086 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0668ee6d-3d96-40c1-8be0-715f1f2a8eb9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:52.322680 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0668ee6d-3d96-40c1-8be0-715f1f2a8eb9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:52.323644 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0668ee6d-3d96-40c1-8be0-715f1f2a8eb9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:52.324894 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0668ee6d-3d96-40c1-8be0-715f1f2a8eb9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:52.342148 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.quota [None req-0668ee6d-3d96-40c1-8be0-715f1f2a8eb9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Getting quotas for project cb659dae6f4b4f26a2d869138f573561. Resources: {'instances', 'ram', 'cores'} {{(pid=117698) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 15:21:52.346333 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.quota [None req-0668ee6d-3d96-40c1-8be0-715f1f2a8eb9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Getting quotas for user 927951dcdbb348d6ac8d467753c55d61 and project cb659dae6f4b4f26a2d869138f573561. Resources: {'instances', 'ram', 'cores'} {{(pid=117698) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 15:21:52.358054 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-0668ee6d-3d96-40c1-8be0-715f1f2a8eb9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Going to run 1 instances... {{(pid=117698) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 15:21:52.360408 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-0668ee6d-3d96-40c1-8be0-715f1f2a8eb9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='49ef0e96-ae1a-44d4-bdfb-b5423e46e199',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 15:21:52.415519 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-0668ee6d-3d96-40c1-8be0-715f1f2a8eb9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.759309 May 24 15:21:52.420982 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 112/211] 10.222.0.45 () {60 vars in 1146 bytes} [Tue May 24 15:21:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 15:21:52.426286 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a698a72a-569b-4eb2-a366-4d2472e27f14 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:52.427835 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a698a72a-569b-4eb2-a366-4d2472e27f14 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:52.443480 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e0e7caec-2209-4fa6-be16-37b9f931ee9d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:52.443667 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e0e7caec-2209-4fa6-be16-37b9f931ee9d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:52.456666 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e0e7caec-2209-4fa6-be16-37b9f931ee9d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:52.457117 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e0e7caec-2209-4fa6-be16-37b9f931ee9d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:52.457898 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e0e7caec-2209-4fa6-be16-37b9f931ee9d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:52.458899 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e0e7caec-2209-4fa6-be16-37b9f931ee9d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:52.556933 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-a698a72a-569b-4eb2-a366-4d2472e27f14 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:52.566052 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a698a72a-569b-4eb2-a366-4d2472e27f14 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1257 microversion: 2.1 time: 0.143724 May 24 15:21:52.567436 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 100/212] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:21:52 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1257 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:21:52.572712 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-ace75abc-1d23-4a29-aa58-63e41cc92b6e tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:52.573611 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-ace75abc-1d23-4a29-aa58-63e41cc92b6e tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] [instance: e2d4b4da-3b00-41c0-a0ac-21477f232931] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:52.580737 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ace75abc-1d23-4a29-aa58-63e41cc92b6e tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:52.581387 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ace75abc-1d23-4a29-aa58-63e41cc92b6e tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:52.582418 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ace75abc-1d23-4a29-aa58-63e41cc92b6e tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:52.583302 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ace75abc-1d23-4a29-aa58-63e41cc92b6e tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:52.696586 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e0e7caec-2209-4fa6-be16-37b9f931ee9d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:52.712038 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e0e7caec-2209-4fa6-be16-37b9f931ee9d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:52.713813 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e0e7caec-2209-4fa6-be16-37b9f931ee9d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:52.715263 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e0e7caec-2209-4fa6-be16-37b9f931ee9d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1724 microversion: 2.20 time: 0.276133 May 24 15:21:52.715968 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 113/213] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:21:52 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1724 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:21:52.721512 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-9a570ea8-274e-4c9d-9959-daa57f05a553 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:52.722291 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-9a570ea8-274e-4c9d-9959-daa57f05a553 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: d01bc80d-033e-4940-a604-b4f34ee070a9] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:52.731338 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9a570ea8-274e-4c9d-9959-daa57f05a553 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:52.731911 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9a570ea8-274e-4c9d-9959-daa57f05a553 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:52.732714 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9a570ea8-274e-4c9d-9959-daa57f05a553 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:52.733580 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9a570ea8-274e-4c9d-9959-daa57f05a553 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:52.895892 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-9a570ea8-274e-4c9d-9959-daa57f05a553 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:52.907021 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-9a570ea8-274e-4c9d-9959-daa57f05a553 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9" status: 200 len: 1508 microversion: 2.1 time: 0.188980 May 24 15:21:52.907970 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 114/214] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:21:52 2022] GET /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9 => generated 1508 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:21:52.925314 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-ace75abc-1d23-4a29-aa58-63e41cc92b6e tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b27ee7d15ca42bca6a09dd18751f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c8c75b264644b7af9831e14cbf7841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:52.939711 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-ace75abc-1d23-4a29-aa58-63e41cc92b6e tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] 10.222.0.45 "GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931" status: 200 len: 1314 microversion: 2.1 time: 0.370709 May 24 15:21:52.940428 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 101/215] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:21:52 2022] GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931 => generated 1314 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:21:53.276453 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [req-061bd380-5819-454a-aa7b-8f0a590f67ed req-1a00666d-d7b6-446d-9ddb-eb24f4fc290b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2d4b4da-3b00-41c0-a0ac-21477f232931", "tag": "696a99fb-5587-4eb6-9451-4255b6f05a8b"}]} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:21:53.287368 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-061bd380-5819-454a-aa7b-8f0a590f67ed req-1a00666d-d7b6-446d-9ddb-eb24f4fc290b service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:53.287974 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-061bd380-5819-454a-aa7b-8f0a590f67ed req-1a00666d-d7b6-446d-9ddb-eb24f4fc290b service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:53.301630 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.compute.server_external_events [req-061bd380-5819-454a-aa7b-8f0a590f67ed req-1a00666d-d7b6-446d-9ddb-eb24f4fc290b service nova] Creating event network-changed:696a99fb-5587-4eb6-9451-4255b6f05a8b for instance e2d4b4da-3b00-41c0-a0ac-21477f232931 on hv-cinder-84315 May 24 15:21:53.306576 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [req-061bd380-5819-454a-aa7b-8f0a590f67ed req-1a00666d-d7b6-446d-9ddb-eb24f4fc290b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033927 May 24 15:21:53.307162 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 115/216] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:21:53.582997 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d21dc14c-cb8d-400f-afd9-9e22c939deae tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:53.583614 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d21dc14c-cb8d-400f-afd9-9e22c939deae tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:53.590228 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d21dc14c-cb8d-400f-afd9-9e22c939deae tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:53.590677 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d21dc14c-cb8d-400f-afd9-9e22c939deae tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:53.591443 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d21dc14c-cb8d-400f-afd9-9e22c939deae tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:53.591874 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d21dc14c-cb8d-400f-afd9-9e22c939deae tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:53.652218 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-d21dc14c-cb8d-400f-afd9-9e22c939deae tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:53.659600 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d21dc14c-cb8d-400f-afd9-9e22c939deae tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1309 microversion: 2.1 time: 0.080455 May 24 15:21:53.660202 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 102/217] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:21:53 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1309 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:21:53.734551 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-624e295d-3746-43fd-9ccf-e6e35729f5d3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:53.735552 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-624e295d-3746-43fd-9ccf-e6e35729f5d3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:53.741619 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-624e295d-3746-43fd-9ccf-e6e35729f5d3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:53.742069 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-624e295d-3746-43fd-9ccf-e6e35729f5d3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:53.742856 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-624e295d-3746-43fd-9ccf-e6e35729f5d3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:53.743291 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-624e295d-3746-43fd-9ccf-e6e35729f5d3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:53.925629 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-43bf8e6c-e7dc-48f6-8f50-f03d8223b7e5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:53.926573 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-43bf8e6c-e7dc-48f6-8f50-f03d8223b7e5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: d01bc80d-033e-4940-a604-b4f34ee070a9] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:53.934411 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-43bf8e6c-e7dc-48f6-8f50-f03d8223b7e5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:53.934987 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-43bf8e6c-e7dc-48f6-8f50-f03d8223b7e5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:53.935981 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-43bf8e6c-e7dc-48f6-8f50-f03d8223b7e5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:53.938588 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-43bf8e6c-e7dc-48f6-8f50-f03d8223b7e5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:53.967445 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-624e295d-3746-43fd-9ccf-e6e35729f5d3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:53.977118 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-624e295d-3746-43fd-9ccf-e6e35729f5d3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:53.979495 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-624e295d-3746-43fd-9ccf-e6e35729f5d3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:53.981446 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-624e295d-3746-43fd-9ccf-e6e35729f5d3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1724 microversion: 2.20 time: 0.251727 May 24 15:21:53.982425 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 116/218] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:21:53 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1724 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:21:53.987905 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-cd6dd5db-3b15-41f0-8e99-0b1d8d6446be tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:53.988884 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-cd6dd5db-3b15-41f0-8e99-0b1d8d6446be tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] [instance: e2d4b4da-3b00-41c0-a0ac-21477f232931] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:53.995441 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cd6dd5db-3b15-41f0-8e99-0b1d8d6446be tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:53.996748 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cd6dd5db-3b15-41f0-8e99-0b1d8d6446be tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:53.997697 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cd6dd5db-3b15-41f0-8e99-0b1d8d6446be tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:53.998178 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cd6dd5db-3b15-41f0-8e99-0b1d8d6446be tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:54.126822 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-43bf8e6c-e7dc-48f6-8f50-f03d8223b7e5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:54.134251 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-43bf8e6c-e7dc-48f6-8f50-f03d8223b7e5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9" status: 200 len: 1508 microversion: 2.1 time: 0.213070 May 24 15:21:54.134958 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 103/219] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:21:53 2022] GET /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9 => generated 1508 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:21:54.205567 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-cd6dd5db-3b15-41f0-8e99-0b1d8d6446be tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b27ee7d15ca42bca6a09dd18751f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c8c75b264644b7af9831e14cbf7841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:54.213565 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-cd6dd5db-3b15-41f0-8e99-0b1d8d6446be tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] 10.222.0.45 "GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931" status: 200 len: 1314 microversion: 2.1 time: 0.229341 May 24 15:21:54.214335 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 117/220] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:21:53 2022] GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:21:54.676590 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-fb59a710-318d-4b1d-8bef-9202ecd911c0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:54.677198 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-fb59a710-318d-4b1d-8bef-9202ecd911c0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:54.684025 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fb59a710-318d-4b1d-8bef-9202ecd911c0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:54.684504 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fb59a710-318d-4b1d-8bef-9202ecd911c0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:54.685272 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fb59a710-318d-4b1d-8bef-9202ecd911c0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:54.685701 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fb59a710-318d-4b1d-8bef-9202ecd911c0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:54.820019 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-fb59a710-318d-4b1d-8bef-9202ecd911c0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:54.828407 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-fb59a710-318d-4b1d-8bef-9202ecd911c0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1357 microversion: 2.1 time: 0.155653 May 24 15:21:54.829071 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 104/221] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:21:54 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:21:55.000238 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-9c6c9aa8-6d2b-4099-98e0-6881d0aed633 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:55.000884 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-9c6c9aa8-6d2b-4099-98e0-6881d0aed633 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:55.003399 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:21:55.009810 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9c6c9aa8-6d2b-4099-98e0-6881d0aed633 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:55.010256 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9c6c9aa8-6d2b-4099-98e0-6881d0aed633 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:55.011014 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9c6c9aa8-6d2b-4099-98e0-6881d0aed633 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:55.011934 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9c6c9aa8-6d2b-4099-98e0-6881d0aed633 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:55.142554 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-9c6c9aa8-6d2b-4099-98e0-6881d0aed633 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:55.150325 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-9c6c9aa8-6d2b-4099-98e0-6881d0aed633 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:55.150836 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-7c9e24ce-efc9-4f72-8873-4fc1f08701cc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:55.151448 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-7c9e24ce-efc9-4f72-8873-4fc1f08701cc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: d01bc80d-033e-4940-a604-b4f34ee070a9] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:55.151833 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-9c6c9aa8-6d2b-4099-98e0-6881d0aed633 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:55.153096 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-9c6c9aa8-6d2b-4099-98e0-6881d0aed633 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1724 microversion: 2.20 time: 0.157808 May 24 15:21:55.153646 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 118/222] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:21:54 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:21:55.157439 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7c9e24ce-efc9-4f72-8873-4fc1f08701cc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:55.157888 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7c9e24ce-efc9-4f72-8873-4fc1f08701cc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:55.158651 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7c9e24ce-efc9-4f72-8873-4fc1f08701cc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:55.159083 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7c9e24ce-efc9-4f72-8873-4fc1f08701cc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:55.230154 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-8c58eab7-ec72-4f69-811c-3793eb4c661e tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:55.230758 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-8c58eab7-ec72-4f69-811c-3793eb4c661e tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] [instance: e2d4b4da-3b00-41c0-a0ac-21477f232931] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:55.236981 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8c58eab7-ec72-4f69-811c-3793eb4c661e tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:55.237421 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8c58eab7-ec72-4f69-811c-3793eb4c661e tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:55.238212 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8c58eab7-ec72-4f69-811c-3793eb4c661e tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:55.238716 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8c58eab7-ec72-4f69-811c-3793eb4c661e tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:55.243826 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:21:55.289118 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-7c9e24ce-efc9-4f72-8873-4fc1f08701cc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:55.296904 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-7c9e24ce-efc9-4f72-8873-4fc1f08701cc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9" status: 200 len: 1508 microversion: 2.1 time: 0.149863 May 24 15:21:55.297503 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 105/223] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:21:55 2022] GET /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9 => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:21:55.374072 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-8c58eab7-ec72-4f69-811c-3793eb4c661e tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b27ee7d15ca42bca6a09dd18751f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c8c75b264644b7af9831e14cbf7841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:55.381415 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-8c58eab7-ec72-4f69-811c-3793eb4c661e tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] 10.222.0.45 "GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931" status: 200 len: 1314 microversion: 2.1 time: 0.155307 May 24 15:21:55.381982 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 119/224] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:21:55 2022] GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:21:55.846811 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-04d5d008-193f-4f45-bc45-a4e70bdd1670 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:55.847311 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-04d5d008-193f-4f45-bc45-a4e70bdd1670 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:55.855014 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-04d5d008-193f-4f45-bc45-a4e70bdd1670 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:55.856364 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-04d5d008-193f-4f45-bc45-a4e70bdd1670 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:55.856933 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-04d5d008-193f-4f45-bc45-a4e70bdd1670 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:55.857373 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-04d5d008-193f-4f45-bc45-a4e70bdd1670 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:56.046652 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-04d5d008-193f-4f45-bc45-a4e70bdd1670 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:56.054592 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-04d5d008-193f-4f45-bc45-a4e70bdd1670 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1357 microversion: 2.1 time: 0.212485 May 24 15:21:56.055271 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 106/225] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:21:55 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1357 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:21:56.171529 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-14b5fcd6-2eaf-42f8-b185-ddc8704718a3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:56.172957 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-14b5fcd6-2eaf-42f8-b185-ddc8704718a3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:56.186537 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-14b5fcd6-2eaf-42f8-b185-ddc8704718a3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:56.191314 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-14b5fcd6-2eaf-42f8-b185-ddc8704718a3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:56.192122 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-14b5fcd6-2eaf-42f8-b185-ddc8704718a3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:56.196629 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-14b5fcd6-2eaf-42f8-b185-ddc8704718a3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:56.313524 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-48fb8faa-29a9-4b54-8264-df311553866b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:56.314378 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-48fb8faa-29a9-4b54-8264-df311553866b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: d01bc80d-033e-4940-a604-b4f34ee070a9] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:56.329876 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-48fb8faa-29a9-4b54-8264-df311553866b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:56.330322 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-48fb8faa-29a9-4b54-8264-df311553866b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:56.331107 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-48fb8faa-29a9-4b54-8264-df311553866b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:56.331543 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-48fb8faa-29a9-4b54-8264-df311553866b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:56.531045 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-14b5fcd6-2eaf-42f8-b185-ddc8704718a3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:56.535004 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-48fb8faa-29a9-4b54-8264-df311553866b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:56.539854 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-14b5fcd6-2eaf-42f8-b185-ddc8704718a3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:56.541494 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-14b5fcd6-2eaf-42f8-b185-ddc8704718a3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:56.543435 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-14b5fcd6-2eaf-42f8-b185-ddc8704718a3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1724 microversion: 2.20 time: 0.375599 May 24 15:21:56.543686 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-48fb8faa-29a9-4b54-8264-df311553866b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9" status: 200 len: 1508 microversion: 2.1 time: 0.233565 May 24 15:21:56.544874 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 107/226] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:21:56 2022] GET /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9 => generated 1508 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:21:56.550570 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-09ea267b-d9e8-4289-9bb1-012f479fafbd tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:56.550570 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-09ea267b-d9e8-4289-9bb1-012f479fafbd tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] [instance: e2d4b4da-3b00-41c0-a0ac-21477f232931] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:56.558232 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-09ea267b-d9e8-4289-9bb1-012f479fafbd tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:56.558232 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-09ea267b-d9e8-4289-9bb1-012f479fafbd tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:56.558499 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 120/227] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:21:56 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1724 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:21:56.558578 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-09ea267b-d9e8-4289-9bb1-012f479fafbd tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:56.558578 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-09ea267b-d9e8-4289-9bb1-012f479fafbd tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:56.696998 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-09ea267b-d9e8-4289-9bb1-012f479fafbd tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b27ee7d15ca42bca6a09dd18751f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c8c75b264644b7af9831e14cbf7841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:56.705314 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-09ea267b-d9e8-4289-9bb1-012f479fafbd tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] 10.222.0.45 "GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931" status: 200 len: 1314 microversion: 2.1 time: 0.159462 May 24 15:21:56.705887 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 108/228] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:21:56 2022] GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:21:56.744784 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [req-13fe2a84-38ce-4ddc-add9-23f125b6a462 req-700c8471-7e6c-46c3-abb0-b09be977957f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c395e512-b693-4a96-8301-640831fee66f", "tag": "3b9228a9-f1b9-4ba1-9526-b1b918986c1b"}]} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:21:56.753880 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-13fe2a84-38ce-4ddc-add9-23f125b6a462 req-700c8471-7e6c-46c3-abb0-b09be977957f service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:56.754550 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-13fe2a84-38ce-4ddc-add9-23f125b6a462 req-700c8471-7e6c-46c3-abb0-b09be977957f service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:56.766823 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.compute.server_external_events [req-13fe2a84-38ce-4ddc-add9-23f125b6a462 req-700c8471-7e6c-46c3-abb0-b09be977957f service nova] Creating event network-changed:3b9228a9-f1b9-4ba1-9526-b1b918986c1b for instance c395e512-b693-4a96-8301-640831fee66f on hv-cinder-84315 May 24 15:21:56.771585 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [req-13fe2a84-38ce-4ddc-add9-23f125b6a462 req-700c8471-7e6c-46c3-abb0-b09be977957f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030735 May 24 15:21:56.772185 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 121/229] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:21:57.071345 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-3b3cae21-314c-4823-ba88-997d20d229b7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:57.072509 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-3b3cae21-314c-4823-ba88-997d20d229b7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:57.079805 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3b3cae21-314c-4823-ba88-997d20d229b7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:57.080254 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3b3cae21-314c-4823-ba88-997d20d229b7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:57.081391 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3b3cae21-314c-4823-ba88-997d20d229b7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:57.082574 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3b3cae21-314c-4823-ba88-997d20d229b7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:57.087641 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:21:57.225311 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-3b3cae21-314c-4823-ba88-997d20d229b7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:57.234394 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-3b3cae21-314c-4823-ba88-997d20d229b7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1357 microversion: 2.1 time: 0.167056 May 24 15:21:57.235536 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 109/230] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:21:57 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:21:57.563452 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-91ed8b90-973d-452c-9118-fff6ba6a9dbd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:57.564274 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-91ed8b90-973d-452c-9118-fff6ba6a9dbd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: d01bc80d-033e-4940-a604-b4f34ee070a9] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:57.572399 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-91ed8b90-973d-452c-9118-fff6ba6a9dbd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:57.573161 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-91ed8b90-973d-452c-9118-fff6ba6a9dbd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:57.575010 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-91ed8b90-973d-452c-9118-fff6ba6a9dbd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:57.575359 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d310807e-f894-485c-b8ab-170fef9f3548 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:57.575803 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-91ed8b90-973d-452c-9118-fff6ba6a9dbd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:57.576481 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d310807e-f894-485c-b8ab-170fef9f3548 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:57.583641 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d310807e-f894-485c-b8ab-170fef9f3548 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:57.584545 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d310807e-f894-485c-b8ab-170fef9f3548 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:57.585673 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d310807e-f894-485c-b8ab-170fef9f3548 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:57.586380 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d310807e-f894-485c-b8ab-170fef9f3548 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:57.773514 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-91ed8b90-973d-452c-9118-fff6ba6a9dbd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:57.782109 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-91ed8b90-973d-452c-9118-fff6ba6a9dbd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9" status: 200 len: 1514 microversion: 2.1 time: 0.224730 May 24 15:21:57.783227 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 122/231] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:21:57 2022] GET /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9 => generated 1514 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:21:57.788129 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-3881bbbb-7694-41e0-b9b3-efa31578c1ba tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:57.788993 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-3881bbbb-7694-41e0-b9b3-efa31578c1ba tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] [instance: e2d4b4da-3b00-41c0-a0ac-21477f232931] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:57.796602 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3881bbbb-7694-41e0-b9b3-efa31578c1ba tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:57.803121 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3881bbbb-7694-41e0-b9b3-efa31578c1ba tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:57.810120 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3881bbbb-7694-41e0-b9b3-efa31578c1ba tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:57.810850 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3881bbbb-7694-41e0-b9b3-efa31578c1ba tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:57.819322 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-d310807e-f894-485c-b8ab-170fef9f3548 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:57.831359 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-d310807e-f894-485c-b8ab-170fef9f3548 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:57.833175 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-d310807e-f894-485c-b8ab-170fef9f3548 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:57.835366 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d310807e-f894-485c-b8ab-170fef9f3548 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1724 microversion: 2.20 time: 0.264357 May 24 15:21:57.844617 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 110/232] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:21:57 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1724 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:21:58.084883 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-3881bbbb-7694-41e0-b9b3-efa31578c1ba tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b27ee7d15ca42bca6a09dd18751f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c8c75b264644b7af9831e14cbf7841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:58.096422 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-3881bbbb-7694-41e0-b9b3-efa31578c1ba tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] 10.222.0.45 "GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931" status: 200 len: 1314 microversion: 2.1 time: 0.311749 May 24 15:21:58.108956 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 123/233] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:21:57 2022] GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931 => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:21:58.253205 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-ea7394ff-01af-4d69-b12a-bc41c3dc745d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:58.253911 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-ea7394ff-01af-4d69-b12a-bc41c3dc745d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:58.256431 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell0:SELECT=2 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:21:58.273695 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ea7394ff-01af-4d69-b12a-bc41c3dc745d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:58.275890 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ea7394ff-01af-4d69-b12a-bc41c3dc745d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:58.278706 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ea7394ff-01af-4d69-b12a-bc41c3dc745d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:58.279154 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ea7394ff-01af-4d69-b12a-bc41c3dc745d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:58.470291 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-ea7394ff-01af-4d69-b12a-bc41c3dc745d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:58.490001 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-ea7394ff-01af-4d69-b12a-bc41c3dc745d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1357 microversion: 2.1 time: 0.241044 May 24 15:21:58.498289 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 111/234] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:21:58 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1357 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:21:58.862629 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c26facb8-dfb4-455d-b45a-799e9895df82 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:58.863239 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-c26facb8-dfb4-455d-b45a-799e9895df82 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:58.874967 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c26facb8-dfb4-455d-b45a-799e9895df82 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:58.875515 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c26facb8-dfb4-455d-b45a-799e9895df82 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:58.878377 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c26facb8-dfb4-455d-b45a-799e9895df82 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:58.878790 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c26facb8-dfb4-455d-b45a-799e9895df82 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:59.088371 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-c26facb8-dfb4-455d-b45a-799e9895df82 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:59.098612 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-c26facb8-dfb4-455d-b45a-799e9895df82 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:59.100147 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-c26facb8-dfb4-455d-b45a-799e9895df82 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:59.102055 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-c26facb8-dfb4-455d-b45a-799e9895df82 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1724 microversion: 2.20 time: 0.242660 May 24 15:21:59.103219 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 124/235] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:21:58 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1724 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:21:59.115737 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-2d74ae67-3521-4c98-af6d-0382c203edab tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:59.116926 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-2d74ae67-3521-4c98-af6d-0382c203edab tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] [instance: e2d4b4da-3b00-41c0-a0ac-21477f232931] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:59.124604 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2d74ae67-3521-4c98-af6d-0382c203edab tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:59.125183 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2d74ae67-3521-4c98-af6d-0382c203edab tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:59.127253 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2d74ae67-3521-4c98-af6d-0382c203edab tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:59.127253 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2d74ae67-3521-4c98-af6d-0382c203edab tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:59.293740 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-2d74ae67-3521-4c98-af6d-0382c203edab tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b27ee7d15ca42bca6a09dd18751f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c8c75b264644b7af9831e14cbf7841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:59.301276 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-2d74ae67-3521-4c98-af6d-0382c203edab tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] 10.222.0.45 "GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931" status: 200 len: 1314 microversion: 2.1 time: 0.190113 May 24 15:21:59.301842 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 112/236] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:21:59 2022] GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:21:59.506790 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-06d1a322-bd3e-4d02-bfac-9e00582b1361 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:21:59.508196 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-06d1a322-bd3e-4d02-bfac-9e00582b1361 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:21:59.515203 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-06d1a322-bd3e-4d02-bfac-9e00582b1361 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:59.515718 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-06d1a322-bd3e-4d02-bfac-9e00582b1361 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:59.516583 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-06d1a322-bd3e-4d02-bfac-9e00582b1361 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:21:59.517081 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-06d1a322-bd3e-4d02-bfac-9e00582b1361 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:21:59.651169 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-06d1a322-bd3e-4d02-bfac-9e00582b1361 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:21:59.659433 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-06d1a322-bd3e-4d02-bfac-9e00582b1361 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1357 microversion: 2.1 time: 0.156458 May 24 15:21:59.662084 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 125/237] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:21:59 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:00.131744 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-670c5c61-41ab-4617-9288-ad9e67f22b0c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:00.133103 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-670c5c61-41ab-4617-9288-ad9e67f22b0c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:00.140633 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-670c5c61-41ab-4617-9288-ad9e67f22b0c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:00.141344 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-670c5c61-41ab-4617-9288-ad9e67f22b0c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:00.142449 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-670c5c61-41ab-4617-9288-ad9e67f22b0c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:00.143443 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-670c5c61-41ab-4617-9288-ad9e67f22b0c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:00.319537 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-424258ff-8c0b-4880-9c37-5a4f0a363c74 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:00.320343 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-670c5c61-41ab-4617-9288-ad9e67f22b0c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:00.321578 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-424258ff-8c0b-4880-9c37-5a4f0a363c74 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] [instance: e2d4b4da-3b00-41c0-a0ac-21477f232931] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:00.329015 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-424258ff-8c0b-4880-9c37-5a4f0a363c74 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:00.329459 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-424258ff-8c0b-4880-9c37-5a4f0a363c74 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:00.330006 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-670c5c61-41ab-4617-9288-ad9e67f22b0c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:00.330222 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-424258ff-8c0b-4880-9c37-5a4f0a363c74 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:00.330650 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-424258ff-8c0b-4880-9c37-5a4f0a363c74 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:00.331508 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-670c5c61-41ab-4617-9288-ad9e67f22b0c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:00.332836 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-670c5c61-41ab-4617-9288-ad9e67f22b0c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1724 microversion: 2.20 time: 0.205402 May 24 15:22:00.333406 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 113/238] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:22:00 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1724 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:22:00.483781 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-424258ff-8c0b-4880-9c37-5a4f0a363c74 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b27ee7d15ca42bca6a09dd18751f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c8c75b264644b7af9831e14cbf7841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:00.495111 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-424258ff-8c0b-4880-9c37-5a4f0a363c74 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] 10.222.0.45 "GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931" status: 200 len: 1314 microversion: 2.1 time: 0.179864 May 24 15:22:00.504508 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 126/239] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:00 2022] GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:22:00.676529 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-83ff968d-d4b0-4038-af48-db343a1300e4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:00.677153 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-83ff968d-d4b0-4038-af48-db343a1300e4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:00.683707 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-83ff968d-d4b0-4038-af48-db343a1300e4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:00.684561 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-83ff968d-d4b0-4038-af48-db343a1300e4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:00.685654 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-83ff968d-d4b0-4038-af48-db343a1300e4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:00.686177 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-83ff968d-d4b0-4038-af48-db343a1300e4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:00.832770 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-83ff968d-d4b0-4038-af48-db343a1300e4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:00.841692 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-83ff968d-d4b0-4038-af48-db343a1300e4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1357 microversion: 2.1 time: 0.168992 May 24 15:22:00.842460 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 114/240] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:00 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:01.351144 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-edffd463-5a2a-418e-8759-e8bd513f745d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:01.351735 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-edffd463-5a2a-418e-8759-e8bd513f745d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:01.359176 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-edffd463-5a2a-418e-8759-e8bd513f745d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:01.359616 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-edffd463-5a2a-418e-8759-e8bd513f745d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:01.360451 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-edffd463-5a2a-418e-8759-e8bd513f745d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:01.360878 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-edffd463-5a2a-418e-8759-e8bd513f745d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:01.511467 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-c599d30c-02b1-462a-bf6f-143f82ff5d97 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:01.512237 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-c599d30c-02b1-462a-bf6f-143f82ff5d97 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] [instance: e2d4b4da-3b00-41c0-a0ac-21477f232931] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:01.513548 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-edffd463-5a2a-418e-8759-e8bd513f745d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:01.526797 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-edffd463-5a2a-418e-8759-e8bd513f745d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:01.526995 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c599d30c-02b1-462a-bf6f-143f82ff5d97 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:01.527445 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c599d30c-02b1-462a-bf6f-143f82ff5d97 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:01.532124 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-edffd463-5a2a-418e-8759-e8bd513f745d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:01.532366 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c599d30c-02b1-462a-bf6f-143f82ff5d97 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:01.532661 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c599d30c-02b1-462a-bf6f-143f82ff5d97 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:01.533377 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-edffd463-5a2a-418e-8759-e8bd513f745d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1724 microversion: 2.20 time: 0.186256 May 24 15:22:01.536543 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 127/241] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:22:01 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:22:01.727075 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-c599d30c-02b1-462a-bf6f-143f82ff5d97 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b27ee7d15ca42bca6a09dd18751f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c8c75b264644b7af9831e14cbf7841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:01.737427 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-c599d30c-02b1-462a-bf6f-143f82ff5d97 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] 10.222.0.45 "GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931" status: 200 len: 1314 microversion: 2.1 time: 0.229625 May 24 15:22:01.738807 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 115/242] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:01 2022] GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:22:01.859784 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-1e8ffdcc-f74f-46e6-9674-6aca59fbcc73 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:01.860335 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-1e8ffdcc-f74f-46e6-9674-6aca59fbcc73 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:01.866479 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1e8ffdcc-f74f-46e6-9674-6aca59fbcc73 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:01.866926 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1e8ffdcc-f74f-46e6-9674-6aca59fbcc73 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:01.867692 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1e8ffdcc-f74f-46e6-9674-6aca59fbcc73 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:01.868131 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1e8ffdcc-f74f-46e6-9674-6aca59fbcc73 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:02.006693 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-1e8ffdcc-f74f-46e6-9674-6aca59fbcc73 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:02.014220 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-1e8ffdcc-f74f-46e6-9674-6aca59fbcc73 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1357 microversion: 2.1 time: 0.159201 May 24 15:22:02.014783 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 128/243] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:01 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:02.554233 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-3eefa804-bd0d-424a-b86c-7abb5300ad66 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:02.555399 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-3eefa804-bd0d-424a-b86c-7abb5300ad66 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:02.563774 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3eefa804-bd0d-424a-b86c-7abb5300ad66 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:02.570290 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3eefa804-bd0d-424a-b86c-7abb5300ad66 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:02.571168 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3eefa804-bd0d-424a-b86c-7abb5300ad66 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:02.571591 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3eefa804-bd0d-424a-b86c-7abb5300ad66 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:02.572058 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell0:SELECT=12 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:22:02.755015 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c5c8a627-13fc-427f-8195-9643865bec0a tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:02.755992 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-c5c8a627-13fc-427f-8195-9643865bec0a tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] [instance: e2d4b4da-3b00-41c0-a0ac-21477f232931] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:02.759213 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-3eefa804-bd0d-424a-b86c-7abb5300ad66 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:02.762485 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell0:SELECT=2 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:22:02.763529 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell0:SELECT=8 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:22:02.766372 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c5c8a627-13fc-427f-8195-9643865bec0a tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:02.766907 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c5c8a627-13fc-427f-8195-9643865bec0a tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:02.768002 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-3eefa804-bd0d-424a-b86c-7abb5300ad66 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:02.768135 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c5c8a627-13fc-427f-8195-9643865bec0a tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:02.768553 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c5c8a627-13fc-427f-8195-9643865bec0a tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:02.770420 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-3eefa804-bd0d-424a-b86c-7abb5300ad66 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:02.771758 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-3eefa804-bd0d-424a-b86c-7abb5300ad66 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1724 microversion: 2.20 time: 0.221899 May 24 15:22:02.780456 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 116/244] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:22:02 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1724 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:22:02.910313 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-c5c8a627-13fc-427f-8195-9643865bec0a tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b27ee7d15ca42bca6a09dd18751f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c8c75b264644b7af9831e14cbf7841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:02.920570 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-c5c8a627-13fc-427f-8195-9643865bec0a tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] 10.222.0.45 "GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931" status: 200 len: 1314 microversion: 2.1 time: 0.169428 May 24 15:22:02.921153 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 129/245] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:02 2022] GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:03.032426 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-3fb6b718-40fa-474d-b5bc-4f8c738b4617 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:03.033048 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-3fb6b718-40fa-474d-b5bc-4f8c738b4617 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:03.039418 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3fb6b718-40fa-474d-b5bc-4f8c738b4617 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:03.039858 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3fb6b718-40fa-474d-b5bc-4f8c738b4617 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:03.040645 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3fb6b718-40fa-474d-b5bc-4f8c738b4617 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:03.041072 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3fb6b718-40fa-474d-b5bc-4f8c738b4617 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:03.202012 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [req-d31e4bfa-30d8-4275-a4e5-9f1aed250348 req-584d88ef-b6d4-4793-8976-61ebfe3215c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2d4b4da-3b00-41c0-a0ac-21477f232931", "name": "network-vif-plugged", "status": "completed", "tag": "696a99fb-5587-4eb6-9451-4255b6f05a8b"}]} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:22:03.217224 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-d31e4bfa-30d8-4275-a4e5-9f1aed250348 req-584d88ef-b6d4-4793-8976-61ebfe3215c7 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:03.217665 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-d31e4bfa-30d8-4275-a4e5-9f1aed250348 req-584d88ef-b6d4-4793-8976-61ebfe3215c7 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:03.219070 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-3fb6b718-40fa-474d-b5bc-4f8c738b4617 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:03.229791 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-3fb6b718-40fa-474d-b5bc-4f8c738b4617 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1357 microversion: 2.1 time: 0.201364 May 24 15:22:03.241904 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 117/246] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:03 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1357 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:03.262634 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.compute.server_external_events [req-d31e4bfa-30d8-4275-a4e5-9f1aed250348 req-584d88ef-b6d4-4793-8976-61ebfe3215c7 service nova] Creating event network-vif-plugged:696a99fb-5587-4eb6-9451-4255b6f05a8b for instance e2d4b4da-3b00-41c0-a0ac-21477f232931 on hv-cinder-84315 May 24 15:22:03.274696 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [req-d31e4bfa-30d8-4275-a4e5-9f1aed250348 req-584d88ef-b6d4-4793-8976-61ebfe3215c7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076851 May 24 15:22:03.275307 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 130/247] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:22:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:22:03.791363 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-280dedb3-bd1b-48d2-bc92-508e249ccdb1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:03.792600 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-280dedb3-bd1b-48d2-bc92-508e249ccdb1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:03.799705 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-280dedb3-bd1b-48d2-bc92-508e249ccdb1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:03.805773 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-280dedb3-bd1b-48d2-bc92-508e249ccdb1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:03.805773 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-280dedb3-bd1b-48d2-bc92-508e249ccdb1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:03.805773 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-280dedb3-bd1b-48d2-bc92-508e249ccdb1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:03.940467 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e565202f-a32a-4602-b406-a5cfcf8f8650 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:03.941943 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e565202f-a32a-4602-b406-a5cfcf8f8650 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] [instance: e2d4b4da-3b00-41c0-a0ac-21477f232931] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:03.943975 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-280dedb3-bd1b-48d2-bc92-508e249ccdb1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:03.950590 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e565202f-a32a-4602-b406-a5cfcf8f8650 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:03.951043 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e565202f-a32a-4602-b406-a5cfcf8f8650 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:03.951820 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e565202f-a32a-4602-b406-a5cfcf8f8650 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:03.952251 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e565202f-a32a-4602-b406-a5cfcf8f8650 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:03.952956 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-280dedb3-bd1b-48d2-bc92-508e249ccdb1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:03.954497 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-280dedb3-bd1b-48d2-bc92-508e249ccdb1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:03.955661 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-280dedb3-bd1b-48d2-bc92-508e249ccdb1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1724 microversion: 2.20 time: 0.168420 May 24 15:22:03.956474 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 118/248] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:22:03 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:22:04.090513 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e565202f-a32a-4602-b406-a5cfcf8f8650 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b27ee7d15ca42bca6a09dd18751f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c8c75b264644b7af9831e14cbf7841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:04.099508 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e565202f-a32a-4602-b406-a5cfcf8f8650 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] 10.222.0.45 "GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931" status: 200 len: 1314 microversion: 2.1 time: 0.164861 May 24 15:22:04.105919 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 131/249] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:03 2022] GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:22:04.250028 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-ce599734-7f23-425c-9f69-a4da7695256c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:04.250687 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-ce599734-7f23-425c-9f69-a4da7695256c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:04.257755 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ce599734-7f23-425c-9f69-a4da7695256c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:04.258196 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ce599734-7f23-425c-9f69-a4da7695256c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:04.258966 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ce599734-7f23-425c-9f69-a4da7695256c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:04.259397 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ce599734-7f23-425c-9f69-a4da7695256c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:04.409735 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-ce599734-7f23-425c-9f69-a4da7695256c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:04.417105 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-ce599734-7f23-425c-9f69-a4da7695256c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1357 microversion: 2.1 time: 0.172026 May 24 15:22:04.417665 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 119/250] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:04 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:04.787792 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-3587ae17-d1b1-4cfe-8ed1-0da57dc1729d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Action: 'create', calling method: .version_select at 0x7f2dd278daf0>, body: {"keypair": {"name": "tempest-keypair-1306177571", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWaZuFPdNmUeKIfT8nE3YEDqfgnyMFMLGgDTcVUWxPA+q9AsFET2DRH1wi/6q8mzFrkkqlUTdo3HpbLSzZ4AI41hOxlHrdRRgN3eeRQXpNARxHhCxEuzYOM1InMwf42Qw=="}} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:22:04.802383 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.quota [None req-3587ae17-d1b1-4cfe-8ed1-0da57dc1729d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Getting quotas for project e8d86717f1954ab7a59cdef0cf13556c. Resources: {'key_pairs'} {{(pid=117698) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 15:22:04.807019 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.quota [None req-3587ae17-d1b1-4cfe-8ed1-0da57dc1729d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Getting quotas for user 2d8a7414fd254ec981d35b417dc373cd and project e8d86717f1954ab7a59cdef0cf13556c. Resources: {'key_pairs'} {{(pid=117698) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 15:22:04.835990 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-3587ae17-d1b1-4cfe-8ed1-0da57dc1729d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052352 May 24 15:22:04.842382 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 132/251] 10.222.0.45 () {60 vars in 1158 bytes} [Tue May 24 15:22:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:22:04.975753 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-4b39d796-2a4e-4b0c-a648-8c11265b3db2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:04.977904 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-4b39d796-2a4e-4b0c-a648-8c11265b3db2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:04.986091 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4b39d796-2a4e-4b0c-a648-8c11265b3db2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:04.986798 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4b39d796-2a4e-4b0c-a648-8c11265b3db2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:04.987785 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4b39d796-2a4e-4b0c-a648-8c11265b3db2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:04.988453 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4b39d796-2a4e-4b0c-a648-8c11265b3db2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:05.117597 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-1117f6c6-9506-4043-80d2-94a95ade456b tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:05.118257 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-1117f6c6-9506-4043-80d2-94a95ade456b tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] [instance: e2d4b4da-3b00-41c0-a0ac-21477f232931] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:05.125633 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1117f6c6-9506-4043-80d2-94a95ade456b tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:05.126359 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1117f6c6-9506-4043-80d2-94a95ade456b tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:05.127309 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1117f6c6-9506-4043-80d2-94a95ade456b tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:05.127790 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1117f6c6-9506-4043-80d2-94a95ade456b tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:05.254551 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-4b39d796-2a4e-4b0c-a648-8c11265b3db2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:05.265916 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-4b39d796-2a4e-4b0c-a648-8c11265b3db2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:05.267666 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-4b39d796-2a4e-4b0c-a648-8c11265b3db2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:05.271958 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-4b39d796-2a4e-4b0c-a648-8c11265b3db2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1724 microversion: 2.20 time: 0.298944 May 24 15:22:05.280125 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 120/252] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:22:04 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1724 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:22:05.295526 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-1117f6c6-9506-4043-80d2-94a95ade456b tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b27ee7d15ca42bca6a09dd18751f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c8c75b264644b7af9831e14cbf7841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:05.304437 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-1117f6c6-9506-4043-80d2-94a95ade456b tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] 10.222.0.45 "GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931" status: 200 len: 1314 microversion: 2.1 time: 0.190737 May 24 15:22:05.305272 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 133/253] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:05 2022] GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:22:05.441837 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-5f84adfb-5dbc-4b98-922b-98c5a21da2cf tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:05.442550 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-5f84adfb-5dbc-4b98-922b-98c5a21da2cf tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:05.451555 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5f84adfb-5dbc-4b98-922b-98c5a21da2cf tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:05.454407 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5f84adfb-5dbc-4b98-922b-98c5a21da2cf tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:05.455286 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5f84adfb-5dbc-4b98-922b-98c5a21da2cf tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:05.460940 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5f84adfb-5dbc-4b98-922b-98c5a21da2cf tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:05.720233 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-5f84adfb-5dbc-4b98-922b-98c5a21da2cf tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:05.728115 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-5f84adfb-5dbc-4b98-922b-98c5a21da2cf tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1357 microversion: 2.1 time: 0.291218 May 24 15:22:05.740185 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 121/254] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:05 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1357 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:06.287001 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-86e3668d-01a9-4bcd-aba6-96bdacedae48 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:06.287615 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-86e3668d-01a9-4bcd-aba6-96bdacedae48 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:06.294211 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-86e3668d-01a9-4bcd-aba6-96bdacedae48 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:06.294761 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-86e3668d-01a9-4bcd-aba6-96bdacedae48 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:06.295600 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-86e3668d-01a9-4bcd-aba6-96bdacedae48 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:06.296108 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-86e3668d-01a9-4bcd-aba6-96bdacedae48 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:06.322462 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-da2f7b5c-34d2-479d-8917-2dd814db5697 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:06.323079 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-da2f7b5c-34d2-479d-8917-2dd814db5697 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] [instance: e2d4b4da-3b00-41c0-a0ac-21477f232931] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:06.346331 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-da2f7b5c-34d2-479d-8917-2dd814db5697 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:06.347236 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-da2f7b5c-34d2-479d-8917-2dd814db5697 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:06.348174 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-da2f7b5c-34d2-479d-8917-2dd814db5697 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:06.348789 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-da2f7b5c-34d2-479d-8917-2dd814db5697 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:06.467082 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-86e3668d-01a9-4bcd-aba6-96bdacedae48 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:06.478157 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-86e3668d-01a9-4bcd-aba6-96bdacedae48 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:06.480293 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-86e3668d-01a9-4bcd-aba6-96bdacedae48 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:06.483882 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-86e3668d-01a9-4bcd-aba6-96bdacedae48 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1724 microversion: 2.20 time: 0.199709 May 24 15:22:06.484945 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 134/255] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:22:06 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1724 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:22:06.493949 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-da2f7b5c-34d2-479d-8917-2dd814db5697 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b27ee7d15ca42bca6a09dd18751f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c8c75b264644b7af9831e14cbf7841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:06.502153 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-da2f7b5c-34d2-479d-8917-2dd814db5697 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] 10.222.0.45 "GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931" status: 200 len: 1314 microversion: 2.1 time: 0.183899 May 24 15:22:06.502721 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 122/256] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:06 2022] GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:06.505608 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-071dae3c-31bd-4b86-8801-f9f5779fdd5f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-140915172", "imageRef": "f921f75e-bbd1-4d99-ab1e-5cce2d895148", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "80d9590c-ed37-4e01-9bdc-105e40ccc4fc"}], "security_groups": [{"name": "tempest-securitygroup--1294473241"}], "key_name": "tempest-keypair-1306177571", "user_data": "}} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:22:06.601904 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.network.neutron [None req-071dae3c-31bd-4b86-8801-f9f5779fdd5f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] validate_networks() for [('80d9590c-ed37-4e01-9bdc-105e40ccc4fc', None, None, None, None, None)] {{(pid=117698) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 15:22:06.747097 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-991b8775-a298-4771-a31e-63cc7466cc1b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:06.748022 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-991b8775-a298-4771-a31e-63cc7466cc1b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:06.754551 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-991b8775-a298-4771-a31e-63cc7466cc1b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:06.755137 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-991b8775-a298-4771-a31e-63cc7466cc1b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:06.755999 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-991b8775-a298-4771-a31e-63cc7466cc1b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:06.756735 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-991b8775-a298-4771-a31e-63cc7466cc1b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:06.904879 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-991b8775-a298-4771-a31e-63cc7466cc1b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:06.912241 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-991b8775-a298-4771-a31e-63cc7466cc1b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1357 microversion: 2.1 time: 0.169081 May 24 15:22:06.912839 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 123/257] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:06 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:22:06.988523 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.virt.hardware [None req-071dae3c-31bd-4b86-8801-f9f5779fdd5f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Flavor limits 0:0:0 {{(pid=117698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 15:22:06.988941 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.virt.hardware [None req-071dae3c-31bd-4b86-8801-f9f5779fdd5f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Image limits 0:0:0 {{(pid=117698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 15:22:06.989407 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.virt.hardware [None req-071dae3c-31bd-4b86-8801-f9f5779fdd5f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Flavor pref 0:0:0 {{(pid=117698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 15:22:06.989807 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.virt.hardware [None req-071dae3c-31bd-4b86-8801-f9f5779fdd5f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Image pref 0:0:0 {{(pid=117698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 15:22:06.990210 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.virt.hardware [None req-071dae3c-31bd-4b86-8801-f9f5779fdd5f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 15:22:07.000493 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-071dae3c-31bd-4b86-8801-f9f5779fdd5f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:07.000928 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-071dae3c-31bd-4b86-8801-f9f5779fdd5f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:07.001738 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-071dae3c-31bd-4b86-8801-f9f5779fdd5f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:07.002165 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-071dae3c-31bd-4b86-8801-f9f5779fdd5f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:07.018926 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.quota [None req-071dae3c-31bd-4b86-8801-f9f5779fdd5f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Getting quotas for project e8d86717f1954ab7a59cdef0cf13556c. Resources: {'instances', 'ram', 'cores'} {{(pid=117698) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 15:22:07.022927 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.quota [None req-071dae3c-31bd-4b86-8801-f9f5779fdd5f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Getting quotas for user 2d8a7414fd254ec981d35b417dc373cd and project e8d86717f1954ab7a59cdef0cf13556c. Resources: {'instances', 'ram', 'cores'} {{(pid=117698) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 15:22:07.034335 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-071dae3c-31bd-4b86-8801-f9f5779fdd5f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Going to run 1 instances... {{(pid=117698) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 15:22:07.037215 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-071dae3c-31bd-4b86-8801-f9f5779fdd5f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f921f75e-bbd1-4d99-ab1e-5cce2d895148',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 15:22:07.086090 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-071dae3c-31bd-4b86-8801-f9f5779fdd5f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.584753 May 24 15:22:07.086718 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 135/258] 10.222.0.45 () {60 vars in 1146 bytes} [Tue May 24 15:22:06 2022] POST /compute/v2.1/servers => generated 409 bytes in 586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 15:22:07.096348 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-37745466-f2f1-4e0d-95f4-89ca99a03803 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:07.096957 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-37745466-f2f1-4e0d-95f4-89ca99a03803 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:07.148855 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-37745466-f2f1-4e0d-95f4-89ca99a03803 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:07.155521 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-37745466-f2f1-4e0d-95f4-89ca99a03803 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1245 microversion: 2.1 time: 0.062946 May 24 15:22:07.156077 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 124/259] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:07 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1245 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:07.503487 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-b2acd5c1-0b28-47a1-ac65-851058943fd2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:07.504092 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-b2acd5c1-0b28-47a1-ac65-851058943fd2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:07.510652 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b2acd5c1-0b28-47a1-ac65-851058943fd2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:07.511099 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b2acd5c1-0b28-47a1-ac65-851058943fd2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:07.511855 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b2acd5c1-0b28-47a1-ac65-851058943fd2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:07.512290 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b2acd5c1-0b28-47a1-ac65-851058943fd2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:07.518475 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-b02ea366-5260-4edb-b952-8db9c5e158e1 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:07.519103 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-b02ea366-5260-4edb-b952-8db9c5e158e1 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] [instance: e2d4b4da-3b00-41c0-a0ac-21477f232931] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:07.524985 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b02ea366-5260-4edb-b952-8db9c5e158e1 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:07.525427 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b02ea366-5260-4edb-b952-8db9c5e158e1 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:07.526170 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b02ea366-5260-4edb-b952-8db9c5e158e1 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:07.526594 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b02ea366-5260-4edb-b952-8db9c5e158e1 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:07.640885 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-b2acd5c1-0b28-47a1-ac65-851058943fd2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:07.648878 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-b2acd5c1-0b28-47a1-ac65-851058943fd2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:07.650653 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-b2acd5c1-0b28-47a1-ac65-851058943fd2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:07.651847 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-b2acd5c1-0b28-47a1-ac65-851058943fd2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1724 microversion: 2.20 time: 0.152809 May 24 15:22:07.652338 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-b02ea366-5260-4edb-b952-8db9c5e158e1 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b27ee7d15ca42bca6a09dd18751f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c8c75b264644b7af9831e14cbf7841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:07.652495 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 136/260] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:22:07 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:22:07.659796 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-b02ea366-5260-4edb-b952-8db9c5e158e1 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] 10.222.0.45 "GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931" status: 200 len: 1314 microversion: 2.1 time: 0.145193 May 24 15:22:07.660474 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 125/261] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:07 2022] GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:22:07.928786 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-1b266de3-b728-4818-9d1c-5e7fa0e0020c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:07.929352 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-1b266de3-b728-4818-9d1c-5e7fa0e0020c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:07.935304 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1b266de3-b728-4818-9d1c-5e7fa0e0020c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:07.935751 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1b266de3-b728-4818-9d1c-5e7fa0e0020c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:07.936537 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1b266de3-b728-4818-9d1c-5e7fa0e0020c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:07.936973 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1b266de3-b728-4818-9d1c-5e7fa0e0020c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:08.064480 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-1b266de3-b728-4818-9d1c-5e7fa0e0020c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:08.072106 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-1b266de3-b728-4818-9d1c-5e7fa0e0020c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1357 microversion: 2.1 time: 0.147179 May 24 15:22:08.072712 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 137/262] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:07 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1357 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:08.172220 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f8343ba2-887b-4fef-ab12-2fc312cc30a3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:08.172851 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f8343ba2-887b-4fef-ab12-2fc312cc30a3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:08.176138 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:22:08.179916 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f8343ba2-887b-4fef-ab12-2fc312cc30a3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:08.180314 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f8343ba2-887b-4fef-ab12-2fc312cc30a3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:08.181065 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f8343ba2-887b-4fef-ab12-2fc312cc30a3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:08.181491 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f8343ba2-887b-4fef-ab12-2fc312cc30a3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:08.243537 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-f8343ba2-887b-4fef-ab12-2fc312cc30a3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:08.246893 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:22:08.251555 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f8343ba2-887b-4fef-ab12-2fc312cc30a3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1249 microversion: 2.1 time: 0.083149 May 24 15:22:08.252111 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 126/263] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:08 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1249 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:08.670003 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-923fc7e1-d6fe-461e-8590-f8418d27fa0a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:08.670610 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-923fc7e1-d6fe-461e-8590-f8418d27fa0a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:08.676762 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-4e45a095-b42a-4a14-a97b-d42532d78b73 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:08.677170 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-923fc7e1-d6fe-461e-8590-f8418d27fa0a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:08.677493 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-4e45a095-b42a-4a14-a97b-d42532d78b73 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] [instance: e2d4b4da-3b00-41c0-a0ac-21477f232931] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:08.677593 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-923fc7e1-d6fe-461e-8590-f8418d27fa0a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:08.678310 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-923fc7e1-d6fe-461e-8590-f8418d27fa0a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:08.678740 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-923fc7e1-d6fe-461e-8590-f8418d27fa0a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:08.683376 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4e45a095-b42a-4a14-a97b-d42532d78b73 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:08.683824 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4e45a095-b42a-4a14-a97b-d42532d78b73 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:08.685109 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4e45a095-b42a-4a14-a97b-d42532d78b73 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:08.685544 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4e45a095-b42a-4a14-a97b-d42532d78b73 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:08.812361 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-923fc7e1-d6fe-461e-8590-f8418d27fa0a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:08.812690 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-4e45a095-b42a-4a14-a97b-d42532d78b73 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b27ee7d15ca42bca6a09dd18751f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c8c75b264644b7af9831e14cbf7841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:08.814693 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:22:08.822877 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-4e45a095-b42a-4a14-a97b-d42532d78b73 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] 10.222.0.45 "GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931" status: 200 len: 1314 microversion: 2.1 time: 0.149972 May 24 15:22:08.823752 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 127/264] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:08 2022] GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:22:08.824976 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-923fc7e1-d6fe-461e-8590-f8418d27fa0a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:08.826974 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-923fc7e1-d6fe-461e-8590-f8418d27fa0a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:08.828475 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-923fc7e1-d6fe-461e-8590-f8418d27fa0a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1724 microversion: 2.20 time: 0.162330 May 24 15:22:08.829188 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 138/265] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:22:08 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:22:09.089227 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-6aef60a7-4cce-4b5f-954b-07f0e731280c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:09.090051 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-6aef60a7-4cce-4b5f-954b-07f0e731280c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:09.096541 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6aef60a7-4cce-4b5f-954b-07f0e731280c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:09.097024 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6aef60a7-4cce-4b5f-954b-07f0e731280c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:09.097807 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6aef60a7-4cce-4b5f-954b-07f0e731280c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:09.098235 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6aef60a7-4cce-4b5f-954b-07f0e731280c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:09.225656 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-6aef60a7-4cce-4b5f-954b-07f0e731280c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:09.233763 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-6aef60a7-4cce-4b5f-954b-07f0e731280c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1357 microversion: 2.1 time: 0.148746 May 24 15:22:09.234331 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 128/266] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:09 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:09.267987 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-6c442db8-76a5-426f-b376-2a4a8300f654 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:09.268615 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-6c442db8-76a5-426f-b376-2a4a8300f654 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:09.274472 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6c442db8-76a5-426f-b376-2a4a8300f654 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:09.274914 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6c442db8-76a5-426f-b376-2a4a8300f654 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:09.275658 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6c442db8-76a5-426f-b376-2a4a8300f654 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:09.276086 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6c442db8-76a5-426f-b376-2a4a8300f654 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:09.334701 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-6c442db8-76a5-426f-b376-2a4a8300f654 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:09.342996 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-6c442db8-76a5-426f-b376-2a4a8300f654 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1249 microversion: 2.1 time: 0.078801 May 24 15:22:09.343633 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 139/267] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:09 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1249 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:09.840389 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-cabd9511-d613-43b5-808f-05ecedb6f537 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:09.841940 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-cabd9511-d613-43b5-808f-05ecedb6f537 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] [instance: e2d4b4da-3b00-41c0-a0ac-21477f232931] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:09.847789 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-1d1a0879-4c60-4879-8b08-59e7c9e2b76f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:09.848652 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-1d1a0879-4c60-4879-8b08-59e7c9e2b76f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:09.850082 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cabd9511-d613-43b5-808f-05ecedb6f537 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:09.850608 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cabd9511-d613-43b5-808f-05ecedb6f537 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:09.851396 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cabd9511-d613-43b5-808f-05ecedb6f537 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:09.851837 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cabd9511-d613-43b5-808f-05ecedb6f537 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:09.859648 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1d1a0879-4c60-4879-8b08-59e7c9e2b76f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:09.860851 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1d1a0879-4c60-4879-8b08-59e7c9e2b76f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:09.861557 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1d1a0879-4c60-4879-8b08-59e7c9e2b76f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:09.861997 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1d1a0879-4c60-4879-8b08-59e7c9e2b76f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:09.998218 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-cabd9511-d613-43b5-808f-05ecedb6f537 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b27ee7d15ca42bca6a09dd18751f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c8c75b264644b7af9831e14cbf7841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:10.009061 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-cabd9511-d613-43b5-808f-05ecedb6f537 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] 10.222.0.45 "GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931" status: 200 len: 1314 microversion: 2.1 time: 0.172175 May 24 15:22:10.010260 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-1d1a0879-4c60-4879-8b08-59e7c9e2b76f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:10.011287 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 129/268] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:09 2022] GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:10.019636 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-1d1a0879-4c60-4879-8b08-59e7c9e2b76f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:10.021360 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-1d1a0879-4c60-4879-8b08-59e7c9e2b76f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:10.022518 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-1d1a0879-4c60-4879-8b08-59e7c9e2b76f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1724 microversion: 2.20 time: 0.178933 May 24 15:22:10.023075 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 140/269] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:22:09 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:22:10.251410 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-c3d51e0d-5509-439c-8e40-32eb5bea5857 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:10.252128 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-c3d51e0d-5509-439c-8e40-32eb5bea5857 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:10.265439 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c3d51e0d-5509-439c-8e40-32eb5bea5857 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:10.266078 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c3d51e0d-5509-439c-8e40-32eb5bea5857 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:10.267046 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c3d51e0d-5509-439c-8e40-32eb5bea5857 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:10.267494 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c3d51e0d-5509-439c-8e40-32eb5bea5857 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:10.359662 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-7ec39a83-c544-476f-bb04-30ad356d4766 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:10.360532 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-7ec39a83-c544-476f-bb04-30ad356d4766 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:10.366823 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7ec39a83-c544-476f-bb04-30ad356d4766 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:10.367414 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7ec39a83-c544-476f-bb04-30ad356d4766 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:10.368293 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7ec39a83-c544-476f-bb04-30ad356d4766 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:10.368770 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7ec39a83-c544-476f-bb04-30ad356d4766 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:10.415133 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-c3d51e0d-5509-439c-8e40-32eb5bea5857 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:10.423524 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-c3d51e0d-5509-439c-8e40-32eb5bea5857 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1357 microversion: 2.1 time: 0.176677 May 24 15:22:10.432429 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 130/270] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:10 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1357 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:22:10.432872 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-7ec39a83-c544-476f-bb04-30ad356d4766 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:10.440128 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-7ec39a83-c544-476f-bb04-30ad356d4766 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1249 microversion: 2.1 time: 0.085019 May 24 15:22:10.440793 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 141/271] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:10 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1249 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:22:11.036151 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-787c4a5f-63b0-4de3-b695-c1294e0e39c2 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:11.036813 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-787c4a5f-63b0-4de3-b695-c1294e0e39c2 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] [instance: e2d4b4da-3b00-41c0-a0ac-21477f232931] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:11.042857 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-7a6ae7d3-a06d-4efd-a165-e427d5ae68de tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:11.044605 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-7a6ae7d3-a06d-4efd-a165-e427d5ae68de tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:11.045179 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-787c4a5f-63b0-4de3-b695-c1294e0e39c2 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:11.045980 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-787c4a5f-63b0-4de3-b695-c1294e0e39c2 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:11.046468 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-787c4a5f-63b0-4de3-b695-c1294e0e39c2 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:11.046912 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-787c4a5f-63b0-4de3-b695-c1294e0e39c2 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:11.052651 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7a6ae7d3-a06d-4efd-a165-e427d5ae68de tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:11.053101 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7a6ae7d3-a06d-4efd-a165-e427d5ae68de tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:11.053868 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7a6ae7d3-a06d-4efd-a165-e427d5ae68de tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:11.054295 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7a6ae7d3-a06d-4efd-a165-e427d5ae68de tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:11.177957 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-787c4a5f-63b0-4de3-b695-c1294e0e39c2 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b27ee7d15ca42bca6a09dd18751f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c8c75b264644b7af9831e14cbf7841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:11.184688 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-7a6ae7d3-a06d-4efd-a165-e427d5ae68de tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:11.185567 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-787c4a5f-63b0-4de3-b695-c1294e0e39c2 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] 10.222.0.45 "GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931" status: 200 len: 1314 microversion: 2.1 time: 0.160461 May 24 15:22:11.186142 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 131/272] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:11 2022] GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:11.192653 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-7a6ae7d3-a06d-4efd-a165-e427d5ae68de tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:11.194135 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-7a6ae7d3-a06d-4efd-a165-e427d5ae68de tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:11.195270 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-7a6ae7d3-a06d-4efd-a165-e427d5ae68de tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1724 microversion: 2.20 time: 0.157619 May 24 15:22:11.195814 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 142/273] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:22:11 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:22:11.440554 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e0f511e3-1ecf-492f-86ce-039fb0a1fbc7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:11.441361 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-e0f511e3-1ecf-492f-86ce-039fb0a1fbc7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:11.447741 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e0f511e3-1ecf-492f-86ce-039fb0a1fbc7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:11.448191 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e0f511e3-1ecf-492f-86ce-039fb0a1fbc7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:11.448992 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e0f511e3-1ecf-492f-86ce-039fb0a1fbc7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:11.449460 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e0f511e3-1ecf-492f-86ce-039fb0a1fbc7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:11.457637 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-f1c70fef-d5d7-4fe5-92a5-b8b9328221c6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:11.459132 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-f1c70fef-d5d7-4fe5-92a5-b8b9328221c6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:11.466870 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f1c70fef-d5d7-4fe5-92a5-b8b9328221c6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:11.468030 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f1c70fef-d5d7-4fe5-92a5-b8b9328221c6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:11.469094 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f1c70fef-d5d7-4fe5-92a5-b8b9328221c6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:11.469970 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f1c70fef-d5d7-4fe5-92a5-b8b9328221c6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:11.550206 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-f1c70fef-d5d7-4fe5-92a5-b8b9328221c6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:11.558241 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-f1c70fef-d5d7-4fe5-92a5-b8b9328221c6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1249 microversion: 2.1 time: 0.105281 May 24 15:22:11.558906 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 143/274] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:11 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1249 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:22:11.583715 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-e0f511e3-1ecf-492f-86ce-039fb0a1fbc7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:11.592199 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-e0f511e3-1ecf-492f-86ce-039fb0a1fbc7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1357 microversion: 2.1 time: 0.155907 May 24 15:22:11.592806 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 132/275] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:11 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:12.202419 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e294e531-7a34-44c4-9b2d-6a2c6af7d50c tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:12.203143 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e294e531-7a34-44c4-9b2d-6a2c6af7d50c tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] [instance: e2d4b4da-3b00-41c0-a0ac-21477f232931] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:12.212605 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e294e531-7a34-44c4-9b2d-6a2c6af7d50c tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:12.213057 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e294e531-7a34-44c4-9b2d-6a2c6af7d50c tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:12.214116 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e294e531-7a34-44c4-9b2d-6a2c6af7d50c tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:12.214206 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-66ac16ea-d3fd-475d-a161-8c6e3dd9317f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:12.214592 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e294e531-7a34-44c4-9b2d-6a2c6af7d50c tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:12.214779 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-66ac16ea-d3fd-475d-a161-8c6e3dd9317f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:12.221355 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-66ac16ea-d3fd-475d-a161-8c6e3dd9317f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:12.221807 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-66ac16ea-d3fd-475d-a161-8c6e3dd9317f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:12.222583 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-66ac16ea-d3fd-475d-a161-8c6e3dd9317f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:12.223011 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-66ac16ea-d3fd-475d-a161-8c6e3dd9317f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:12.372220 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e294e531-7a34-44c4-9b2d-6a2c6af7d50c tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b27ee7d15ca42bca6a09dd18751f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c8c75b264644b7af9831e14cbf7841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:12.377784 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-66ac16ea-d3fd-475d-a161-8c6e3dd9317f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:12.380924 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e294e531-7a34-44c4-9b2d-6a2c6af7d50c tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] 10.222.0.45 "GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931" status: 200 len: 1314 microversion: 2.1 time: 0.183160 May 24 15:22:12.391327 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-66ac16ea-d3fd-475d-a161-8c6e3dd9317f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:12.391327 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-66ac16ea-d3fd-475d-a161-8c6e3dd9317f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:12.391327 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-66ac16ea-d3fd-475d-a161-8c6e3dd9317f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1724 microversion: 2.20 time: 0.181259 May 24 15:22:12.392257 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 133/276] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:22:12 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:22:12.393334 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 144/277] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:12 2022] GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:12.575624 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d8c3862a-c4a5-4b5c-910a-00c02ab0815b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:12.576410 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d8c3862a-c4a5-4b5c-910a-00c02ab0815b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:12.583316 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d8c3862a-c4a5-4b5c-910a-00c02ab0815b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:12.583877 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d8c3862a-c4a5-4b5c-910a-00c02ab0815b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:12.584681 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d8c3862a-c4a5-4b5c-910a-00c02ab0815b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:12.585116 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d8c3862a-c4a5-4b5c-910a-00c02ab0815b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:12.610447 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-11b6ae31-08e0-4f71-99a7-3989e7eeab36 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:12.611058 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-11b6ae31-08e0-4f71-99a7-3989e7eeab36 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:12.617783 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-11b6ae31-08e0-4f71-99a7-3989e7eeab36 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:12.618236 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-11b6ae31-08e0-4f71-99a7-3989e7eeab36 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:12.619047 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-11b6ae31-08e0-4f71-99a7-3989e7eeab36 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:12.619476 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-11b6ae31-08e0-4f71-99a7-3989e7eeab36 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:12.754926 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-11b6ae31-08e0-4f71-99a7-3989e7eeab36 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:12.762726 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-11b6ae31-08e0-4f71-99a7-3989e7eeab36 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1357 microversion: 2.1 time: 0.156648 May 24 15:22:12.763228 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 145/278] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:12 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:22:12.774111 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-d8c3862a-c4a5-4b5c-910a-00c02ab0815b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:12.781855 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d8c3862a-c4a5-4b5c-910a-00c02ab0815b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1249 microversion: 2.1 time: 0.210695 May 24 15:22:12.791545 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 134/279] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:12 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1249 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:13.398619 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-22465d46-5c4e-42fb-882b-5be6c9449f07 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:13.399237 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-22465d46-5c4e-42fb-882b-5be6c9449f07 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] [instance: e2d4b4da-3b00-41c0-a0ac-21477f232931] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:13.405765 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-22465d46-5c4e-42fb-882b-5be6c9449f07 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:13.406217 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-22465d46-5c4e-42fb-882b-5be6c9449f07 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:13.406986 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-22465d46-5c4e-42fb-882b-5be6c9449f07 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:13.407432 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-22465d46-5c4e-42fb-882b-5be6c9449f07 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:13.409860 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-9808309f-c597-44eb-abdf-97c89d9b96c0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:13.410364 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-9808309f-c597-44eb-abdf-97c89d9b96c0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:13.416617 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9808309f-c597-44eb-abdf-97c89d9b96c0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:13.417126 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9808309f-c597-44eb-abdf-97c89d9b96c0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:13.417954 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9808309f-c597-44eb-abdf-97c89d9b96c0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:13.418450 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9808309f-c597-44eb-abdf-97c89d9b96c0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:13.539109 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-22465d46-5c4e-42fb-882b-5be6c9449f07 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b27ee7d15ca42bca6a09dd18751f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c8c75b264644b7af9831e14cbf7841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:13.546999 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-22465d46-5c4e-42fb-882b-5be6c9449f07 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] 10.222.0.45 "GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931" status: 200 len: 1314 microversion: 2.1 time: 0.152157 May 24 15:22:13.547564 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 146/280] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:13 2022] GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:13.551932 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-9808309f-c597-44eb-abdf-97c89d9b96c0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:13.560451 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-9808309f-c597-44eb-abdf-97c89d9b96c0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:13.561933 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-9808309f-c597-44eb-abdf-97c89d9b96c0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:13.563074 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-9808309f-c597-44eb-abdf-97c89d9b96c0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1724 microversion: 2.20 time: 0.157320 May 24 15:22:13.563619 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 135/281] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:22:13 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:22:13.779439 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-afbb5c5a-fe38-4c92-83fb-d7e871f0c957 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:13.780039 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-afbb5c5a-fe38-4c92-83fb-d7e871f0c957 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:13.788470 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-afbb5c5a-fe38-4c92-83fb-d7e871f0c957 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:13.788470 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-afbb5c5a-fe38-4c92-83fb-d7e871f0c957 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:13.788470 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-afbb5c5a-fe38-4c92-83fb-d7e871f0c957 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:13.788470 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-afbb5c5a-fe38-4c92-83fb-d7e871f0c957 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:13.799139 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-1407cbe4-9341-488d-b2c9-38f14a04f5f9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:13.799740 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-1407cbe4-9341-488d-b2c9-38f14a04f5f9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:13.806108 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1407cbe4-9341-488d-b2c9-38f14a04f5f9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:13.806548 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1407cbe4-9341-488d-b2c9-38f14a04f5f9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:13.807303 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1407cbe4-9341-488d-b2c9-38f14a04f5f9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:13.807729 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1407cbe4-9341-488d-b2c9-38f14a04f5f9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:13.867910 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-1407cbe4-9341-488d-b2c9-38f14a04f5f9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:13.876648 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-1407cbe4-9341-488d-b2c9-38f14a04f5f9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1249 microversion: 2.1 time: 0.081018 May 24 15:22:13.877230 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 136/282] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:13 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1249 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:22:14.119286 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-afbb5c5a-fe38-4c92-83fb-d7e871f0c957 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:14.126684 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-afbb5c5a-fe38-4c92-83fb-d7e871f0c957 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1357 microversion: 2.1 time: 0.351605 May 24 15:22:14.127250 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 147/283] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:13 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1357 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:14.564163 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-cdaeb3e0-b308-46a9-857d-a93fd03c6ca3 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:14.564797 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-cdaeb3e0-b308-46a9-857d-a93fd03c6ca3 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] [instance: e2d4b4da-3b00-41c0-a0ac-21477f232931] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:14.570755 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cdaeb3e0-b308-46a9-857d-a93fd03c6ca3 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:14.571134 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cdaeb3e0-b308-46a9-857d-a93fd03c6ca3 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:14.571886 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cdaeb3e0-b308-46a9-857d-a93fd03c6ca3 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:14.572329 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cdaeb3e0-b308-46a9-857d-a93fd03c6ca3 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:14.581781 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-282d1575-14ed-4417-8fbf-5002c588e5e8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:14.582909 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-282d1575-14ed-4417-8fbf-5002c588e5e8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:14.589264 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-282d1575-14ed-4417-8fbf-5002c588e5e8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:14.589704 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-282d1575-14ed-4417-8fbf-5002c588e5e8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:14.590488 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-282d1575-14ed-4417-8fbf-5002c588e5e8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:14.590949 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-282d1575-14ed-4417-8fbf-5002c588e5e8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:14.700917 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-cdaeb3e0-b308-46a9-857d-a93fd03c6ca3 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b27ee7d15ca42bca6a09dd18751f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c8c75b264644b7af9831e14cbf7841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:14.708328 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-cdaeb3e0-b308-46a9-857d-a93fd03c6ca3 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] 10.222.0.45 "GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931" status: 200 len: 1314 microversion: 2.1 time: 0.148130 May 24 15:22:14.708914 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 137/284] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:14 2022] GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:14.716282 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-282d1575-14ed-4417-8fbf-5002c588e5e8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:14.724251 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-282d1575-14ed-4417-8fbf-5002c588e5e8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:14.725826 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-282d1575-14ed-4417-8fbf-5002c588e5e8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:14.726981 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-282d1575-14ed-4417-8fbf-5002c588e5e8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1724 microversion: 2.20 time: 0.149200 May 24 15:22:14.727531 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 148/285] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:22:14 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:22:14.893720 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-7f80770c-3ef6-4c50-aff7-ce4218ad6a96 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:14.894330 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-7f80770c-3ef6-4c50-aff7-ce4218ad6a96 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:14.900767 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7f80770c-3ef6-4c50-aff7-ce4218ad6a96 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:14.901210 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7f80770c-3ef6-4c50-aff7-ce4218ad6a96 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:14.901965 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7f80770c-3ef6-4c50-aff7-ce4218ad6a96 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:14.902396 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7f80770c-3ef6-4c50-aff7-ce4218ad6a96 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:14.966238 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-7f80770c-3ef6-4c50-aff7-ce4218ad6a96 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:14.974205 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-7f80770c-3ef6-4c50-aff7-ce4218ad6a96 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1249 microversion: 2.1 time: 0.084248 May 24 15:22:14.974761 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 138/286] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:14 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1249 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:15.143690 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-baaa306f-5ea4-4141-9ebe-4b03c1bc869f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:15.144226 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-baaa306f-5ea4-4141-9ebe-4b03c1bc869f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:15.150258 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-baaa306f-5ea4-4141-9ebe-4b03c1bc869f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:15.150697 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-baaa306f-5ea4-4141-9ebe-4b03c1bc869f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:15.151441 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-baaa306f-5ea4-4141-9ebe-4b03c1bc869f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:15.151896 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-baaa306f-5ea4-4141-9ebe-4b03c1bc869f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:15.277645 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-baaa306f-5ea4-4141-9ebe-4b03c1bc869f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:15.284970 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-baaa306f-5ea4-4141-9ebe-4b03c1bc869f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1357 microversion: 2.1 time: 0.145149 May 24 15:22:15.285524 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 149/287] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:15 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1357 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:15.726199 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-89191e26-65cc-4734-9eab-c1beddeff41e tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:15.726199 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-89191e26-65cc-4734-9eab-c1beddeff41e tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] [instance: e2d4b4da-3b00-41c0-a0ac-21477f232931] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:15.732737 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-89191e26-65cc-4734-9eab-c1beddeff41e tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:15.733440 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-89191e26-65cc-4734-9eab-c1beddeff41e tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:15.734192 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-89191e26-65cc-4734-9eab-c1beddeff41e tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:15.734618 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-89191e26-65cc-4734-9eab-c1beddeff41e tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:15.745018 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c83c7193-70f8-43c9-8565-f1114b34a4b8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:15.745614 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-c83c7193-70f8-43c9-8565-f1114b34a4b8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:15.752839 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c83c7193-70f8-43c9-8565-f1114b34a4b8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:15.753275 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c83c7193-70f8-43c9-8565-f1114b34a4b8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:15.754054 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c83c7193-70f8-43c9-8565-f1114b34a4b8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:15.754481 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c83c7193-70f8-43c9-8565-f1114b34a4b8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:15.862803 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-89191e26-65cc-4734-9eab-c1beddeff41e tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b27ee7d15ca42bca6a09dd18751f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c8c75b264644b7af9831e14cbf7841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:15.871392 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-89191e26-65cc-4734-9eab-c1beddeff41e tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] 10.222.0.45 "GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931" status: 200 len: 1314 microversion: 2.1 time: 0.149617 May 24 15:22:15.873054 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 139/288] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:15 2022] GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:15.886681 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-c83c7193-70f8-43c9-8565-f1114b34a4b8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:15.894555 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-c83c7193-70f8-43c9-8565-f1114b34a4b8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:15.896061 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-c83c7193-70f8-43c9-8565-f1114b34a4b8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:15.897244 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-c83c7193-70f8-43c9-8565-f1114b34a4b8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1724 microversion: 2.20 time: 0.156079 May 24 15:22:15.897800 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 150/289] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:22:15 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:22:15.990300 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-08c9501d-79bf-4eb7-9891-c47acc9c7290 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:15.990842 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-08c9501d-79bf-4eb7-9891-c47acc9c7290 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:15.997855 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-08c9501d-79bf-4eb7-9891-c47acc9c7290 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:15.998292 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-08c9501d-79bf-4eb7-9891-c47acc9c7290 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:15.999045 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-08c9501d-79bf-4eb7-9891-c47acc9c7290 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:15.999471 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-08c9501d-79bf-4eb7-9891-c47acc9c7290 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:16.059222 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-08c9501d-79bf-4eb7-9891-c47acc9c7290 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:16.066553 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-08c9501d-79bf-4eb7-9891-c47acc9c7290 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1249 microversion: 2.1 time: 0.080090 May 24 15:22:16.067122 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 140/290] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:15 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1249 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:16.300630 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-690a7f2e-ccde-4fcd-9e1b-aab477398b14 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:16.301162 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-690a7f2e-ccde-4fcd-9e1b-aab477398b14 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:16.307120 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-690a7f2e-ccde-4fcd-9e1b-aab477398b14 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:16.307561 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-690a7f2e-ccde-4fcd-9e1b-aab477398b14 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:16.308342 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-690a7f2e-ccde-4fcd-9e1b-aab477398b14 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:16.308775 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-690a7f2e-ccde-4fcd-9e1b-aab477398b14 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:16.444342 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-690a7f2e-ccde-4fcd-9e1b-aab477398b14 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:16.454701 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-690a7f2e-ccde-4fcd-9e1b-aab477398b14 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1357 microversion: 2.1 time: 0.157907 May 24 15:22:16.455758 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 151/291] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:16 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:16.889636 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-dedab328-2628-4eb4-b6ae-48e965f671c0 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:16.890229 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-dedab328-2628-4eb4-b6ae-48e965f671c0 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] [instance: e2d4b4da-3b00-41c0-a0ac-21477f232931] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:16.896542 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dedab328-2628-4eb4-b6ae-48e965f671c0 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:16.897129 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dedab328-2628-4eb4-b6ae-48e965f671c0 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:16.897803 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dedab328-2628-4eb4-b6ae-48e965f671c0 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:16.898253 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dedab328-2628-4eb4-b6ae-48e965f671c0 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:16.915735 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-b3f039c0-7fe7-456a-8a44-20ecf4cd5181 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:16.916371 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-b3f039c0-7fe7-456a-8a44-20ecf4cd5181 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:16.923256 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b3f039c0-7fe7-456a-8a44-20ecf4cd5181 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:16.923861 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b3f039c0-7fe7-456a-8a44-20ecf4cd5181 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:16.924835 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b3f039c0-7fe7-456a-8a44-20ecf4cd5181 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:16.925420 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b3f039c0-7fe7-456a-8a44-20ecf4cd5181 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:17.009252 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell0:SELECT=2 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:22:17.030398 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell0:SELECT=10 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:22:17.041916 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-dedab328-2628-4eb4-b6ae-48e965f671c0 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b27ee7d15ca42bca6a09dd18751f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c8c75b264644b7af9831e14cbf7841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:17.054348 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-dedab328-2628-4eb4-b6ae-48e965f671c0 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] 10.222.0.45 "GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931" status: 200 len: 1314 microversion: 2.1 time: 0.169299 May 24 15:22:17.054935 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 141/292] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:16 2022] GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:17.070039 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-b3f039c0-7fe7-456a-8a44-20ecf4cd5181 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:17.078259 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-b3f039c0-7fe7-456a-8a44-20ecf4cd5181 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:17.079749 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-b3f039c0-7fe7-456a-8a44-20ecf4cd5181 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:17.081128 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-b3f039c0-7fe7-456a-8a44-20ecf4cd5181 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1724 microversion: 2.20 time: 0.169467 May 24 15:22:17.081727 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 152/293] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:22:16 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:22:17.087575 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-11b892b1-34ae-4e76-87b4-02712a1b9d5c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:17.088453 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-11b892b1-34ae-4e76-87b4-02712a1b9d5c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:17.095166 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-11b892b1-34ae-4e76-87b4-02712a1b9d5c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:17.095613 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-11b892b1-34ae-4e76-87b4-02712a1b9d5c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:17.096398 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-11b892b1-34ae-4e76-87b4-02712a1b9d5c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:17.096835 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-11b892b1-34ae-4e76-87b4-02712a1b9d5c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:17.153783 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell0:SELECT=2 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:22:17.158117 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-11b892b1-34ae-4e76-87b4-02712a1b9d5c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:17.165809 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-11b892b1-34ae-4e76-87b4-02712a1b9d5c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1249 microversion: 2.1 time: 0.082664 May 24 15:22:17.166376 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 142/294] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:17 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1249 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:17.471915 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-253a5709-bde0-40f1-80aa-eddc7a463198 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:17.472567 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-253a5709-bde0-40f1-80aa-eddc7a463198 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:17.478584 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-253a5709-bde0-40f1-80aa-eddc7a463198 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:17.479027 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-253a5709-bde0-40f1-80aa-eddc7a463198 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:17.479790 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-253a5709-bde0-40f1-80aa-eddc7a463198 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:17.480223 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-253a5709-bde0-40f1-80aa-eddc7a463198 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:17.681142 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-253a5709-bde0-40f1-80aa-eddc7a463198 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:17.689128 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-253a5709-bde0-40f1-80aa-eddc7a463198 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1357 microversion: 2.1 time: 0.221052 May 24 15:22:17.689686 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 153/295] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:17 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1357 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:18.089536 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-13578cb3-6d36-4bfc-a340-f3da3abb090f tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:18.090713 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-13578cb3-6d36-4bfc-a340-f3da3abb090f tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] [instance: e2d4b4da-3b00-41c0-a0ac-21477f232931] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:18.100447 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-3acbe29c-d338-42a3-a5a8-5fcf9a74d9bf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:18.101062 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-3acbe29c-d338-42a3-a5a8-5fcf9a74d9bf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:18.109197 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-13578cb3-6d36-4bfc-a340-f3da3abb090f tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:18.111177 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-13578cb3-6d36-4bfc-a340-f3da3abb090f tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:18.111689 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3acbe29c-d338-42a3-a5a8-5fcf9a74d9bf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:18.112629 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-13578cb3-6d36-4bfc-a340-f3da3abb090f tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:18.114275 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-13578cb3-6d36-4bfc-a340-f3da3abb090f tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:18.137011 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3acbe29c-d338-42a3-a5a8-5fcf9a74d9bf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:18.138187 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3acbe29c-d338-42a3-a5a8-5fcf9a74d9bf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:18.142156 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:22:18.145163 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3acbe29c-d338-42a3-a5a8-5fcf9a74d9bf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:18.323153 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-13578cb3-6d36-4bfc-a340-f3da3abb090f tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b27ee7d15ca42bca6a09dd18751f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c8c75b264644b7af9831e14cbf7841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:18.334445 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-13578cb3-6d36-4bfc-a340-f3da3abb090f tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] 10.222.0.45 "GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931" status: 200 len: 1314 microversion: 2.1 time: 0.258667 May 24 15:22:18.335281 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 143/296] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:18 2022] GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:18.340879 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-7e17cb55-b3e3-453a-ae66-786b8915e2d3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:18.341549 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-7e17cb55-b3e3-453a-ae66-786b8915e2d3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:18.348597 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7e17cb55-b3e3-453a-ae66-786b8915e2d3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:18.349051 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7e17cb55-b3e3-453a-ae66-786b8915e2d3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:18.349821 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7e17cb55-b3e3-453a-ae66-786b8915e2d3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:18.350991 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7e17cb55-b3e3-453a-ae66-786b8915e2d3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:18.371901 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-3acbe29c-d338-42a3-a5a8-5fcf9a74d9bf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:18.382010 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-3acbe29c-d338-42a3-a5a8-5fcf9a74d9bf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:18.383673 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-3acbe29c-d338-42a3-a5a8-5fcf9a74d9bf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:18.385169 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-3acbe29c-d338-42a3-a5a8-5fcf9a74d9bf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1745 microversion: 2.20 time: 0.288592 May 24 15:22:18.397514 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 154/297] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:22:18 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1745 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:22:18.416228 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-7e17cb55-b3e3-453a-ae66-786b8915e2d3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:18.425885 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-7e17cb55-b3e3-453a-ae66-786b8915e2d3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1297 microversion: 2.1 time: 0.087912 May 24 15:22:18.426664 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 144/298] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:18 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1297 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:18.707383 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-a4af6725-f5f6-4fda-9dbd-124a564866db tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:18.708014 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-a4af6725-f5f6-4fda-9dbd-124a564866db tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:18.713273 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:22:18.715271 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a4af6725-f5f6-4fda-9dbd-124a564866db tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:18.715763 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a4af6725-f5f6-4fda-9dbd-124a564866db tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:18.716840 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a4af6725-f5f6-4fda-9dbd-124a564866db tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:18.717329 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a4af6725-f5f6-4fda-9dbd-124a564866db tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:18.734442 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:22:18.889165 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-a4af6725-f5f6-4fda-9dbd-124a564866db tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:18.897471 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-a4af6725-f5f6-4fda-9dbd-124a564866db tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1357 microversion: 2.1 time: 0.195471 May 24 15:22:18.898051 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 155/299] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:18 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1357 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:19.352620 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-57330237-2490-4467-9a52-1347493bfadf tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:19.353366 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-57330237-2490-4467-9a52-1347493bfadf tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] [instance: e2d4b4da-3b00-41c0-a0ac-21477f232931] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:19.361274 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-57330237-2490-4467-9a52-1347493bfadf tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:19.361724 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-57330237-2490-4467-9a52-1347493bfadf tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:19.362530 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-57330237-2490-4467-9a52-1347493bfadf tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:19.363001 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-57330237-2490-4467-9a52-1347493bfadf tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:19.404969 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-3aa37f66-6012-423b-ae6e-313e9a470375 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:19.406801 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-3aa37f66-6012-423b-ae6e-313e9a470375 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:19.416966 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3aa37f66-6012-423b-ae6e-313e9a470375 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:19.417552 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3aa37f66-6012-423b-ae6e-313e9a470375 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:19.418890 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3aa37f66-6012-423b-ae6e-313e9a470375 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:19.419378 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3aa37f66-6012-423b-ae6e-313e9a470375 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:19.507254 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-57330237-2490-4467-9a52-1347493bfadf tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b27ee7d15ca42bca6a09dd18751f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c8c75b264644b7af9831e14cbf7841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:19.514974 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-57330237-2490-4467-9a52-1347493bfadf tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] 10.222.0.45 "GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931" status: 200 len: 1314 microversion: 2.1 time: 0.166702 May 24 15:22:19.515541 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 145/300] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:19 2022] GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:19.519956 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a4bd8c00-99ed-4212-bc99-f2cd78fdd6ed tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:19.520579 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a4bd8c00-99ed-4212-bc99-f2cd78fdd6ed tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:19.526595 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a4bd8c00-99ed-4212-bc99-f2cd78fdd6ed tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:19.527043 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a4bd8c00-99ed-4212-bc99-f2cd78fdd6ed tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:19.527849 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a4bd8c00-99ed-4212-bc99-f2cd78fdd6ed tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:19.528281 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a4bd8c00-99ed-4212-bc99-f2cd78fdd6ed tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:19.560788 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-3aa37f66-6012-423b-ae6e-313e9a470375 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:19.569324 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-3aa37f66-6012-423b-ae6e-313e9a470375 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:19.571172 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-3aa37f66-6012-423b-ae6e-313e9a470375 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:19.572590 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-3aa37f66-6012-423b-ae6e-313e9a470375 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1745 microversion: 2.20 time: 0.172085 May 24 15:22:19.573091 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 156/301] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:22:19 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1745 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:22:19.589807 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-a4bd8c00-99ed-4212-bc99-f2cd78fdd6ed tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:19.597808 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a4bd8c00-99ed-4212-bc99-f2cd78fdd6ed tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1315 microversion: 2.1 time: 0.081337 May 24 15:22:19.598367 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 146/302] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:19 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1315 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:19.914426 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-0699b877-d2bd-493c-83d1-75010ba31e2c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:19.915061 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-0699b877-d2bd-493c-83d1-75010ba31e2c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:19.921032 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0699b877-d2bd-493c-83d1-75010ba31e2c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:19.921470 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0699b877-d2bd-493c-83d1-75010ba31e2c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:19.923158 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0699b877-d2bd-493c-83d1-75010ba31e2c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:19.923630 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0699b877-d2bd-493c-83d1-75010ba31e2c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:20.283170 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-0699b877-d2bd-493c-83d1-75010ba31e2c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:20.294500 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-0699b877-d2bd-493c-83d1-75010ba31e2c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1357 microversion: 2.1 time: 0.383969 May 24 15:22:20.297888 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 157/303] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:19 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1357 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:20.532963 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-7ddf25fa-2257-456e-a3fc-083f611d2dda tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:20.534206 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-7ddf25fa-2257-456e-a3fc-083f611d2dda tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] [instance: e2d4b4da-3b00-41c0-a0ac-21477f232931] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:20.541970 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7ddf25fa-2257-456e-a3fc-083f611d2dda tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:20.551576 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7ddf25fa-2257-456e-a3fc-083f611d2dda tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:20.552521 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7ddf25fa-2257-456e-a3fc-083f611d2dda tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:20.554271 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7ddf25fa-2257-456e-a3fc-083f611d2dda tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:20.591818 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-cfb4f320-18d5-49d3-a447-0f5363167fb3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:20.592975 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-cfb4f320-18d5-49d3-a447-0f5363167fb3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:20.608831 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cfb4f320-18d5-49d3-a447-0f5363167fb3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:20.609474 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cfb4f320-18d5-49d3-a447-0f5363167fb3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:20.610416 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cfb4f320-18d5-49d3-a447-0f5363167fb3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:20.610858 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cfb4f320-18d5-49d3-a447-0f5363167fb3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:20.710597 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-7ddf25fa-2257-456e-a3fc-083f611d2dda tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b27ee7d15ca42bca6a09dd18751f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c8c75b264644b7af9831e14cbf7841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:20.721707 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-7ddf25fa-2257-456e-a3fc-083f611d2dda tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] 10.222.0.45 "GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931" status: 200 len: 1498 microversion: 2.1 time: 0.193728 May 24 15:22:20.722317 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 147/304] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:20 2022] GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931 => generated 1498 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:20.727291 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-8bd248aa-b2c9-4a42-8bc9-2859ad8d1a29 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:20.728144 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-8bd248aa-b2c9-4a42-8bc9-2859ad8d1a29 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:20.736610 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8bd248aa-b2c9-4a42-8bc9-2859ad8d1a29 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:20.737320 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8bd248aa-b2c9-4a42-8bc9-2859ad8d1a29 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:20.738614 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8bd248aa-b2c9-4a42-8bc9-2859ad8d1a29 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:20.739117 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8bd248aa-b2c9-4a42-8bc9-2859ad8d1a29 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:20.881273 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-cfb4f320-18d5-49d3-a447-0f5363167fb3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:20.897703 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-cfb4f320-18d5-49d3-a447-0f5363167fb3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:20.911519 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-cfb4f320-18d5-49d3-a447-0f5363167fb3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:20.915491 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-cfb4f320-18d5-49d3-a447-0f5363167fb3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1745 microversion: 2.20 time: 0.328254 May 24 15:22:20.919843 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 158/305] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:22:20 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1745 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:22:20.930376 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [req-d3a64ca7-eaa9-4c36-8b54-427ca718d09c req-d25da612-97e9-47bc-aec8-8ddf9d3c56bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c54fc3c-070c-4cab-b181-081d80eeb078", "name": "network-vif-plugged", "status": "completed", "tag": "17e61d65-8da4-4259-8227-bdbecc4fa610"}]} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:22:20.945110 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-8bd248aa-b2c9-4a42-8bc9-2859ad8d1a29 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:20.952710 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-d3a64ca7-eaa9-4c36-8b54-427ca718d09c req-d25da612-97e9-47bc-aec8-8ddf9d3c56bd service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:20.953203 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-d3a64ca7-eaa9-4c36-8b54-427ca718d09c req-d25da612-97e9-47bc-aec8-8ddf9d3c56bd service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:20.956897 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-8bd248aa-b2c9-4a42-8bc9-2859ad8d1a29 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1371 microversion: 2.1 time: 0.233146 May 24 15:22:20.957691 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 148/306] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:20 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1371 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:20.970335 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.compute.server_external_events [req-d3a64ca7-eaa9-4c36-8b54-427ca718d09c req-d25da612-97e9-47bc-aec8-8ddf9d3c56bd service nova] Creating event network-vif-plugged:17e61d65-8da4-4259-8227-bdbecc4fa610 for instance 6c54fc3c-070c-4cab-b181-081d80eeb078 on hv-cinder-84315 May 24 15:22:20.976893 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [req-d3a64ca7-eaa9-4c36-8b54-427ca718d09c req-d25da612-97e9-47bc-aec8-8ddf9d3c56bd service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055337 May 24 15:22:20.977520 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 159/307] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:22:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:22:20.989551 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d7564557-7d0b-4a12-b02f-59b09f321d87 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:22:20.996468 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d7564557-7d0b-4a12-b02f-59b09f321d87 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:20.996983 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d7564557-7d0b-4a12-b02f-59b09f321d87 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:21.087142 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d7564557-7d0b-4a12-b02f-59b09f321d87 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Going to try to stop instance {{(pid=117699) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 24 15:22:21.175301 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d7564557-7d0b-4a12-b02f-59b09f321d87 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "POST /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa/action" status: 202 len: 0 microversion: 2.1 time: 0.190063 May 24 15:22:21.175999 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 149/308] 10.222.0.45 () {60 vars in 1277 bytes} [Tue May 24 15:22:20 2022] POST /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 15:22:21.185641 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-f5d88938-7735-4b83-99b0-7cf1914b9335 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:21.186340 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-f5d88938-7735-4b83-99b0-7cf1914b9335 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:21.195485 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f5d88938-7735-4b83-99b0-7cf1914b9335 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:21.196134 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f5d88938-7735-4b83-99b0-7cf1914b9335 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:21.197190 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f5d88938-7735-4b83-99b0-7cf1914b9335 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:21.198321 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f5d88938-7735-4b83-99b0-7cf1914b9335 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:21.312988 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-6682136e-edf4-4cf6-9c1f-4c4e69ab034d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:21.313684 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-6682136e-edf4-4cf6-9c1f-4c4e69ab034d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:21.319795 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6682136e-edf4-4cf6-9c1f-4c4e69ab034d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:21.320246 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6682136e-edf4-4cf6-9c1f-4c4e69ab034d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:21.321037 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6682136e-edf4-4cf6-9c1f-4c4e69ab034d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:21.321468 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6682136e-edf4-4cf6-9c1f-4c4e69ab034d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:21.467662 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-6682136e-edf4-4cf6-9c1f-4c4e69ab034d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:21.477865 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-6682136e-edf4-4cf6-9c1f-4c4e69ab034d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1357 microversion: 2.1 time: 0.168879 May 24 15:22:21.478804 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 150/309] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:21 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:22:21.479954 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-f5d88938-7735-4b83-99b0-7cf1914b9335 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:21.489855 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-f5d88938-7735-4b83-99b0-7cf1914b9335 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1724 microversion: 2.1 time: 0.309171 May 24 15:22:21.492243 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-7079b813-6f20-49e8-a1e5-7225a9a418a0 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:21.492778 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-7079b813-6f20-49e8-a1e5-7225a9a418a0 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] [instance: e2d4b4da-3b00-41c0-a0ac-21477f232931] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:21.496953 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 160/310] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:21 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1724 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:21.499991 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7079b813-6f20-49e8-a1e5-7225a9a418a0 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:21.500546 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7079b813-6f20-49e8-a1e5-7225a9a418a0 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:21.501313 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7079b813-6f20-49e8-a1e5-7225a9a418a0 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:21.501746 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7079b813-6f20-49e8-a1e5-7225a9a418a0 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:21.526529 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-7079b813-6f20-49e8-a1e5-7225a9a418a0 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] [instance: e2d4b4da-3b00-41c0-a0ac-21477f232931] Going to try to terminate instance {{(pid=117699) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 15:22:21.601068 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-7079b813-6f20-49e8-a1e5-7225a9a418a0 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] 10.222.0.45 "DELETE /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931" status: 204 len: 0 microversion: 2.1 time: 0.112292 May 24 15:22:21.601991 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 151/311] 10.222.0.45 () {58 vars in 1238 bytes} [Tue May 24 15:22:21 2022] DELETE /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 15:22:21.610541 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-72d73933-6c2c-44ba-9426-222e534eb39f tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:21.611233 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-72d73933-6c2c-44ba-9426-222e534eb39f tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] [instance: e2d4b4da-3b00-41c0-a0ac-21477f232931] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:21.618045 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-72d73933-6c2c-44ba-9426-222e534eb39f tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:21.618045 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-72d73933-6c2c-44ba-9426-222e534eb39f tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:21.618826 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-72d73933-6c2c-44ba-9426-222e534eb39f tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:21.619263 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-72d73933-6c2c-44ba-9426-222e534eb39f tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:21.886656 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-72d73933-6c2c-44ba-9426-222e534eb39f tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b27ee7d15ca42bca6a09dd18751f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c8c75b264644b7af9831e14cbf7841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:21.894089 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-72d73933-6c2c-44ba-9426-222e534eb39f tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] 10.222.0.45 "GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931" status: 200 len: 1504 microversion: 2.1 time: 0.288105 May 24 15:22:21.894648 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 161/312] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:21 2022] GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931 => generated 1504 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:21.938872 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-25925f14-d1a8-46ea-b1ca-79a2079a89a1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:21.939567 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-25925f14-d1a8-46ea-b1ca-79a2079a89a1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:21.945547 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-25925f14-d1a8-46ea-b1ca-79a2079a89a1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:21.945989 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-25925f14-d1a8-46ea-b1ca-79a2079a89a1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:21.946747 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-25925f14-d1a8-46ea-b1ca-79a2079a89a1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:21.947174 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-25925f14-d1a8-46ea-b1ca-79a2079a89a1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:21.974574 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-1053dff2-dabd-46f7-acae-0f11fb4f179d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:21.975182 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-1053dff2-dabd-46f7-acae-0f11fb4f179d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:21.982668 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1053dff2-dabd-46f7-acae-0f11fb4f179d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:21.983314 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1053dff2-dabd-46f7-acae-0f11fb4f179d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:21.984148 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1053dff2-dabd-46f7-acae-0f11fb4f179d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:21.984610 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1053dff2-dabd-46f7-acae-0f11fb4f179d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:22.112238 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-25925f14-d1a8-46ea-b1ca-79a2079a89a1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:22.121481 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-25925f14-d1a8-46ea-b1ca-79a2079a89a1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:22.123071 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-25925f14-d1a8-46ea-b1ca-79a2079a89a1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:22.124284 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-25925f14-d1a8-46ea-b1ca-79a2079a89a1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1745 microversion: 2.20 time: 0.190205 May 24 15:22:22.132420 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 152/313] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:22:21 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1745 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:22:22.132420 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [req-5a0ee2f9-fc1a-4a2c-a773-bac66da370d9 req-a4a36357-610b-4288-b50e-ffd3532987e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3017990e-8735-4d85-a686-1eebb1484dd3", "tag": "ca6cef6e-61fd-4449-934f-86f49e0487c0"}]} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:22:22.140958 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-5a0ee2f9-fc1a-4a2c-a773-bac66da370d9 req-a4a36357-610b-4288-b50e-ffd3532987e8 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:22.141590 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-5a0ee2f9-fc1a-4a2c-a773-bac66da370d9 req-a4a36357-610b-4288-b50e-ffd3532987e8 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:22.153339 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.compute.server_external_events [req-5a0ee2f9-fc1a-4a2c-a773-bac66da370d9 req-a4a36357-610b-4288-b50e-ffd3532987e8 service nova] Creating event network-changed:ca6cef6e-61fd-4449-934f-86f49e0487c0 for instance 3017990e-8735-4d85-a686-1eebb1484dd3 on hv-cinder-84315 May 24 15:22:22.158552 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [req-5a0ee2f9-fc1a-4a2c-a773-bac66da370d9 req-a4a36357-610b-4288-b50e-ffd3532987e8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032057 May 24 15:22:22.159153 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 153/314] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:22:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:22:22.164084 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-1053dff2-dabd-46f7-acae-0f11fb4f179d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:22.172671 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-1053dff2-dabd-46f7-acae-0f11fb4f179d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1371 microversion: 2.1 time: 0.202018 May 24 15:22:22.173353 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 162/315] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:21 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1371 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:22:22.494989 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-6fee2602-fb62-4856-affe-8173e3214cc7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:22.495677 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-6fee2602-fb62-4856-affe-8173e3214cc7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:22.502060 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6fee2602-fb62-4856-affe-8173e3214cc7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:22.502501 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6fee2602-fb62-4856-affe-8173e3214cc7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:22.503252 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6fee2602-fb62-4856-affe-8173e3214cc7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:22.503681 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6fee2602-fb62-4856-affe-8173e3214cc7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:22.506765 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-069ad9a0-a63c-40fb-a3a5-1f972c37f5d1 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:22.507368 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-069ad9a0-a63c-40fb-a3a5-1f972c37f5d1 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:22.513683 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-069ad9a0-a63c-40fb-a3a5-1f972c37f5d1 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:22.514128 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-069ad9a0-a63c-40fb-a3a5-1f972c37f5d1 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:22.514876 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-069ad9a0-a63c-40fb-a3a5-1f972c37f5d1 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:22.515304 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-069ad9a0-a63c-40fb-a3a5-1f972c37f5d1 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:22.639194 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-6fee2602-fb62-4856-affe-8173e3214cc7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:22.644676 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-069ad9a0-a63c-40fb-a3a5-1f972c37f5d1 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:22.646765 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-6fee2602-fb62-4856-affe-8173e3214cc7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1357 microversion: 2.1 time: 0.155947 May 24 15:22:22.647416 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 154/316] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:22 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:22.652692 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-069ad9a0-a63c-40fb-a3a5-1f972c37f5d1 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1724 microversion: 2.1 time: 0.149599 May 24 15:22:22.653907 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 163/317] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:22 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:22:22.911012 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-93fe97ee-bf0d-4c8b-9e40-99da1661ed9b tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:22.911636 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-93fe97ee-bf0d-4c8b-9e40-99da1661ed9b tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] [instance: e2d4b4da-3b00-41c0-a0ac-21477f232931] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:22.917655 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-93fe97ee-bf0d-4c8b-9e40-99da1661ed9b tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:22.918101 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-93fe97ee-bf0d-4c8b-9e40-99da1661ed9b tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:22.918896 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-93fe97ee-bf0d-4c8b-9e40-99da1661ed9b tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:22.919337 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-93fe97ee-bf0d-4c8b-9e40-99da1661ed9b tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:23.048418 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-93fe97ee-bf0d-4c8b-9e40-99da1661ed9b tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b27ee7d15ca42bca6a09dd18751f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c8c75b264644b7af9831e14cbf7841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:23.055838 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-93fe97ee-bf0d-4c8b-9e40-99da1661ed9b tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] 10.222.0.45 "GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931" status: 200 len: 1504 microversion: 2.1 time: 0.148774 May 24 15:22:23.056426 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 155/318] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:22 2022] GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931 => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:23.142812 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e8e1cca7-39e1-46a1-aff8-025d1f3343fc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:23.143424 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e8e1cca7-39e1-46a1-aff8-025d1f3343fc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:23.149906 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e8e1cca7-39e1-46a1-aff8-025d1f3343fc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:23.150359 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e8e1cca7-39e1-46a1-aff8-025d1f3343fc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:23.151123 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e8e1cca7-39e1-46a1-aff8-025d1f3343fc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:23.151554 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e8e1cca7-39e1-46a1-aff8-025d1f3343fc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:23.189949 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-0acf8b79-e3ec-431c-af16-3782c7cc950f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:23.190777 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-0acf8b79-e3ec-431c-af16-3782c7cc950f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:23.197048 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0acf8b79-e3ec-431c-af16-3782c7cc950f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:23.197488 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0acf8b79-e3ec-431c-af16-3782c7cc950f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:23.198253 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0acf8b79-e3ec-431c-af16-3782c7cc950f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:23.198682 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0acf8b79-e3ec-431c-af16-3782c7cc950f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:23.335071 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-0acf8b79-e3ec-431c-af16-3782c7cc950f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:23.344762 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-0acf8b79-e3ec-431c-af16-3782c7cc950f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1371 microversion: 2.1 time: 0.158731 May 24 15:22:23.345465 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 156/319] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:23 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:22:23.363464 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e8e1cca7-39e1-46a1-aff8-025d1f3343fc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:23.371554 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e8e1cca7-39e1-46a1-aff8-025d1f3343fc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:23.373157 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e8e1cca7-39e1-46a1-aff8-025d1f3343fc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:23.374378 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e8e1cca7-39e1-46a1-aff8-025d1f3343fc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1745 microversion: 2.20 time: 0.235435 May 24 15:22:23.375026 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 164/320] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:22:23 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1745 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:22:23.663842 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d406fb34-5dda-4d5a-9b27-27a85d620a3d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:23.664474 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d406fb34-5dda-4d5a-9b27-27a85d620a3d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:23.670649 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-f0c2f15b-f7c4-4c90-97d9-48b18bcf026c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:23.671691 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d406fb34-5dda-4d5a-9b27-27a85d620a3d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:23.671844 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-f0c2f15b-f7c4-4c90-97d9-48b18bcf026c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:23.672139 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d406fb34-5dda-4d5a-9b27-27a85d620a3d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:23.672923 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d406fb34-5dda-4d5a-9b27-27a85d620a3d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:23.673619 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d406fb34-5dda-4d5a-9b27-27a85d620a3d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:23.678611 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f0c2f15b-f7c4-4c90-97d9-48b18bcf026c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:23.679058 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f0c2f15b-f7c4-4c90-97d9-48b18bcf026c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:23.679825 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f0c2f15b-f7c4-4c90-97d9-48b18bcf026c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:23.680342 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f0c2f15b-f7c4-4c90-97d9-48b18bcf026c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:23.819752 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-d406fb34-5dda-4d5a-9b27-27a85d620a3d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:23.827884 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d406fb34-5dda-4d5a-9b27-27a85d620a3d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1357 microversion: 2.1 time: 0.168105 May 24 15:22:23.828676 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-f0c2f15b-f7c4-4c90-97d9-48b18bcf026c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:23.828977 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 157/321] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:23 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:23.837440 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-f0c2f15b-f7c4-4c90-97d9-48b18bcf026c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1724 microversion: 2.1 time: 0.170369 May 24 15:22:23.837440 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 165/322] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:23 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:24.074019 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-65ea6346-b66e-4a22-82e6-55e536e19e4b tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:24.075125 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-65ea6346-b66e-4a22-82e6-55e536e19e4b tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] [instance: e2d4b4da-3b00-41c0-a0ac-21477f232931] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:24.082000 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-65ea6346-b66e-4a22-82e6-55e536e19e4b tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:24.082591 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-65ea6346-b66e-4a22-82e6-55e536e19e4b tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:24.083380 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-65ea6346-b66e-4a22-82e6-55e536e19e4b tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:24.085952 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-65ea6346-b66e-4a22-82e6-55e536e19e4b tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:24.362522 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-18a83f88-62c1-4daf-8b9e-e3a418c3e9cc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:24.363142 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-18a83f88-62c1-4daf-8b9e-e3a418c3e9cc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:24.370011 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-18a83f88-62c1-4daf-8b9e-e3a418c3e9cc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:24.370472 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-18a83f88-62c1-4daf-8b9e-e3a418c3e9cc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:24.371800 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-18a83f88-62c1-4daf-8b9e-e3a418c3e9cc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:24.372810 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-18a83f88-62c1-4daf-8b9e-e3a418c3e9cc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:24.377440 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:22:24.576941 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-18a83f88-62c1-4daf-8b9e-e3a418c3e9cc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:24.587967 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-18a83f88-62c1-4daf-8b9e-e3a418c3e9cc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1371 microversion: 2.1 time: 0.228845 May 24 15:22:24.599372 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 158/323] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:24 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1371 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:22:24.607121 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-65ea6346-b66e-4a22-82e6-55e536e19e4b tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b27ee7d15ca42bca6a09dd18751f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c8c75b264644b7af9831e14cbf7841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:24.609375 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-8c65156b-d816-4433-94a3-75ff1f351b0b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:24.610005 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-8c65156b-d816-4433-94a3-75ff1f351b0b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:24.616632 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-65ea6346-b66e-4a22-82e6-55e536e19e4b tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] 10.222.0.45 "GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931" status: 200 len: 1504 microversion: 2.1 time: 0.547272 May 24 15:22:24.617302 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 166/324] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:24 2022] GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931 => generated 1504 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:24.618980 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8c65156b-d816-4433-94a3-75ff1f351b0b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:24.619695 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8c65156b-d816-4433-94a3-75ff1f351b0b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:24.620680 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8c65156b-d816-4433-94a3-75ff1f351b0b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:24.621398 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8c65156b-d816-4433-94a3-75ff1f351b0b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:24.846672 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-6d300039-6693-4d78-8853-2c4dc2075d5d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:24.847324 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-6d300039-6693-4d78-8853-2c4dc2075d5d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:24.855089 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6d300039-6693-4d78-8853-2c4dc2075d5d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:24.855530 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6d300039-6693-4d78-8853-2c4dc2075d5d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:24.863997 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6d300039-6693-4d78-8853-2c4dc2075d5d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:24.864637 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6d300039-6693-4d78-8853-2c4dc2075d5d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:24.999025 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-8c65156b-d816-4433-94a3-75ff1f351b0b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:25.010974 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-8c65156b-d816-4433-94a3-75ff1f351b0b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:25.012413 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-8c65156b-d816-4433-94a3-75ff1f351b0b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:25.016588 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-8c65156b-d816-4433-94a3-75ff1f351b0b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1740 microversion: 2.20 time: 0.413189 May 24 15:22:25.017201 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 159/325] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:22:24 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1740 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:22:25.021736 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-3f910294-8c3c-40b9-aca2-a70baad4813c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:25.022342 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-3f910294-8c3c-40b9-aca2-a70baad4813c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:25.034713 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3f910294-8c3c-40b9-aca2-a70baad4813c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:25.035525 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3f910294-8c3c-40b9-aca2-a70baad4813c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:25.036586 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3f910294-8c3c-40b9-aca2-a70baad4813c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:25.037260 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3f910294-8c3c-40b9-aca2-a70baad4813c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:25.062499 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-6d300039-6693-4d78-8853-2c4dc2075d5d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:25.091149 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-6d300039-6693-4d78-8853-2c4dc2075d5d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1357 microversion: 2.1 time: 0.249558 May 24 15:22:25.091744 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 167/326] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:24 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1357 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:22:25.368908 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-3f910294-8c3c-40b9-aca2-a70baad4813c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:25.378497 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-3f910294-8c3c-40b9-aca2-a70baad4813c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1724 microversion: 2.1 time: 0.360279 May 24 15:22:25.379293 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 160/327] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:25 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1724 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:25.576940 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [req-9d39b639-74cb-41ea-ac86-950b516636f9 req-db8d803b-0ca8-45cc-8ea9-ec03d5f04f1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2d4b4da-3b00-41c0-a0ac-21477f232931", "name": "network-vif-deleted", "tag": "696a99fb-5587-4eb6-9451-4255b6f05a8b"}]} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:22:25.586126 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-9d39b639-74cb-41ea-ac86-950b516636f9 req-db8d803b-0ca8-45cc-8ea9-ec03d5f04f1e service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:25.586558 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-9d39b639-74cb-41ea-ac86-950b516636f9 req-db8d803b-0ca8-45cc-8ea9-ec03d5f04f1e service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:25.599821 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.compute.server_external_events [req-9d39b639-74cb-41ea-ac86-950b516636f9 req-db8d803b-0ca8-45cc-8ea9-ec03d5f04f1e service nova] Creating event network-vif-deleted:696a99fb-5587-4eb6-9451-4255b6f05a8b for instance e2d4b4da-3b00-41c0-a0ac-21477f232931 on hv-cinder-84315 May 24 15:22:25.605033 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d6d7ae8a-b791-48e3-a9b2-cefbdc408c41 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:25.606148 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d6d7ae8a-b791-48e3-a9b2-cefbdc408c41 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:25.613060 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d6d7ae8a-b791-48e3-a9b2-cefbdc408c41 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:25.613774 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d6d7ae8a-b791-48e3-a9b2-cefbdc408c41 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:25.614945 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d6d7ae8a-b791-48e3-a9b2-cefbdc408c41 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:25.615569 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d6d7ae8a-b791-48e3-a9b2-cefbdc408c41 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:25.620357 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [req-9d39b639-74cb-41ea-ac86-950b516636f9 req-db8d803b-0ca8-45cc-8ea9-ec03d5f04f1e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048287 May 24 15:22:25.624136 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 168/328] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:22:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:22:25.638365 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-20970092-779d-4712-a6bb-b44001932468 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:25.639335 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-20970092-779d-4712-a6bb-b44001932468 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] [instance: e2d4b4da-3b00-41c0-a0ac-21477f232931] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:25.646989 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-20970092-779d-4712-a6bb-b44001932468 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:25.647574 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-20970092-779d-4712-a6bb-b44001932468 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:25.648448 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-20970092-779d-4712-a6bb-b44001932468 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:25.648952 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-20970092-779d-4712-a6bb-b44001932468 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:25.743723 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-20970092-779d-4712-a6bb-b44001932468 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b27ee7d15ca42bca6a09dd18751f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c8c75b264644b7af9831e14cbf7841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:25.753867 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-20970092-779d-4712-a6bb-b44001932468 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] 10.222.0.45 "GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931" status: 200 len: 1462 microversion: 2.1 time: 0.122626 May 24 15:22:25.754468 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 169/329] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:25 2022] GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931 => generated 1462 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:25.805070 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-d6d7ae8a-b791-48e3-a9b2-cefbdc408c41 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:25.817932 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d6d7ae8a-b791-48e3-a9b2-cefbdc408c41 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1371 microversion: 2.1 time: 0.216841 May 24 15:22:25.818817 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 161/330] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:25 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1371 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:22:26.034899 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-adccb867-8ad3-4ba4-9c7e-670695953c2c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:26.035547 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-adccb867-8ad3-4ba4-9c7e-670695953c2c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:26.041553 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-adccb867-8ad3-4ba4-9c7e-670695953c2c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:26.041997 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-adccb867-8ad3-4ba4-9c7e-670695953c2c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:26.042762 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-adccb867-8ad3-4ba4-9c7e-670695953c2c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:26.043763 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-adccb867-8ad3-4ba4-9c7e-670695953c2c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:26.109133 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-255a7c5d-e524-4fc3-8f1c-25a343e1b72d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:26.109787 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-255a7c5d-e524-4fc3-8f1c-25a343e1b72d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:26.119673 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-255a7c5d-e524-4fc3-8f1c-25a343e1b72d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:26.122756 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-255a7c5d-e524-4fc3-8f1c-25a343e1b72d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:26.125178 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-255a7c5d-e524-4fc3-8f1c-25a343e1b72d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:26.125781 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-255a7c5d-e524-4fc3-8f1c-25a343e1b72d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:26.331566 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-adccb867-8ad3-4ba4-9c7e-670695953c2c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:26.341932 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-adccb867-8ad3-4ba4-9c7e-670695953c2c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:26.348128 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-adccb867-8ad3-4ba4-9c7e-670695953c2c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:26.349361 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-adccb867-8ad3-4ba4-9c7e-670695953c2c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1740 microversion: 2.20 time: 0.318314 May 24 15:22:26.363475 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 170/331] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:22:26 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1740 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:22:26.399538 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-f9153d63-43d0-4ee1-a90d-05111df6ac59 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:26.400474 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-f9153d63-43d0-4ee1-a90d-05111df6ac59 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:26.411853 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f9153d63-43d0-4ee1-a90d-05111df6ac59 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:26.412671 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f9153d63-43d0-4ee1-a90d-05111df6ac59 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:26.416182 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f9153d63-43d0-4ee1-a90d-05111df6ac59 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:26.417893 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f9153d63-43d0-4ee1-a90d-05111df6ac59 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:26.425518 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-255a7c5d-e524-4fc3-8f1c-25a343e1b72d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:26.454884 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-255a7c5d-e524-4fc3-8f1c-25a343e1b72d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1357 microversion: 2.1 time: 0.350476 May 24 15:22:26.460423 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 162/332] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:26 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1357 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:26.623494 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-f9153d63-43d0-4ee1-a90d-05111df6ac59 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:26.632816 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-f9153d63-43d0-4ee1-a90d-05111df6ac59 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1724 microversion: 2.1 time: 0.239565 May 24 15:22:26.633570 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 171/333] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:26 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1724 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:22:26.771779 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-4f1f95fc-e4d1-443a-b3f6-71642f951dc2 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:26.772744 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-4f1f95fc-e4d1-443a-b3f6-71642f951dc2 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] [instance: e2d4b4da-3b00-41c0-a0ac-21477f232931] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:26.779985 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4f1f95fc-e4d1-443a-b3f6-71642f951dc2 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:26.780582 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4f1f95fc-e4d1-443a-b3f6-71642f951dc2 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:26.782122 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4f1f95fc-e4d1-443a-b3f6-71642f951dc2 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:26.782876 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4f1f95fc-e4d1-443a-b3f6-71642f951dc2 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:26.804830 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.wsgi [None req-4f1f95fc-e4d1-443a-b3f6-71642f951dc2 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] HTTP exception thrown: Instance e2d4b4da-3b00-41c0-a0ac-21477f232931 could not be found. May 24 15:22:26.807392 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-4f1f95fc-e4d1-443a-b3f6-71642f951dc2 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Request method failure captured: May 24 15:22:26.807392 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: request: GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931 HTTP/1.1 May 24 15:22:26.807392 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Accept: application/json May 24 15:22:26.807392 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Accept-Encoding: identity May 24 15:22:26.807392 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Connection: close May 24 15:22:26.807392 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Content-Length: 0 May 24 15:22:26.807392 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Content-Type: application/json May 24 15:22:26.807392 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Host: 10.222.0.45 May 24 15:22:26.807392 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Openstack-System-Scope: None May 24 15:22:26.807392 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: User-Agent: python-urllib3/1.26.9 May 24 15:22:26.807392 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Auth-Token: gAAAAABijPf-q_mXcnokr_SQQO45R_M-PIO2RwtbbG-OF08i_RCbZbfbQwMS880uqpjJaYjj_W3ZNsaEztzwyflDmLNIz3bjVcoc_xIq8FMAZdGXqzCFUpZaYZ1m37gyeBr8FG-KO7rQ6yv0rySPIVt5tUcEG_NU7ZSaeaGGdNuDsWiMEsXcvk0 May 24 15:22:26.807392 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Domain-Id: None May 24 15:22:26.807392 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Domain-Name: None May 24 15:22:26.807392 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Identity-Status: Confirmed May 24 15:22:26.807392 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Is-Admin-Project: True May 24 15:22:26.807392 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Domain-Id: default May 24 15:22:26.807392 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Domain-Name: Default May 24 15:22:26.807392 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Id: f7c8c75b264644b7af9831e14cbf7841 May 24 15:22:26.807392 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Name: tempest-VolumesActionsTest-1184662138 May 24 15:22:26.807392 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Role: reader,member May 24 15:22:26.807392 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Roles: reader,member May 24 15:22:26.810219 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f7c8c75b264644b7af9831e14cbf7841"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f7c8c75b264644b7af9831e14cbf7841"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f7c8c75b264644b7af9831e14cbf7841"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f7c8c75b264644b7af9831e14cbf7841"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 24 15:22:26.810219 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant: tempest-VolumesActionsTest-1184662138 May 24 15:22:26.810219 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant-Id: f7c8c75b264644b7af9831e14cbf7841 May 24 15:22:26.810219 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant-Name: tempest-VolumesActionsTest-1184662138 May 24 15:22:26.810219 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User: tempest-VolumesActionsTest-1184662138-project May 24 15:22:26.810219 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Domain-Id: default May 24 15:22:26.810219 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Domain-Name: Default May 24 15:22:26.810219 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Id: 2b27ee7d15ca42bca6a09dd18751f01e May 24 15:22:26.810219 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Name: tempest-VolumesActionsTest-1184662138-project May 24 15:22:26.810219 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: method: > May 24 15:22:26.810219 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: exception: Instance e2d4b4da-3b00-41c0-a0ac-21477f232931 could not be found. May 24 15:22:26.810219 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: action_args: {'id': 'e2d4b4da-3b00-41c0-a0ac-21477f232931'} May 24 15:22:26.811053 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:22:26.811053 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:22:26.811053 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:22:26.811053 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:22:26.811053 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:22:26.811053 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:22:26.811053 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:22:26.811053 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:22:26.811053 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:22:26.811053 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:22:26.811053 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2d4b4da-3b00-41c0-a0ac-21477f232931 could not be found. May 24 15:22:26.811053 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:22:26.811053 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:22:26.811053 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:22:26.811053 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:22:26.811053 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:22:26.811053 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:22:26.811053 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:22:26.811053 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:22:26.811053 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:22:26.812360 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:22:26.812360 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 15:22:26.812360 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 15:22:26.812360 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:22:26.812360 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:22:26.812360 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:22:26.812360 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:22:26.812360 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2d4b4da-3b00-41c0-a0ac-21477f232931 could not be found. May 24 15:22:26.812360 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:22:26.812360 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:22:26.812360 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:22:26.812360 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:22:26.812360 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:22:26.812360 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:22:26.812360 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:22:26.812360 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:22:26.812360 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2d4b4da-3b00-41c0-a0ac-21477f232931 could not be found. May 24 15:22:26.812360 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:22:26.815002 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-4f1f95fc-e4d1-443a-b3f6-71642f951dc2 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Returning 404 to user: Instance e2d4b4da-3b00-41c0-a0ac-21477f232931 could not be found. {{(pid=117699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:22:26.816378 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-4f1f95fc-e4d1-443a-b3f6-71642f951dc2 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] 10.222.0.45 "GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931" status: 404 len: 111 microversion: 2.1 time: 0.048716 May 24 15:22:26.818391 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [req-bf712054-ca45-4896-ac5c-37edaa2bb0f0 req-142a2ef2-1055-491a-be5c-d8ab6d55c27d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c395e512-b693-4a96-8301-640831fee66f", "name": "network-vif-plugged", "status": "completed", "tag": "3b9228a9-f1b9-4ba1-9526-b1b918986c1b"}]} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:22:26.837287 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-bf712054-ca45-4896-ac5c-37edaa2bb0f0 req-142a2ef2-1055-491a-be5c-d8ab6d55c27d service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:26.838217 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 163/334] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:26 2022] GET /compute/v2.1/servers/e2d4b4da-3b00-41c0-a0ac-21477f232931 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:22:26.838340 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-bf712054-ca45-4896-ac5c-37edaa2bb0f0 req-142a2ef2-1055-491a-be5c-d8ab6d55c27d service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:26.854989 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-683f341e-d9b1-4040-972b-502543590bbc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:26.856517 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-683f341e-d9b1-4040-972b-502543590bbc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:26.872934 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.compute.server_external_events [req-bf712054-ca45-4896-ac5c-37edaa2bb0f0 req-142a2ef2-1055-491a-be5c-d8ab6d55c27d service nova] Creating event network-vif-plugged:3b9228a9-f1b9-4ba1-9526-b1b918986c1b for instance c395e512-b693-4a96-8301-640831fee66f on hv-cinder-84315 May 24 15:22:26.873172 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-683f341e-d9b1-4040-972b-502543590bbc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:26.873780 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-683f341e-d9b1-4040-972b-502543590bbc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:26.877943 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-683f341e-d9b1-4040-972b-502543590bbc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:26.878597 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-683f341e-d9b1-4040-972b-502543590bbc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:26.880719 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [req-bf712054-ca45-4896-ac5c-37edaa2bb0f0 req-142a2ef2-1055-491a-be5c-d8ab6d55c27d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066963 May 24 15:22:26.886751 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 172/335] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:22:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:22:26.974061 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-2779a25c-7853-49e1-863c-a36597778f96 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-436989400", "imageRef": "f921f75e-bbd1-4d99-ab1e-5cce2d895148", "flavorRef": "452", "networks": [{"uuid": "723319e7-0003-40d4-b31a-e8bfdc78ea04"}]}} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:22:27.065703 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.network.neutron [None req-2779a25c-7853-49e1-863c-a36597778f96 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] validate_networks() for [('723319e7-0003-40d4-b31a-e8bfdc78ea04', None, None, None, None, None)] {{(pid=117698) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 15:22:27.139420 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-683f341e-d9b1-4040-972b-502543590bbc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:27.156693 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-683f341e-d9b1-4040-972b-502543590bbc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1371 microversion: 2.1 time: 0.313229 May 24 15:22:27.158032 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 164/336] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:26 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1371 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:27.371993 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e83c334a-bcf3-4a0f-9476-fdfb41fadd91 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:27.373469 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-e83c334a-bcf3-4a0f-9476-fdfb41fadd91 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:27.382757 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e83c334a-bcf3-4a0f-9476-fdfb41fadd91 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:27.383196 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e83c334a-bcf3-4a0f-9476-fdfb41fadd91 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:27.385805 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e83c334a-bcf3-4a0f-9476-fdfb41fadd91 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:27.392244 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e83c334a-bcf3-4a0f-9476-fdfb41fadd91 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:27.535794 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.virt.hardware [None req-2779a25c-7853-49e1-863c-a36597778f96 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Flavor limits 0:0:0 {{(pid=117698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 15:22:27.537035 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.virt.hardware [None req-2779a25c-7853-49e1-863c-a36597778f96 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Image limits 0:0:0 {{(pid=117698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 15:22:27.538135 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.virt.hardware [None req-2779a25c-7853-49e1-863c-a36597778f96 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Flavor pref 0:0:0 {{(pid=117698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 15:22:27.539021 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.virt.hardware [None req-2779a25c-7853-49e1-863c-a36597778f96 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Image pref 0:0:0 {{(pid=117698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 15:22:27.539584 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.virt.hardware [None req-2779a25c-7853-49e1-863c-a36597778f96 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 15:22:27.574287 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-e83c334a-bcf3-4a0f-9476-fdfb41fadd91 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:27.578269 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2779a25c-7853-49e1-863c-a36597778f96 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:27.578715 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2779a25c-7853-49e1-863c-a36597778f96 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:27.579556 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2779a25c-7853-49e1-863c-a36597778f96 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:27.582390 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2779a25c-7853-49e1-863c-a36597778f96 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:27.586601 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-e83c334a-bcf3-4a0f-9476-fdfb41fadd91 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:27.588638 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-e83c334a-bcf3-4a0f-9476-fdfb41fadd91 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:27.590559 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-e83c334a-bcf3-4a0f-9476-fdfb41fadd91 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1740 microversion: 2.20 time: 0.225294 May 24 15:22:27.591669 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 165/337] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:22:27 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1740 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:22:27.597876 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-deb7ffee-59f3-48d2-a7d7-7e0b221f9b36 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:27.598703 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-deb7ffee-59f3-48d2-a7d7-7e0b221f9b36 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:27.606428 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-deb7ffee-59f3-48d2-a7d7-7e0b221f9b36 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:27.607356 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-deb7ffee-59f3-48d2-a7d7-7e0b221f9b36 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:27.608889 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-deb7ffee-59f3-48d2-a7d7-7e0b221f9b36 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:27.609696 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-deb7ffee-59f3-48d2-a7d7-7e0b221f9b36 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:27.628520 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.quota [None req-2779a25c-7853-49e1-863c-a36597778f96 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Getting quotas for project f7c8c75b264644b7af9831e14cbf7841. Resources: {'instances', 'ram', 'cores'} {{(pid=117698) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 15:22:27.634458 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.quota [None req-2779a25c-7853-49e1-863c-a36597778f96 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Getting quotas for user 2b27ee7d15ca42bca6a09dd18751f01e and project f7c8c75b264644b7af9831e14cbf7841. Resources: {'instances', 'ram', 'cores'} {{(pid=117698) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 15:22:27.648911 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-2779a25c-7853-49e1-863c-a36597778f96 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Going to run 1 instances... {{(pid=117698) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 15:22:27.651369 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-2779a25c-7853-49e1-863c-a36597778f96 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] [instance: a140e45c-3e7e-488d-a0ec-3229ca34fbcf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f921f75e-bbd1-4d99-ab1e-5cce2d895148',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 15:22:27.711565 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-2779a25c-7853-49e1-863c-a36597778f96 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.741832 May 24 15:22:27.712218 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 173/338] 10.222.0.45 () {60 vars in 1146 bytes} [Tue May 24 15:22:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 24 15:22:27.724365 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c4460e15-f36a-4c4b-9a72-ac84f323cc3f tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:27.729857 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-c4460e15-f36a-4c4b-9a72-ac84f323cc3f tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:27.741739 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c4460e15-f36a-4c4b-9a72-ac84f323cc3f tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:27.742112 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c4460e15-f36a-4c4b-9a72-ac84f323cc3f tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:27.742903 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c4460e15-f36a-4c4b-9a72-ac84f323cc3f tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:27.743344 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c4460e15-f36a-4c4b-9a72-ac84f323cc3f tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:27.869466 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-deb7ffee-59f3-48d2-a7d7-7e0b221f9b36 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:27.882231 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-deb7ffee-59f3-48d2-a7d7-7e0b221f9b36 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1357 microversion: 2.1 time: 0.288909 May 24 15:22:27.882935 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 166/339] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:27 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1357 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:27.897158 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-130ef5a2-7c8f-4ddb-90d1-5a9bc258dfa6 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:27.897869 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-130ef5a2-7c8f-4ddb-90d1-5a9bc258dfa6 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] [instance: a140e45c-3e7e-488d-a0ec-3229ca34fbcf] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:27.961656 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-130ef5a2-7c8f-4ddb-90d1-5a9bc258dfa6 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b27ee7d15ca42bca6a09dd18751f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c8c75b264644b7af9831e14cbf7841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:27.970476 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-130ef5a2-7c8f-4ddb-90d1-5a9bc258dfa6 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] 10.222.0.45 "GET /compute/v2.1/servers/a140e45c-3e7e-488d-a0ec-3229ca34fbcf" status: 200 len: 1213 microversion: 2.1 time: 0.077381 May 24 15:22:27.980205 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 167/340] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:27 2022] GET /compute/v2.1/servers/a140e45c-3e7e-488d-a0ec-3229ca34fbcf => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:28.146190 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-c4460e15-f36a-4c4b-9a72-ac84f323cc3f tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:28.153189 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:22:28.157377 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-c4460e15-f36a-4c4b-9a72-ac84f323cc3f tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1724 microversion: 2.1 time: 0.444128 May 24 15:22:28.167177 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 174/341] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:27 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1724 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:28.173640 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-2a4ae723-4e0a-4457-b17b-3312b04b970d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:28.174249 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-2a4ae723-4e0a-4457-b17b-3312b04b970d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:28.186217 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2a4ae723-4e0a-4457-b17b-3312b04b970d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:28.191291 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2a4ae723-4e0a-4457-b17b-3312b04b970d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:28.192154 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2a4ae723-4e0a-4457-b17b-3312b04b970d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:28.192784 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2a4ae723-4e0a-4457-b17b-3312b04b970d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:28.395021 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-2a4ae723-4e0a-4457-b17b-3312b04b970d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:28.412500 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-2a4ae723-4e0a-4457-b17b-3312b04b970d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1371 microversion: 2.1 time: 0.242406 May 24 15:22:28.413077 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 168/342] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:28 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1371 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:28.613352 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-dbdab38d-8738-48c2-823b-457336295f87 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:28.613953 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-dbdab38d-8738-48c2-823b-457336295f87 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:28.625072 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dbdab38d-8738-48c2-823b-457336295f87 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:28.637063 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dbdab38d-8738-48c2-823b-457336295f87 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:28.637898 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dbdab38d-8738-48c2-823b-457336295f87 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:28.638334 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dbdab38d-8738-48c2-823b-457336295f87 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:28.803772 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-dbdab38d-8738-48c2-823b-457336295f87 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:28.812001 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-dbdab38d-8738-48c2-823b-457336295f87 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:28.813523 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-dbdab38d-8738-48c2-823b-457336295f87 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:28.814674 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-dbdab38d-8738-48c2-823b-457336295f87 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1740 microversion: 2.20 time: 0.210090 May 24 15:22:28.815403 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 175/343] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:22:28 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1740 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:22:28.899026 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-dd89f859-0d35-48dd-984a-dd98405c77d5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:28.899876 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-dd89f859-0d35-48dd-984a-dd98405c77d5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:28.912497 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dd89f859-0d35-48dd-984a-dd98405c77d5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:28.913184 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dd89f859-0d35-48dd-984a-dd98405c77d5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:28.921327 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dd89f859-0d35-48dd-984a-dd98405c77d5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:28.921855 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dd89f859-0d35-48dd-984a-dd98405c77d5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:28.988012 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-980b9f3a-278e-4df8-ac03-275dcb070518 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:28.988892 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-980b9f3a-278e-4df8-ac03-275dcb070518 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] [instance: a140e45c-3e7e-488d-a0ec-3229ca34fbcf] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:29.003405 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-980b9f3a-278e-4df8-ac03-275dcb070518 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:29.004119 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-980b9f3a-278e-4df8-ac03-275dcb070518 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:29.004931 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-980b9f3a-278e-4df8-ac03-275dcb070518 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:29.005368 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-980b9f3a-278e-4df8-ac03-275dcb070518 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:29.129522 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-980b9f3a-278e-4df8-ac03-275dcb070518 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b27ee7d15ca42bca6a09dd18751f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c8c75b264644b7af9831e14cbf7841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:29.138271 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-980b9f3a-278e-4df8-ac03-275dcb070518 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] 10.222.0.45 "GET /compute/v2.1/servers/a140e45c-3e7e-488d-a0ec-3229ca34fbcf" status: 200 len: 1209 microversion: 2.1 time: 0.154320 May 24 15:22:29.148761 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 176/344] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:28 2022] GET /compute/v2.1/servers/a140e45c-3e7e-488d-a0ec-3229ca34fbcf => generated 1209 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:22:29.153740 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-dd89f859-0d35-48dd-984a-dd98405c77d5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:29.162761 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-dd89f859-0d35-48dd-984a-dd98405c77d5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1357 microversion: 2.1 time: 0.267633 May 24 15:22:29.163896 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 169/345] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:28 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1357 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:29.174380 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-52486a65-43b5-4a4e-8fef-718c19a42c12 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:29.178657 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-52486a65-43b5-4a4e-8fef-718c19a42c12 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:29.192045 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-52486a65-43b5-4a4e-8fef-718c19a42c12 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:29.193033 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-52486a65-43b5-4a4e-8fef-718c19a42c12 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:29.194034 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-52486a65-43b5-4a4e-8fef-718c19a42c12 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:29.194685 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-52486a65-43b5-4a4e-8fef-718c19a42c12 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:29.368545 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-52486a65-43b5-4a4e-8fef-718c19a42c12 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:29.390138 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-52486a65-43b5-4a4e-8fef-718c19a42c12 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1724 microversion: 2.1 time: 0.219590 May 24 15:22:29.402287 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 177/346] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:29 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1724 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:22:29.430349 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-0b8f894b-0db9-4c59-9ab1-6a85a968a6d7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:29.431108 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-0b8f894b-0db9-4c59-9ab1-6a85a968a6d7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:29.447925 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0b8f894b-0db9-4c59-9ab1-6a85a968a6d7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:29.448574 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0b8f894b-0db9-4c59-9ab1-6a85a968a6d7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:29.449488 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0b8f894b-0db9-4c59-9ab1-6a85a968a6d7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:29.450157 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0b8f894b-0db9-4c59-9ab1-6a85a968a6d7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:29.620550 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-0b8f894b-0db9-4c59-9ab1-6a85a968a6d7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:29.630154 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-0b8f894b-0db9-4c59-9ab1-6a85a968a6d7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1371 microversion: 2.1 time: 0.203661 May 24 15:22:29.631544 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 170/347] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:29 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1371 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:29.833880 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-7ef4bd15-546f-4da0-a938-cdb1957456a7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:29.834484 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-7ef4bd15-546f-4da0-a938-cdb1957456a7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:29.841313 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7ef4bd15-546f-4da0-a938-cdb1957456a7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:29.842357 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7ef4bd15-546f-4da0-a938-cdb1957456a7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:29.843494 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7ef4bd15-546f-4da0-a938-cdb1957456a7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:29.844100 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7ef4bd15-546f-4da0-a938-cdb1957456a7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:29.999091 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-7ef4bd15-546f-4da0-a938-cdb1957456a7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:30.009058 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-7ef4bd15-546f-4da0-a938-cdb1957456a7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:30.011112 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-7ef4bd15-546f-4da0-a938-cdb1957456a7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:30.012589 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-7ef4bd15-546f-4da0-a938-cdb1957456a7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1740 microversion: 2.20 time: 0.182482 May 24 15:22:30.023707 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 178/348] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:22:29 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1740 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:22:30.155718 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-27f3c57d-c91d-475e-9429-7510898a63d7 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:30.156206 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-27f3c57d-c91d-475e-9429-7510898a63d7 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] [instance: a140e45c-3e7e-488d-a0ec-3229ca34fbcf] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:30.175570 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-27f3c57d-c91d-475e-9429-7510898a63d7 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:30.176344 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-27f3c57d-c91d-475e-9429-7510898a63d7 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:30.177322 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-27f3c57d-c91d-475e-9429-7510898a63d7 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:30.177947 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-27f3c57d-c91d-475e-9429-7510898a63d7 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:30.179469 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d9fd3b42-7576-46fc-ba81-80b1a23996d7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:30.182371 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d9fd3b42-7576-46fc-ba81-80b1a23996d7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:30.189771 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d9fd3b42-7576-46fc-ba81-80b1a23996d7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:30.190236 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d9fd3b42-7576-46fc-ba81-80b1a23996d7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:30.190999 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d9fd3b42-7576-46fc-ba81-80b1a23996d7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:30.191438 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d9fd3b42-7576-46fc-ba81-80b1a23996d7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:30.311325 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-27f3c57d-c91d-475e-9429-7510898a63d7 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b27ee7d15ca42bca6a09dd18751f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c8c75b264644b7af9831e14cbf7841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:30.319521 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-27f3c57d-c91d-475e-9429-7510898a63d7 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] 10.222.0.45 "GET /compute/v2.1/servers/a140e45c-3e7e-488d-a0ec-3229ca34fbcf" status: 200 len: 1265 microversion: 2.1 time: 0.168212 May 24 15:22:30.322671 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 171/349] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:30 2022] GET /compute/v2.1/servers/a140e45c-3e7e-488d-a0ec-3229ca34fbcf => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:30.408934 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-9929d9f4-ac70-4c7b-8bca-d5119a4e1e66 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:30.409560 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-9929d9f4-ac70-4c7b-8bca-d5119a4e1e66 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:30.412510 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:22:30.456521 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9929d9f4-ac70-4c7b-8bca-d5119a4e1e66 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:30.457146 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9929d9f4-ac70-4c7b-8bca-d5119a4e1e66 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:30.457907 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9929d9f4-ac70-4c7b-8bca-d5119a4e1e66 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:30.458351 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9929d9f4-ac70-4c7b-8bca-d5119a4e1e66 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:30.461447 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-d9fd3b42-7576-46fc-ba81-80b1a23996d7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:30.476712 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d9fd3b42-7576-46fc-ba81-80b1a23996d7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1548 microversion: 2.1 time: 0.296767 May 24 15:22:30.477651 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 179/350] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:30 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1548 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:30.494535 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-95deeda1-6342-47dd-9d85-293e03b7e7ee tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:30.495264 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-95deeda1-6342-47dd-9d85-293e03b7e7ee tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:30.503177 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-95deeda1-6342-47dd-9d85-293e03b7e7ee tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:30.503630 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-95deeda1-6342-47dd-9d85-293e03b7e7ee tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:30.504454 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-95deeda1-6342-47dd-9d85-293e03b7e7ee tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:30.504893 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-95deeda1-6342-47dd-9d85-293e03b7e7ee tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:30.700322 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-9929d9f4-ac70-4c7b-8bca-d5119a4e1e66 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:30.709993 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-9929d9f4-ac70-4c7b-8bca-d5119a4e1e66 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1724 microversion: 2.1 time: 0.305789 May 24 15:22:30.711482 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 172/351] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:30 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1724 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:30.719726 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-ad4648ea-9614-43cb-910a-678ef70b775c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:30.724384 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-ad4648ea-9614-43cb-910a-678ef70b775c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:30.740686 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ad4648ea-9614-43cb-910a-678ef70b775c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:30.741142 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ad4648ea-9614-43cb-910a-678ef70b775c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:30.741928 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ad4648ea-9614-43cb-910a-678ef70b775c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:30.742366 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ad4648ea-9614-43cb-910a-678ef70b775c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:31.060689 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-95deeda1-6342-47dd-9d85-293e03b7e7ee tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:31.086864 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-95deeda1-6342-47dd-9d85-293e03b7e7ee tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1548 microversion: 2.1 time: 0.596153 May 24 15:22:31.087444 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 180/352] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:30 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1548 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:31.095667 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [req-60a92ecc-c6da-48ed-a042-198aea95be51 req-a6691dd2-ab5c-40cf-a191-efae294f79d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3017990e-8735-4d85-a686-1eebb1484dd3", "name": "network-vif-plugged", "status": "completed", "tag": "ca6cef6e-61fd-4449-934f-86f49e0487c0"}]} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:22:31.120527 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-60a92ecc-c6da-48ed-a042-198aea95be51 req-a6691dd2-ab5c-40cf-a191-efae294f79d2 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:31.120965 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-60a92ecc-c6da-48ed-a042-198aea95be51 req-a6691dd2-ab5c-40cf-a191-efae294f79d2 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:31.149611 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.compute.server_external_events [req-60a92ecc-c6da-48ed-a042-198aea95be51 req-a6691dd2-ab5c-40cf-a191-efae294f79d2 service nova] Creating event network-vif-plugged:ca6cef6e-61fd-4449-934f-86f49e0487c0 for instance 3017990e-8735-4d85-a686-1eebb1484dd3 on hv-cinder-84315 May 24 15:22:31.171249 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [req-60a92ecc-c6da-48ed-a042-198aea95be51 req-a6691dd2-ab5c-40cf-a191-efae294f79d2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081782 May 24 15:22:31.171625 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-ad4648ea-9614-43cb-910a-678ef70b775c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:31.173869 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 181/353] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:22:31.180817 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-ad4648ea-9614-43cb-910a-678ef70b775c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1371 microversion: 2.1 time: 0.468268 May 24 15:22:31.187501 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-82bd0bc5-d225-4416-bfda-63c08ba501dc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:31.188807 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-82bd0bc5-d225-4416-bfda-63c08ba501dc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:31.190911 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 173/354] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:30 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1371 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:31.195999 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-712b51a9-f14b-4fc9-af46-8e1bbacb5961 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:31.199796 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-712b51a9-f14b-4fc9-af46-8e1bbacb5961 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:31.200770 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-712b51a9-f14b-4fc9-af46-8e1bbacb5961 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Searching by: {'deleted': False, 'project_id': 'cb659dae6f4b4f26a2d869138f573561'} {{(pid=117699) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 24 15:22:31.204774 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-82bd0bc5-d225-4416-bfda-63c08ba501dc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:31.205809 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-82bd0bc5-d225-4416-bfda-63c08ba501dc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:31.210936 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-82bd0bc5-d225-4416-bfda-63c08ba501dc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:31.211404 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-82bd0bc5-d225-4416-bfda-63c08ba501dc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:31.228277 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-712b51a9-f14b-4fc9-af46-8e1bbacb5961 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:31.232710 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-712b51a9-f14b-4fc9-af46-8e1bbacb5961 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:31.234042 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-712b51a9-f14b-4fc9-af46-8e1bbacb5961 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:31.234738 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-712b51a9-f14b-4fc9-af46-8e1bbacb5961 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:31.387447 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.multi_cell_list [None req-712b51a9-f14b-4fc9-af46-8e1bbacb5961 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117699) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 24 15:22:31.549516 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-82bd0bc5-d225-4416-bfda-63c08ba501dc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:31.557779 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-82bd0bc5-d225-4416-bfda-63c08ba501dc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:31.559862 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-82bd0bc5-d225-4416-bfda-63c08ba501dc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:31.566875 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-82bd0bc5-d225-4416-bfda-63c08ba501dc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1740 microversion: 2.20 time: 0.390953 May 24 15:22:31.567679 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 182/355] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:22:31 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1740 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:22:31.583932 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-29a26eb3-a6d8-4f21-8def-9f05137c21c1 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:31.584776 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-29a26eb3-a6d8-4f21-8def-9f05137c21c1 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] [instance: a140e45c-3e7e-488d-a0ec-3229ca34fbcf] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:31.591111 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-29a26eb3-a6d8-4f21-8def-9f05137c21c1 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:31.591812 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-29a26eb3-a6d8-4f21-8def-9f05137c21c1 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:31.592986 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-29a26eb3-a6d8-4f21-8def-9f05137c21c1 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:31.593633 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-29a26eb3-a6d8-4f21-8def-9f05137c21c1 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:31.594352 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-712b51a9-f14b-4fc9-af46-8e1bbacb5961 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.401513 May 24 15:22:31.597218 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 174/356] 10.222.0.45 () {58 vars in 1124 bytes} [Tue May 24 15:22:31 2022] GET /compute/v2.1/servers => generated 342 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:22:31.607707 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-949f4003-8a81-466c-a613-a3cc2afbf389 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:31.618684 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-949f4003-8a81-466c-a613-a3cc2afbf389 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:31.629569 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-949f4003-8a81-466c-a613-a3cc2afbf389 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:31.630035 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-949f4003-8a81-466c-a613-a3cc2afbf389 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:31.630959 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-949f4003-8a81-466c-a613-a3cc2afbf389 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:31.631404 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-949f4003-8a81-466c-a613-a3cc2afbf389 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:31.722546 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-29a26eb3-a6d8-4f21-8def-9f05137c21c1 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b27ee7d15ca42bca6a09dd18751f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c8c75b264644b7af9831e14cbf7841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:31.737825 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-29a26eb3-a6d8-4f21-8def-9f05137c21c1 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] 10.222.0.45 "GET /compute/v2.1/servers/a140e45c-3e7e-488d-a0ec-3229ca34fbcf" status: 200 len: 1271 microversion: 2.1 time: 0.158313 May 24 15:22:31.738767 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 183/357] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:31 2022] GET /compute/v2.1/servers/a140e45c-3e7e-488d-a0ec-3229ca34fbcf => generated 1271 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:31.747588 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-9bab8e5d-00d0-45b6-b5e5-fcf567650d57 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:31.751219 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-9bab8e5d-00d0-45b6-b5e5-fcf567650d57 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:31.766372 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9bab8e5d-00d0-45b6-b5e5-fcf567650d57 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:31.773769 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9bab8e5d-00d0-45b6-b5e5-fcf567650d57 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:31.775538 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9bab8e5d-00d0-45b6-b5e5-fcf567650d57 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:31.776055 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9bab8e5d-00d0-45b6-b5e5-fcf567650d57 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:31.805054 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-949f4003-8a81-466c-a613-a3cc2afbf389 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:31.814499 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-949f4003-8a81-466c-a613-a3cc2afbf389 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1548 microversion: 2.1 time: 0.211095 May 24 15:22:31.824594 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 175/358] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:31 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1548 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:32.016614 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-9bab8e5d-00d0-45b6-b5e5-fcf567650d57 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:32.025011 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-9bab8e5d-00d0-45b6-b5e5-fcf567650d57 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1724 microversion: 2.1 time: 0.282476 May 24 15:22:32.028790 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 184/359] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:31 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1724 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:32.202395 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-84b596f9-4b4d-4414-b802-be712d5d96db tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:32.203240 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-84b596f9-4b4d-4414-b802-be712d5d96db tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:32.220641 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-84b596f9-4b4d-4414-b802-be712d5d96db tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:32.221096 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-84b596f9-4b4d-4414-b802-be712d5d96db tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:32.235753 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-84b596f9-4b4d-4414-b802-be712d5d96db tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:32.236242 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-84b596f9-4b4d-4414-b802-be712d5d96db tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:32.246860 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:22:32.588833 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-370f8269-651e-47a6-8e8a-3e6b8adb79ce tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:32.590337 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-370f8269-651e-47a6-8e8a-3e6b8adb79ce tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:32.602566 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-370f8269-651e-47a6-8e8a-3e6b8adb79ce tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:32.604703 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-370f8269-651e-47a6-8e8a-3e6b8adb79ce tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:32.606291 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-370f8269-651e-47a6-8e8a-3e6b8adb79ce tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:32.608980 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-370f8269-651e-47a6-8e8a-3e6b8adb79ce tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:32.611907 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-84b596f9-4b4d-4414-b802-be712d5d96db tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:32.625326 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-84b596f9-4b4d-4414-b802-be712d5d96db tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1371 microversion: 2.1 time: 0.428238 May 24 15:22:32.626375 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 176/360] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:32 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1371 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:32.755555 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-8248ae65-a9b6-4118-89d3-d45f35168814 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:32.756338 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-8248ae65-a9b6-4118-89d3-d45f35168814 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] [instance: a140e45c-3e7e-488d-a0ec-3229ca34fbcf] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:32.762815 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8248ae65-a9b6-4118-89d3-d45f35168814 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:32.763551 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8248ae65-a9b6-4118-89d3-d45f35168814 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:32.764582 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8248ae65-a9b6-4118-89d3-d45f35168814 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:32.765336 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8248ae65-a9b6-4118-89d3-d45f35168814 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:32.917073 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-370f8269-651e-47a6-8e8a-3e6b8adb79ce tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:32.926447 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-370f8269-651e-47a6-8e8a-3e6b8adb79ce tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:32.931386 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-370f8269-651e-47a6-8e8a-3e6b8adb79ce tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:32.934875 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-370f8269-651e-47a6-8e8a-3e6b8adb79ce tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1740 microversion: 2.20 time: 0.350498 May 24 15:22:32.947866 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 185/361] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:22:32 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1740 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:22:32.951339 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-8248ae65-a9b6-4118-89d3-d45f35168814 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b27ee7d15ca42bca6a09dd18751f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c8c75b264644b7af9831e14cbf7841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:32.962059 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-8248ae65-a9b6-4118-89d3-d45f35168814 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] 10.222.0.45 "GET /compute/v2.1/servers/a140e45c-3e7e-488d-a0ec-3229ca34fbcf" status: 200 len: 1313 microversion: 2.1 time: 0.210230 May 24 15:22:32.963136 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 177/362] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:32 2022] GET /compute/v2.1/servers/a140e45c-3e7e-488d-a0ec-3229ca34fbcf => generated 1313 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:22:33.045404 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-9957deb0-b5d7-441f-845c-9f8b7ef7d2c9 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:33.046379 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-9957deb0-b5d7-441f-845c-9f8b7ef7d2c9 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:33.052587 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9957deb0-b5d7-441f-845c-9f8b7ef7d2c9 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:33.053313 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9957deb0-b5d7-441f-845c-9f8b7ef7d2c9 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:33.054381 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9957deb0-b5d7-441f-845c-9f8b7ef7d2c9 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:33.055033 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9957deb0-b5d7-441f-845c-9f8b7ef7d2c9 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:33.331669 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-9957deb0-b5d7-441f-845c-9f8b7ef7d2c9 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:33.340542 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-9957deb0-b5d7-441f-845c-9f8b7ef7d2c9 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1724 microversion: 2.1 time: 0.298421 May 24 15:22:33.341118 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 186/363] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:33 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1724 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:22:33.497750 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [req-4b937559-8c26-444c-b723-0e0dec33636d req-a1af0edd-aec0-4b80-a000-6ba6e3454ccb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a140e45c-3e7e-488d-a0ec-3229ca34fbcf", "tag": "5e3b2905-304a-40e3-bf51-a328ddddff86"}]} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:22:33.513581 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-4b937559-8c26-444c-b723-0e0dec33636d req-a1af0edd-aec0-4b80-a000-6ba6e3454ccb service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:33.514291 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-4b937559-8c26-444c-b723-0e0dec33636d req-a1af0edd-aec0-4b80-a000-6ba6e3454ccb service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:33.530481 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.compute.server_external_events [req-4b937559-8c26-444c-b723-0e0dec33636d req-a1af0edd-aec0-4b80-a000-6ba6e3454ccb service nova] Creating event network-changed:5e3b2905-304a-40e3-bf51-a328ddddff86 for instance a140e45c-3e7e-488d-a0ec-3229ca34fbcf on hv-cinder-84315 May 24 15:22:33.553185 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [req-4b937559-8c26-444c-b723-0e0dec33636d req-a1af0edd-aec0-4b80-a000-6ba6e3454ccb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058200 May 24 15:22:33.554749 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 178/364] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:22:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:22:33.642159 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-2dc33d74-bf60-4772-a001-0896ba3beb4f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:33.643397 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-2dc33d74-bf60-4772-a001-0896ba3beb4f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:33.652703 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2dc33d74-bf60-4772-a001-0896ba3beb4f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:33.653157 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2dc33d74-bf60-4772-a001-0896ba3beb4f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:33.653966 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2dc33d74-bf60-4772-a001-0896ba3beb4f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:33.654405 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2dc33d74-bf60-4772-a001-0896ba3beb4f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:33.970030 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-5277e215-96e5-4e91-9769-1d629920e690 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:33.970726 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-5277e215-96e5-4e91-9769-1d629920e690 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:33.983247 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5277e215-96e5-4e91-9769-1d629920e690 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:33.983965 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5277e215-96e5-4e91-9769-1d629920e690 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:33.985078 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5277e215-96e5-4e91-9769-1d629920e690 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:33.985846 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5277e215-96e5-4e91-9769-1d629920e690 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:33.993046 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-2dc33d74-bf60-4772-a001-0896ba3beb4f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:34.002556 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-2dc33d74-bf60-4772-a001-0896ba3beb4f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1564 microversion: 2.1 time: 0.364307 May 24 15:22:34.003126 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 187/365] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:33 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1564 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:34.011417 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-48b13606-aa08-4795-9693-f0104911475f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3cbf20c3-d23e-45ec-9308-c45fc0665b2d"}} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:22:34.014418 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-48b13606-aa08-4795-9693-f0104911475f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:34.022384 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-48b13606-aa08-4795-9693-f0104911475f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:34.023097 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-48b13606-aa08-4795-9693-f0104911475f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:34.024070 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-48b13606-aa08-4795-9693-f0104911475f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:34.024567 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-48b13606-aa08-4795-9693-f0104911475f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:34.180666 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-5277e215-96e5-4e91-9769-1d629920e690 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:34.190780 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-5277e215-96e5-4e91-9769-1d629920e690 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:34.192637 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-5277e215-96e5-4e91-9769-1d629920e690 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:34.194755 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-5277e215-96e5-4e91-9769-1d629920e690 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1740 microversion: 2.20 time: 0.244481 May 24 15:22:34.195820 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 179/366] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:22:33 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1740 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:22:34.200489 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-afcd2d71-2180-483a-9785-443985460762 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:34.201083 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-afcd2d71-2180-483a-9785-443985460762 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] [instance: a140e45c-3e7e-488d-a0ec-3229ca34fbcf] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:34.208116 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-afcd2d71-2180-483a-9785-443985460762 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:34.209132 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-afcd2d71-2180-483a-9785-443985460762 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:34.210020 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-afcd2d71-2180-483a-9785-443985460762 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:34.210523 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-afcd2d71-2180-483a-9785-443985460762 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:34.384014 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-afcd2d71-2180-483a-9785-443985460762 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b27ee7d15ca42bca6a09dd18751f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c8c75b264644b7af9831e14cbf7841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:34.392236 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-afcd2d71-2180-483a-9785-443985460762 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] 10.222.0.45 "GET /compute/v2.1/servers/a140e45c-3e7e-488d-a0ec-3229ca34fbcf" status: 200 len: 1313 microversion: 2.1 time: 0.195095 May 24 15:22:34.393317 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 180/367] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:34 2022] GET /compute/v2.1/servers/a140e45c-3e7e-488d-a0ec-3229ca34fbcf => generated 1313 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:34.398546 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a8f1709d-f9d7-4c6d-a65c-e8d8dfa75709 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:34.399234 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a8f1709d-f9d7-4c6d-a65c-e8d8dfa75709 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:34.416041 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a8f1709d-f9d7-4c6d-a65c-e8d8dfa75709 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:34.417746 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a8f1709d-f9d7-4c6d-a65c-e8d8dfa75709 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:34.420692 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a8f1709d-f9d7-4c6d-a65c-e8d8dfa75709 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:34.421840 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a8f1709d-f9d7-4c6d-a65c-e8d8dfa75709 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:34.461361 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-48b13606-aa08-4795-9693-f0104911475f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "POST /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.455246 May 24 15:22:34.461976 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 188/368] 10.222.0.45 () {60 vars in 1322 bytes} [Tue May 24 15:22:34 2022] POST /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 194 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:22:34.469894 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-fe35114c-4309-4525-925d-f635701519f3 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:34.470598 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-fe35114c-4309-4525-925d-f635701519f3 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:34.485220 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fe35114c-4309-4525-925d-f635701519f3 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:34.486382 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fe35114c-4309-4525-925d-f635701519f3 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:34.487269 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fe35114c-4309-4525-925d-f635701519f3 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:34.487714 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fe35114c-4309-4525-925d-f635701519f3 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:34.557830 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a8f1709d-f9d7-4c6d-a65c-e8d8dfa75709 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.163173 May 24 15:22:34.564782 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 181/369] 10.222.0.45 () {58 vars in 1274 bytes} [Tue May 24 15:22:34 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-interface => generated 284 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:22:34.651442 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-fe35114c-4309-4525-925d-f635701519f3 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:34.663189 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-fe35114c-4309-4525-925d-f635701519f3 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1724 microversion: 2.1 time: 0.200014 May 24 15:22:34.663932 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 189/370] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:34 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1724 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:35.214229 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f73aa429-2979-4197-9c9a-1eabab8959a4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:35.216823 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f73aa429-2979-4197-9c9a-1eabab8959a4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:35.223346 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f73aa429-2979-4197-9c9a-1eabab8959a4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:35.224278 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f73aa429-2979-4197-9c9a-1eabab8959a4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:35.225388 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f73aa429-2979-4197-9c9a-1eabab8959a4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:35.225973 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f73aa429-2979-4197-9c9a-1eabab8959a4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:35.413567 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-f2a8d437-efd1-4431-a344-fedf983c1c97 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:35.414583 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-f2a8d437-efd1-4431-a344-fedf983c1c97 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] [instance: a140e45c-3e7e-488d-a0ec-3229ca34fbcf] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:35.430229 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f2a8d437-efd1-4431-a344-fedf983c1c97 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:35.430921 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f2a8d437-efd1-4431-a344-fedf983c1c97 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:35.431886 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f2a8d437-efd1-4431-a344-fedf983c1c97 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:35.432331 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f2a8d437-efd1-4431-a344-fedf983c1c97 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:35.499360 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-f73aa429-2979-4197-9c9a-1eabab8959a4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:35.523064 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-f73aa429-2979-4197-9c9a-1eabab8959a4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:35.527839 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-f73aa429-2979-4197-9c9a-1eabab8959a4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:35.532067 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f73aa429-2979-4197-9c9a-1eabab8959a4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1740 microversion: 2.20 time: 0.320124 May 24 15:22:35.533015 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 182/371] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:22:35 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1740 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:22:35.618945 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-f2a8d437-efd1-4431-a344-fedf983c1c97 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b27ee7d15ca42bca6a09dd18751f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c8c75b264644b7af9831e14cbf7841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:35.622048 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:22:35.639423 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-f2a8d437-efd1-4431-a344-fedf983c1c97 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] 10.222.0.45 "GET /compute/v2.1/servers/a140e45c-3e7e-488d-a0ec-3229ca34fbcf" status: 200 len: 1313 microversion: 2.1 time: 0.234355 May 24 15:22:35.640116 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 190/372] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:35 2022] GET /compute/v2.1/servers/a140e45c-3e7e-488d-a0ec-3229ca34fbcf => generated 1313 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:35.680806 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d860c7ac-6afe-41e8-bee3-9a5d5873c4d4 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:35.681403 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d860c7ac-6afe-41e8-bee3-9a5d5873c4d4 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:35.691559 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d860c7ac-6afe-41e8-bee3-9a5d5873c4d4 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:35.692012 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d860c7ac-6afe-41e8-bee3-9a5d5873c4d4 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:35.692870 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d860c7ac-6afe-41e8-bee3-9a5d5873c4d4 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:35.693545 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d860c7ac-6afe-41e8-bee3-9a5d5873c4d4 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:36.015481 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-d860c7ac-6afe-41e8-bee3-9a5d5873c4d4 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:36.025918 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d860c7ac-6afe-41e8-bee3-9a5d5873c4d4 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1724 microversion: 2.1 time: 0.348523 May 24 15:22:36.027143 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 183/373] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:35 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1724 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:36.113439 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [req-271e9137-2770-4c76-8be7-028d3d389de6 req-ed73a561-8328-470b-9c0b-30561ff1caa7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3017990e-8735-4d85-a686-1eebb1484dd3", "tag": "ca6cef6e-61fd-4449-934f-86f49e0487c0"}]} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:22:36.127688 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-271e9137-2770-4c76-8be7-028d3d389de6 req-ed73a561-8328-470b-9c0b-30561ff1caa7 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:36.128527 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-271e9137-2770-4c76-8be7-028d3d389de6 req-ed73a561-8328-470b-9c0b-30561ff1caa7 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:36.141663 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.compute.server_external_events [req-271e9137-2770-4c76-8be7-028d3d389de6 req-ed73a561-8328-470b-9c0b-30561ff1caa7 service nova] Creating event network-changed:ca6cef6e-61fd-4449-934f-86f49e0487c0 for instance 3017990e-8735-4d85-a686-1eebb1484dd3 on hv-cinder-84315 May 24 15:22:36.148262 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [req-271e9137-2770-4c76-8be7-028d3d389de6 req-ed73a561-8328-470b-9c0b-30561ff1caa7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038310 May 24 15:22:36.153219 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 191/374] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:22:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:22:36.552714 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-058c5df1-3193-46c9-a670-0506d08cd405 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:36.556052 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-058c5df1-3193-46c9-a670-0506d08cd405 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:36.573950 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-058c5df1-3193-46c9-a670-0506d08cd405 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:36.574655 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-058c5df1-3193-46c9-a670-0506d08cd405 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:36.575223 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-058c5df1-3193-46c9-a670-0506d08cd405 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:36.579138 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-058c5df1-3193-46c9-a670-0506d08cd405 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:36.662211 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-9691253e-2ba7-49f5-a2fd-5b8a7b2b2006 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:36.663350 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-9691253e-2ba7-49f5-a2fd-5b8a7b2b2006 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] [instance: a140e45c-3e7e-488d-a0ec-3229ca34fbcf] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:36.671029 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9691253e-2ba7-49f5-a2fd-5b8a7b2b2006 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:36.671748 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9691253e-2ba7-49f5-a2fd-5b8a7b2b2006 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:36.673022 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9691253e-2ba7-49f5-a2fd-5b8a7b2b2006 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:36.673659 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9691253e-2ba7-49f5-a2fd-5b8a7b2b2006 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:36.968944 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-9691253e-2ba7-49f5-a2fd-5b8a7b2b2006 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b27ee7d15ca42bca6a09dd18751f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c8c75b264644b7af9831e14cbf7841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:36.982002 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-9691253e-2ba7-49f5-a2fd-5b8a7b2b2006 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] 10.222.0.45 "GET /compute/v2.1/servers/a140e45c-3e7e-488d-a0ec-3229ca34fbcf" status: 200 len: 1313 microversion: 2.1 time: 0.326992 May 24 15:22:36.994866 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 192/375] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:36 2022] GET /compute/v2.1/servers/a140e45c-3e7e-488d-a0ec-3229ca34fbcf => generated 1313 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:22:37.008153 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-058c5df1-3193-46c9-a670-0506d08cd405 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:37.017947 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-058c5df1-3193-46c9-a670-0506d08cd405 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:37.035671 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-058c5df1-3193-46c9-a670-0506d08cd405 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:37.035671 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-058c5df1-3193-46c9-a670-0506d08cd405 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1740 microversion: 2.20 time: 0.478463 May 24 15:22:37.035671 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 184/376] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:22:36 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1740 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:22:37.054478 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-833555fc-a45d-43f1-ba9f-62be1c638b23 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:37.056349 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-833555fc-a45d-43f1-ba9f-62be1c638b23 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:37.075943 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-833555fc-a45d-43f1-ba9f-62be1c638b23 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:37.076422 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-833555fc-a45d-43f1-ba9f-62be1c638b23 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:37.077214 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-833555fc-a45d-43f1-ba9f-62be1c638b23 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:37.077647 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-833555fc-a45d-43f1-ba9f-62be1c638b23 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:37.384247 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-833555fc-a45d-43f1-ba9f-62be1c638b23 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:37.393618 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-833555fc-a45d-43f1-ba9f-62be1c638b23 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1724 microversion: 2.1 time: 0.343323 May 24 15:22:37.395075 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 193/377] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:37 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1724 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:37.999214 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-35d220a7-e805-47b9-a171-9509d3e41f7c tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:37.999986 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-35d220a7-e805-47b9-a171-9509d3e41f7c tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] [instance: a140e45c-3e7e-488d-a0ec-3229ca34fbcf] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:38.002267 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell0:SELECT=2 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:22:38.013915 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-35d220a7-e805-47b9-a171-9509d3e41f7c tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:38.021110 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-35d220a7-e805-47b9-a171-9509d3e41f7c tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:38.022351 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-35d220a7-e805-47b9-a171-9509d3e41f7c tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:38.023010 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-35d220a7-e805-47b9-a171-9509d3e41f7c tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:38.057194 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d3d03575-256d-40fa-a66d-96d5e6923cde tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:38.058708 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d3d03575-256d-40fa-a66d-96d5e6923cde tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:38.088273 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell0:SELECT=2 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:22:38.089294 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell0:SELECT=6 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:22:38.092586 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d3d03575-256d-40fa-a66d-96d5e6923cde tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:38.097522 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d3d03575-256d-40fa-a66d-96d5e6923cde tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:38.098736 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d3d03575-256d-40fa-a66d-96d5e6923cde tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:38.099332 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d3d03575-256d-40fa-a66d-96d5e6923cde tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:38.230837 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-35d220a7-e805-47b9-a171-9509d3e41f7c tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b27ee7d15ca42bca6a09dd18751f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c8c75b264644b7af9831e14cbf7841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:38.250567 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-35d220a7-e805-47b9-a171-9509d3e41f7c tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] 10.222.0.45 "GET /compute/v2.1/servers/a140e45c-3e7e-488d-a0ec-3229ca34fbcf" status: 200 len: 1313 microversion: 2.1 time: 0.255256 May 24 15:22:38.261239 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 185/378] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:37 2022] GET /compute/v2.1/servers/a140e45c-3e7e-488d-a0ec-3229ca34fbcf => generated 1313 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:38.411073 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-006ebacf-7e48-4741-96f8-8b66571fb461 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:38.411789 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-006ebacf-7e48-4741-96f8-8b66571fb461 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:38.418476 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-006ebacf-7e48-4741-96f8-8b66571fb461 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:38.419064 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-006ebacf-7e48-4741-96f8-8b66571fb461 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:38.419903 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-006ebacf-7e48-4741-96f8-8b66571fb461 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:38.420365 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-006ebacf-7e48-4741-96f8-8b66571fb461 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:38.510813 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-d3d03575-256d-40fa-a66d-96d5e6923cde tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:38.519445 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-d3d03575-256d-40fa-a66d-96d5e6923cde tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:38.520968 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-d3d03575-256d-40fa-a66d-96d5e6923cde tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:38.522204 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d3d03575-256d-40fa-a66d-96d5e6923cde tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1740 microversion: 2.20 time: 0.469702 May 24 15:22:38.522696 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 194/379] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:22:38 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1740 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:22:38.552853 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-006ebacf-7e48-4741-96f8-8b66571fb461 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:38.561222 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-006ebacf-7e48-4741-96f8-8b66571fb461 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1724 microversion: 2.1 time: 0.154079 May 24 15:22:38.561785 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 186/380] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:38 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:22:39.267771 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-ee9e2ea9-e949-4b75-8a64-a06c7797eb8f tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:39.268756 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-ee9e2ea9-e949-4b75-8a64-a06c7797eb8f tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] [instance: a140e45c-3e7e-488d-a0ec-3229ca34fbcf] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:39.276924 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ee9e2ea9-e949-4b75-8a64-a06c7797eb8f tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:39.278337 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ee9e2ea9-e949-4b75-8a64-a06c7797eb8f tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:39.279193 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ee9e2ea9-e949-4b75-8a64-a06c7797eb8f tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:39.279739 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ee9e2ea9-e949-4b75-8a64-a06c7797eb8f tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:39.411156 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [req-6b1f8e4b-bc03-447c-9c13-59565e8e2b75 req-99cbc8eb-6eca-4d0d-80cf-3f22987e02a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a140e45c-3e7e-488d-a0ec-3229ca34fbcf", "name": "network-vif-plugged", "status": "completed", "tag": "5e3b2905-304a-40e3-bf51-a328ddddff86"}]} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:22:39.416086 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ee9e2ea9-e949-4b75-8a64-a06c7797eb8f tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b27ee7d15ca42bca6a09dd18751f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c8c75b264644b7af9831e14cbf7841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:39.424627 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-6b1f8e4b-bc03-447c-9c13-59565e8e2b75 req-99cbc8eb-6eca-4d0d-80cf-3f22987e02a4 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:39.425191 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-6b1f8e4b-bc03-447c-9c13-59565e8e2b75 req-99cbc8eb-6eca-4d0d-80cf-3f22987e02a4 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:39.426210 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-ee9e2ea9-e949-4b75-8a64-a06c7797eb8f tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] 10.222.0.45 "GET /compute/v2.1/servers/a140e45c-3e7e-488d-a0ec-3229ca34fbcf" status: 200 len: 1313 microversion: 2.1 time: 0.162300 May 24 15:22:39.427101 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 195/381] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:39 2022] GET /compute/v2.1/servers/a140e45c-3e7e-488d-a0ec-3229ca34fbcf => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:22:39.437649 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.compute.server_external_events [req-6b1f8e4b-bc03-447c-9c13-59565e8e2b75 req-99cbc8eb-6eca-4d0d-80cf-3f22987e02a4 service nova] Creating event network-vif-plugged:5e3b2905-304a-40e3-bf51-a328ddddff86 for instance a140e45c-3e7e-488d-a0ec-3229ca34fbcf on hv-cinder-84315 May 24 15:22:39.443283 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [req-6b1f8e4b-bc03-447c-9c13-59565e8e2b75 req-99cbc8eb-6eca-4d0d-80cf-3f22987e02a4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038513 May 24 15:22:39.444496 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 187/382] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:22:39.539659 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-f136cd3d-1da0-4b45-ac4d-eb4438ede203 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:39.540261 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-f136cd3d-1da0-4b45-ac4d-eb4438ede203 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:39.547295 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f136cd3d-1da0-4b45-ac4d-eb4438ede203 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:39.547738 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f136cd3d-1da0-4b45-ac4d-eb4438ede203 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:39.548604 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f136cd3d-1da0-4b45-ac4d-eb4438ede203 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:39.549252 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f136cd3d-1da0-4b45-ac4d-eb4438ede203 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:39.580583 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d28add8a-1038-45f6-bec1-31e16e52589c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:39.582514 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d28add8a-1038-45f6-bec1-31e16e52589c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:39.593125 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d28add8a-1038-45f6-bec1-31e16e52589c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:39.593585 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d28add8a-1038-45f6-bec1-31e16e52589c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:39.594493 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d28add8a-1038-45f6-bec1-31e16e52589c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:39.594924 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d28add8a-1038-45f6-bec1-31e16e52589c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:39.721419 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-f136cd3d-1da0-4b45-ac4d-eb4438ede203 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:39.730765 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-f136cd3d-1da0-4b45-ac4d-eb4438ede203 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:39.732494 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-f136cd3d-1da0-4b45-ac4d-eb4438ede203 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:39.734004 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-f136cd3d-1da0-4b45-ac4d-eb4438ede203 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1722 microversion: 2.20 time: 0.198252 May 24 15:22:39.734671 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 196/383] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:22:39 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1722 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:22:39.799767 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-d28add8a-1038-45f6-bec1-31e16e52589c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:39.807757 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d28add8a-1038-45f6-bec1-31e16e52589c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1724 microversion: 2.1 time: 0.232247 May 24 15:22:39.808336 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 188/384] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:39 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1724 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:22:40.443311 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-310831f6-7771-48a5-96ab-bf662ea5bf7d tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:40.443947 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-310831f6-7771-48a5-96ab-bf662ea5bf7d tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] [instance: a140e45c-3e7e-488d-a0ec-3229ca34fbcf] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:40.450881 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-310831f6-7771-48a5-96ab-bf662ea5bf7d tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:40.451286 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-310831f6-7771-48a5-96ab-bf662ea5bf7d tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:40.452032 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-310831f6-7771-48a5-96ab-bf662ea5bf7d tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:40.452569 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-310831f6-7771-48a5-96ab-bf662ea5bf7d tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:40.575996 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-310831f6-7771-48a5-96ab-bf662ea5bf7d tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b27ee7d15ca42bca6a09dd18751f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c8c75b264644b7af9831e14cbf7841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:40.583492 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-310831f6-7771-48a5-96ab-bf662ea5bf7d tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] 10.222.0.45 "GET /compute/v2.1/servers/a140e45c-3e7e-488d-a0ec-3229ca34fbcf" status: 200 len: 1313 microversion: 2.1 time: 0.144288 May 24 15:22:40.584045 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 197/385] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:40 2022] GET /compute/v2.1/servers/a140e45c-3e7e-488d-a0ec-3229ca34fbcf => generated 1313 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:22:40.751906 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-30c5c08f-124f-47ce-9a8b-8968c7b50496 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:40.752570 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-30c5c08f-124f-47ce-9a8b-8968c7b50496 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:40.759250 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-30c5c08f-124f-47ce-9a8b-8968c7b50496 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:40.759698 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-30c5c08f-124f-47ce-9a8b-8968c7b50496 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:40.760520 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-30c5c08f-124f-47ce-9a8b-8968c7b50496 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:40.760958 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-30c5c08f-124f-47ce-9a8b-8968c7b50496 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:40.824890 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-3eacec6b-32e9-4275-90f6-7d15805bd52b tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:40.825503 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-3eacec6b-32e9-4275-90f6-7d15805bd52b tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:40.827376 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:22:40.832717 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3eacec6b-32e9-4275-90f6-7d15805bd52b tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:40.833165 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3eacec6b-32e9-4275-90f6-7d15805bd52b tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:40.833932 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3eacec6b-32e9-4275-90f6-7d15805bd52b tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:40.834364 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3eacec6b-32e9-4275-90f6-7d15805bd52b tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:40.896879 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-30c5c08f-124f-47ce-9a8b-8968c7b50496 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:40.904923 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-30c5c08f-124f-47ce-9a8b-8968c7b50496 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:40.906424 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-30c5c08f-124f-47ce-9a8b-8968c7b50496 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:40.907583 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-30c5c08f-124f-47ce-9a8b-8968c7b50496 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1722 microversion: 2.20 time: 0.159534 May 24 15:22:40.908375 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 189/386] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:22:40 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:22:40.968557 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-3eacec6b-32e9-4275-90f6-7d15805bd52b tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:40.976395 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-3eacec6b-32e9-4275-90f6-7d15805bd52b tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1724 microversion: 2.1 time: 0.155874 May 24 15:22:40.976951 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 198/387] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:40 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:22:41.600852 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-89ee79ca-37ab-4c04-8cf9-ce62d33d77db tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:41.601484 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-89ee79ca-37ab-4c04-8cf9-ce62d33d77db tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] [instance: a140e45c-3e7e-488d-a0ec-3229ca34fbcf] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:41.603415 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell0:SELECT=2 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:22:41.609722 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-89ee79ca-37ab-4c04-8cf9-ce62d33d77db tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:41.610162 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-89ee79ca-37ab-4c04-8cf9-ce62d33d77db tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:41.610910 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-89ee79ca-37ab-4c04-8cf9-ce62d33d77db tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:41.611336 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-89ee79ca-37ab-4c04-8cf9-ce62d33d77db tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:41.734308 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-89ee79ca-37ab-4c04-8cf9-ce62d33d77db tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b27ee7d15ca42bca6a09dd18751f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c8c75b264644b7af9831e14cbf7841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:41.741702 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-89ee79ca-37ab-4c04-8cf9-ce62d33d77db tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] 10.222.0.45 "GET /compute/v2.1/servers/a140e45c-3e7e-488d-a0ec-3229ca34fbcf" status: 200 len: 1313 microversion: 2.1 time: 0.144844 May 24 15:22:41.742257 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 190/388] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:41 2022] GET /compute/v2.1/servers/a140e45c-3e7e-488d-a0ec-3229ca34fbcf => generated 1313 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:41.924988 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-78c75432-f2a1-4f00-a037-93b9a5e9543e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:41.925715 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-78c75432-f2a1-4f00-a037-93b9a5e9543e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:41.932177 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-78c75432-f2a1-4f00-a037-93b9a5e9543e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:41.932656 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-78c75432-f2a1-4f00-a037-93b9a5e9543e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:41.933429 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-78c75432-f2a1-4f00-a037-93b9a5e9543e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:41.933835 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-78c75432-f2a1-4f00-a037-93b9a5e9543e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:41.993532 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-8d936230-ac32-402c-a806-9a7c474c6276 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:41.994201 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-8d936230-ac32-402c-a806-9a7c474c6276 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:42.001359 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8d936230-ac32-402c-a806-9a7c474c6276 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:42.002330 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8d936230-ac32-402c-a806-9a7c474c6276 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:42.002571 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8d936230-ac32-402c-a806-9a7c474c6276 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:42.003011 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8d936230-ac32-402c-a806-9a7c474c6276 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:42.070219 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-78c75432-f2a1-4f00-a037-93b9a5e9543e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:42.079115 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-78c75432-f2a1-4f00-a037-93b9a5e9543e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:42.080869 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-78c75432-f2a1-4f00-a037-93b9a5e9543e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:42.082126 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-78c75432-f2a1-4f00-a037-93b9a5e9543e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1722 microversion: 2.20 time: 0.160931 May 24 15:22:42.082895 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 199/389] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:22:41 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:22:42.138189 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-8d936230-ac32-402c-a806-9a7c474c6276 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:42.146116 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-8d936230-ac32-402c-a806-9a7c474c6276 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1724 microversion: 2.1 time: 0.156506 May 24 15:22:42.146672 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 191/390] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:41 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:22:42.758025 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-de557eb1-e7f8-4695-9133-f4570d50199f tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:42.758627 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-de557eb1-e7f8-4695-9133-f4570d50199f tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] [instance: a140e45c-3e7e-488d-a0ec-3229ca34fbcf] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:42.766324 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-de557eb1-e7f8-4695-9133-f4570d50199f tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:42.766324 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-de557eb1-e7f8-4695-9133-f4570d50199f tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:42.766324 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-de557eb1-e7f8-4695-9133-f4570d50199f tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:42.766324 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-de557eb1-e7f8-4695-9133-f4570d50199f tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:42.896071 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-de557eb1-e7f8-4695-9133-f4570d50199f tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b27ee7d15ca42bca6a09dd18751f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c8c75b264644b7af9831e14cbf7841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:42.903994 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-de557eb1-e7f8-4695-9133-f4570d50199f tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] 10.222.0.45 "GET /compute/v2.1/servers/a140e45c-3e7e-488d-a0ec-3229ca34fbcf" status: 200 len: 1313 microversion: 2.1 time: 0.149797 May 24 15:22:42.904584 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 200/391] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:42 2022] GET /compute/v2.1/servers/a140e45c-3e7e-488d-a0ec-3229ca34fbcf => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:43.100772 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-436f269d-0357-4e4b-8701-ec1d1957aecd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:43.101406 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-436f269d-0357-4e4b-8701-ec1d1957aecd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:43.108180 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-436f269d-0357-4e4b-8701-ec1d1957aecd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:43.108651 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-436f269d-0357-4e4b-8701-ec1d1957aecd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:43.109399 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-436f269d-0357-4e4b-8701-ec1d1957aecd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:43.109831 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-436f269d-0357-4e4b-8701-ec1d1957aecd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:43.163067 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-5a6e4359-7aaf-4226-80d1-e790050d9e05 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:43.163822 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-5a6e4359-7aaf-4226-80d1-e790050d9e05 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:43.170461 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5a6e4359-7aaf-4226-80d1-e790050d9e05 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:43.170899 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5a6e4359-7aaf-4226-80d1-e790050d9e05 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:43.171672 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5a6e4359-7aaf-4226-80d1-e790050d9e05 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:43.172104 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5a6e4359-7aaf-4226-80d1-e790050d9e05 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:43.256957 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-436f269d-0357-4e4b-8701-ec1d1957aecd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:43.267150 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-436f269d-0357-4e4b-8701-ec1d1957aecd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:43.269017 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-436f269d-0357-4e4b-8701-ec1d1957aecd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:43.270355 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-436f269d-0357-4e4b-8701-ec1d1957aecd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1725 microversion: 2.20 time: 0.173539 May 24 15:22:43.276405 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 192/392] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:22:43 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:22:43.289011 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-ae14c583-835e-4ae0-a4ad-a29829c55a2c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "af4eab8c-4b6b-4224-b721-4b35deb155bd"}} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:22:43.290253 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-ae14c583-835e-4ae0-a4ad-a29829c55a2c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:43.297683 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ae14c583-835e-4ae0-a4ad-a29829c55a2c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:43.298250 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ae14c583-835e-4ae0-a4ad-a29829c55a2c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:43.299587 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ae14c583-835e-4ae0-a4ad-a29829c55a2c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:43.300145 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ae14c583-835e-4ae0-a4ad-a29829c55a2c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:43.314012 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-5a6e4359-7aaf-4226-80d1-e790050d9e05 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:43.322310 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-5a6e4359-7aaf-4226-80d1-e790050d9e05 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1724 microversion: 2.1 time: 0.163103 May 24 15:22:43.323252 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 201/393] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:43 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:22:43.369710 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [req-4bf82127-2bb3-4ca9-b659-76a723fd0779 req-d550dd8c-992e-4381-8a5f-70f31830284a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c54fc3c-070c-4cab-b181-081d80eeb078", "name": "network-vif-unplugged", "status": "completed", "tag": "17e61d65-8da4-4259-8227-bdbecc4fa610"}]} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:22:43.379896 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-4bf82127-2bb3-4ca9-b659-76a723fd0779 req-d550dd8c-992e-4381-8a5f-70f31830284a service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:43.380502 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-4bf82127-2bb3-4ca9-b659-76a723fd0779 req-d550dd8c-992e-4381-8a5f-70f31830284a service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:43.393672 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.compute.server_external_events [req-4bf82127-2bb3-4ca9-b659-76a723fd0779 req-d550dd8c-992e-4381-8a5f-70f31830284a service nova] Creating event network-vif-unplugged:17e61d65-8da4-4259-8227-bdbecc4fa610 for instance 6c54fc3c-070c-4cab-b181-081d80eeb078 on hv-cinder-84315 May 24 15:22:43.404692 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [req-4bf82127-2bb3-4ca9-b659-76a723fd0779 req-d550dd8c-992e-4381-8a5f-70f31830284a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034209 May 24 15:22:43.405301 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 202/394] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:22:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:22:43.478016 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:22:43.587538 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-ae14c583-835e-4ae0-a4ad-a29829c55a2c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "POST /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.302822 May 24 15:22:43.588169 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 193/395] 10.222.0.45 () {62 vars in 1363 bytes} [Tue May 24 15:22:43 2022] POST /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 188 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:22:43.700484 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e6596607-a9e7-4d4c-8da0-e8124138c943 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:22:43.701134 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e6596607-a9e7-4d4c-8da0-e8124138c943 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:43.707237 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e6596607-a9e7-4d4c-8da0-e8124138c943 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:43.707687 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e6596607-a9e7-4d4c-8da0-e8124138c943 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:43.708467 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e6596607-a9e7-4d4c-8da0-e8124138c943 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:43.708900 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e6596607-a9e7-4d4c-8da0-e8124138c943 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:43.797959 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e6596607-a9e7-4d4c-8da0-e8124138c943 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "POST /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/action" status: 202 len: 0 microversion: 2.20 time: 0.102168 May 24 15:22:43.802591 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 203/396] 10.222.0.45 () {62 vars in 1318 bytes} [Tue May 24 15:22:43 2022] POST /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 24 15:22:43.812249 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e9ddf008-f7da-4df4-8a57-87fb32091037 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:43.813335 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-e9ddf008-f7da-4df4-8a57-87fb32091037 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:43.825091 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e9ddf008-f7da-4df4-8a57-87fb32091037 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:43.825953 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e9ddf008-f7da-4df4-8a57-87fb32091037 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:43.827472 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e9ddf008-f7da-4df4-8a57-87fb32091037 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:43.828242 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e9ddf008-f7da-4df4-8a57-87fb32091037 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:43.921368 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e8dcc3bd-003a-42cb-ad0c-d26ec5b177ff tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:43.921884 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e8dcc3bd-003a-42cb-ad0c-d26ec5b177ff tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] [instance: a140e45c-3e7e-488d-a0ec-3229ca34fbcf] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:43.927829 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e8dcc3bd-003a-42cb-ad0c-d26ec5b177ff tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:43.928271 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e8dcc3bd-003a-42cb-ad0c-d26ec5b177ff tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:43.929078 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e8dcc3bd-003a-42cb-ad0c-d26ec5b177ff tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:43.929592 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e8dcc3bd-003a-42cb-ad0c-d26ec5b177ff tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:43.971327 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-e9ddf008-f7da-4df4-8a57-87fb32091037 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:43.979856 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-e9ddf008-f7da-4df4-8a57-87fb32091037 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:43.981973 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-e9ddf008-f7da-4df4-8a57-87fb32091037 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:43.983369 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-e9ddf008-f7da-4df4-8a57-87fb32091037 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1811 microversion: 2.20 time: 0.178494 May 24 15:22:43.984156 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 194/397] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:22:43 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1811 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:22:44.074809 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e8dcc3bd-003a-42cb-ad0c-d26ec5b177ff tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b27ee7d15ca42bca6a09dd18751f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c8c75b264644b7af9831e14cbf7841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:44.083293 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e8dcc3bd-003a-42cb-ad0c-d26ec5b177ff tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] 10.222.0.45 "GET /compute/v2.1/servers/a140e45c-3e7e-488d-a0ec-3229ca34fbcf" status: 200 len: 1496 microversion: 2.1 time: 0.166527 May 24 15:22:44.084252 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 204/398] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:43 2022] GET /compute/v2.1/servers/a140e45c-3e7e-488d-a0ec-3229ca34fbcf => generated 1496 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:22:44.339117 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-95921b82-4dfb-4278-a5a5-4d92bdf31eb1 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:44.340337 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-95921b82-4dfb-4278-a5a5-4d92bdf31eb1 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:44.347372 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-95921b82-4dfb-4278-a5a5-4d92bdf31eb1 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:44.347815 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-95921b82-4dfb-4278-a5a5-4d92bdf31eb1 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:44.348621 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-95921b82-4dfb-4278-a5a5-4d92bdf31eb1 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:44.349054 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-95921b82-4dfb-4278-a5a5-4d92bdf31eb1 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:44.503384 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-95921b82-4dfb-4278-a5a5-4d92bdf31eb1 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:44.511950 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-95921b82-4dfb-4278-a5a5-4d92bdf31eb1 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1724 microversion: 2.1 time: 0.176631 May 24 15:22:44.512541 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 195/399] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:44 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:44.720851 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-a9c12537-5958-47db-95c6-371a3b8eb1d3 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:44.721514 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-a9c12537-5958-47db-95c6-371a3b8eb1d3 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] [instance: a140e45c-3e7e-488d-a0ec-3229ca34fbcf] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:44.728487 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a9c12537-5958-47db-95c6-371a3b8eb1d3 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:44.728936 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a9c12537-5958-47db-95c6-371a3b8eb1d3 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:44.729875 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a9c12537-5958-47db-95c6-371a3b8eb1d3 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:44.730348 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a9c12537-5958-47db-95c6-371a3b8eb1d3 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:44.758535 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-a9c12537-5958-47db-95c6-371a3b8eb1d3 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] [instance: a140e45c-3e7e-488d-a0ec-3229ca34fbcf] Going to try to terminate instance {{(pid=117698) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 15:22:44.845857 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-a9c12537-5958-47db-95c6-371a3b8eb1d3 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] 10.222.0.45 "DELETE /compute/v2.1/servers/a140e45c-3e7e-488d-a0ec-3229ca34fbcf" status: 204 len: 0 microversion: 2.1 time: 0.129231 May 24 15:22:44.846472 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 205/400] 10.222.0.45 () {58 vars in 1238 bytes} [Tue May 24 15:22:44 2022] DELETE /compute/v2.1/servers/a140e45c-3e7e-488d-a0ec-3229ca34fbcf => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 15:22:44.855780 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a9a178eb-38a7-4674-8a4f-82b412df8674 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:44.856473 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a9a178eb-38a7-4674-8a4f-82b412df8674 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] [instance: a140e45c-3e7e-488d-a0ec-3229ca34fbcf] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:44.862942 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a9a178eb-38a7-4674-8a4f-82b412df8674 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:44.863381 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a9a178eb-38a7-4674-8a4f-82b412df8674 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:44.864188 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a9a178eb-38a7-4674-8a4f-82b412df8674 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:44.864634 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a9a178eb-38a7-4674-8a4f-82b412df8674 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:45.002471 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-a9a178eb-38a7-4674-8a4f-82b412df8674 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b27ee7d15ca42bca6a09dd18751f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c8c75b264644b7af9831e14cbf7841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:45.002687 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-bf1e9d4f-0371-47dd-a87c-e5f6b591df4f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:45.003637 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-bf1e9d4f-0371-47dd-a87c-e5f6b591df4f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:45.009764 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bf1e9d4f-0371-47dd-a87c-e5f6b591df4f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:45.010068 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a9a178eb-38a7-4674-8a4f-82b412df8674 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] 10.222.0.45 "GET /compute/v2.1/servers/a140e45c-3e7e-488d-a0ec-3229ca34fbcf" status: 200 len: 1502 microversion: 2.1 time: 0.159261 May 24 15:22:45.010287 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bf1e9d4f-0371-47dd-a87c-e5f6b591df4f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:45.010639 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 196/401] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:44 2022] GET /compute/v2.1/servers/a140e45c-3e7e-488d-a0ec-3229ca34fbcf => generated 1502 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:22:45.011750 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bf1e9d4f-0371-47dd-a87c-e5f6b591df4f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:45.012320 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bf1e9d4f-0371-47dd-a87c-e5f6b591df4f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:45.016601 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:22:45.141100 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-bf1e9d4f-0371-47dd-a87c-e5f6b591df4f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:45.149450 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-bf1e9d4f-0371-47dd-a87c-e5f6b591df4f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:45.150935 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-bf1e9d4f-0371-47dd-a87c-e5f6b591df4f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:45.152076 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-bf1e9d4f-0371-47dd-a87c-e5f6b591df4f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1751 microversion: 2.20 time: 0.153595 May 24 15:22:45.152671 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 206/402] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:22:44 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:22:45.296526 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a5a18d11-96e8-425d-b9b7-80955ef942a7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:45.297135 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a5a18d11-96e8-425d-b9b7-80955ef942a7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:45.303053 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a5a18d11-96e8-425d-b9b7-80955ef942a7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:45.303499 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a5a18d11-96e8-425d-b9b7-80955ef942a7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:45.304243 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a5a18d11-96e8-425d-b9b7-80955ef942a7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:45.304694 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a5a18d11-96e8-425d-b9b7-80955ef942a7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:45.429235 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-a5a18d11-96e8-425d-b9b7-80955ef942a7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:45.437097 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a5a18d11-96e8-425d-b9b7-80955ef942a7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1594 microversion: 2.1 time: 0.144953 May 24 15:22:45.437657 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 197/403] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:45 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1594 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:45.530131 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-a1ea12e3-05bd-453c-b93d-73f54a2b226f tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:45.530738 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-a1ea12e3-05bd-453c-b93d-73f54a2b226f tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:45.536641 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a1ea12e3-05bd-453c-b93d-73f54a2b226f tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:45.537083 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a1ea12e3-05bd-453c-b93d-73f54a2b226f tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:45.537829 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a1ea12e3-05bd-453c-b93d-73f54a2b226f tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:45.538255 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a1ea12e3-05bd-453c-b93d-73f54a2b226f tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:45.672779 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-a1ea12e3-05bd-453c-b93d-73f54a2b226f tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:45.680703 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-a1ea12e3-05bd-453c-b93d-73f54a2b226f tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1724 microversion: 2.1 time: 0.155440 May 24 15:22:45.681274 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 207/404] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:45 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:46.027552 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a56d717f-af74-40ae-9d87-82e8209650aa tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:46.028185 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a56d717f-af74-40ae-9d87-82e8209650aa tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] [instance: a140e45c-3e7e-488d-a0ec-3229ca34fbcf] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:46.034494 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a56d717f-af74-40ae-9d87-82e8209650aa tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:46.034937 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a56d717f-af74-40ae-9d87-82e8209650aa tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:46.035752 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a56d717f-af74-40ae-9d87-82e8209650aa tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:46.036185 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a56d717f-af74-40ae-9d87-82e8209650aa tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:46.170161 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-15c965e1-68df-4c84-82bf-87b7d029829c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:46.170773 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-15c965e1-68df-4c84-82bf-87b7d029829c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:46.177305 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-15c965e1-68df-4c84-82bf-87b7d029829c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:46.177757 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-15c965e1-68df-4c84-82bf-87b7d029829c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:46.178515 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-15c965e1-68df-4c84-82bf-87b7d029829c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:46.178947 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-15c965e1-68df-4c84-82bf-87b7d029829c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:46.219015 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-a56d717f-af74-40ae-9d87-82e8209650aa tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b27ee7d15ca42bca6a09dd18751f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c8c75b264644b7af9831e14cbf7841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:46.227112 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a56d717f-af74-40ae-9d87-82e8209650aa tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] 10.222.0.45 "GET /compute/v2.1/servers/a140e45c-3e7e-488d-a0ec-3229ca34fbcf" status: 200 len: 1502 microversion: 2.1 time: 0.203899 May 24 15:22:46.227773 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 198/405] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:46 2022] GET /compute/v2.1/servers/a140e45c-3e7e-488d-a0ec-3229ca34fbcf => generated 1502 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:46.320225 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-15c965e1-68df-4c84-82bf-87b7d029829c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:46.329635 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-15c965e1-68df-4c84-82bf-87b7d029829c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:46.331116 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-15c965e1-68df-4c84-82bf-87b7d029829c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:46.332258 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-15c965e1-68df-4c84-82bf-87b7d029829c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1751 microversion: 2.20 time: 0.166670 May 24 15:22:46.332834 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 208/406] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:22:46 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1751 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:22:46.697002 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-040c7d13-df4d-4daf-a832-8982a498874c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:46.697683 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-040c7d13-df4d-4daf-a832-8982a498874c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:46.704217 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-040c7d13-df4d-4daf-a832-8982a498874c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:46.704787 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-040c7d13-df4d-4daf-a832-8982a498874c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:46.705608 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-040c7d13-df4d-4daf-a832-8982a498874c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:46.706039 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-040c7d13-df4d-4daf-a832-8982a498874c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:46.922397 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-040c7d13-df4d-4daf-a832-8982a498874c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:46.930742 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-040c7d13-df4d-4daf-a832-8982a498874c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1724 microversion: 2.1 time: 0.237415 May 24 15:22:46.942876 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 199/407] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:46 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1724 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:47.245241 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-1fc1f7ab-3081-4e80-9985-5b54a3837c28 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:47.245959 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-1fc1f7ab-3081-4e80-9985-5b54a3837c28 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] [instance: a140e45c-3e7e-488d-a0ec-3229ca34fbcf] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:47.259164 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1fc1f7ab-3081-4e80-9985-5b54a3837c28 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:47.259896 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1fc1f7ab-3081-4e80-9985-5b54a3837c28 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:47.260956 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1fc1f7ab-3081-4e80-9985-5b54a3837c28 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:47.261941 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1fc1f7ab-3081-4e80-9985-5b54a3837c28 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:47.352598 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-8212b0eb-22e6-4992-95d8-e7a1a64f901b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:47.353962 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-8212b0eb-22e6-4992-95d8-e7a1a64f901b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:47.360647 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-1fc1f7ab-3081-4e80-9985-5b54a3837c28 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b27ee7d15ca42bca6a09dd18751f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c8c75b264644b7af9831e14cbf7841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:47.363279 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8212b0eb-22e6-4992-95d8-e7a1a64f901b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:47.363945 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8212b0eb-22e6-4992-95d8-e7a1a64f901b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:47.365998 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8212b0eb-22e6-4992-95d8-e7a1a64f901b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:47.366651 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8212b0eb-22e6-4992-95d8-e7a1a64f901b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:47.372182 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-1fc1f7ab-3081-4e80-9985-5b54a3837c28 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] 10.222.0.45 "GET /compute/v2.1/servers/a140e45c-3e7e-488d-a0ec-3229ca34fbcf" status: 200 len: 1460 microversion: 2.1 time: 0.130793 May 24 15:22:47.382483 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 209/408] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:47 2022] GET /compute/v2.1/servers/a140e45c-3e7e-488d-a0ec-3229ca34fbcf => generated 1460 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:47.392760 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [req-94015a31-11ef-4b68-8c78-bc724875ed32 req-fa7608ac-187b-4e51-8e31-a314316b5928 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a140e45c-3e7e-488d-a0ec-3229ca34fbcf", "name": "network-vif-deleted", "tag": "5e3b2905-304a-40e3-bf51-a328ddddff86"}]} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:22:47.403035 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-94015a31-11ef-4b68-8c78-bc724875ed32 req-fa7608ac-187b-4e51-8e31-a314316b5928 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:47.403463 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-94015a31-11ef-4b68-8c78-bc724875ed32 req-fa7608ac-187b-4e51-8e31-a314316b5928 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:47.416077 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.compute.server_external_events [req-94015a31-11ef-4b68-8c78-bc724875ed32 req-fa7608ac-187b-4e51-8e31-a314316b5928 service nova] Creating event network-vif-deleted:5e3b2905-304a-40e3-bf51-a328ddddff86 for instance a140e45c-3e7e-488d-a0ec-3229ca34fbcf on hv-cinder-84315 May 24 15:22:47.423978 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [req-94015a31-11ef-4b68-8c78-bc724875ed32 req-fa7608ac-187b-4e51-8e31-a314316b5928 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034836 May 24 15:22:47.424915 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 210/409] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:22:47.566099 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [req-759ccf99-04b0-43ed-93bd-5314a8d979d1 req-14ce1554-12c2-4411-92e7-1bdbce65f4a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c395e512-b693-4a96-8301-640831fee66f", "tag": "3b9228a9-f1b9-4ba1-9526-b1b918986c1b"}]} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:22:47.585571 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-759ccf99-04b0-43ed-93bd-5314a8d979d1 req-14ce1554-12c2-4411-92e7-1bdbce65f4a4 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:47.585571 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-759ccf99-04b0-43ed-93bd-5314a8d979d1 req-14ce1554-12c2-4411-92e7-1bdbce65f4a4 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:47.598345 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.compute.server_external_events [req-759ccf99-04b0-43ed-93bd-5314a8d979d1 req-14ce1554-12c2-4411-92e7-1bdbce65f4a4 service nova] Creating event network-changed:3b9228a9-f1b9-4ba1-9526-b1b918986c1b for instance c395e512-b693-4a96-8301-640831fee66f on hv-cinder-84315 May 24 15:22:47.600017 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-8212b0eb-22e6-4992-95d8-e7a1a64f901b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:47.605310 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [req-759ccf99-04b0-43ed-93bd-5314a8d979d1 req-14ce1554-12c2-4411-92e7-1bdbce65f4a4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046482 May 24 15:22:47.605981 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 211/410] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:22:47.611659 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-8212b0eb-22e6-4992-95d8-e7a1a64f901b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:47.614130 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-8212b0eb-22e6-4992-95d8-e7a1a64f901b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:47.615715 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-8212b0eb-22e6-4992-95d8-e7a1a64f901b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1753 microversion: 2.20 time: 0.269370 May 24 15:22:47.616899 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 200/411] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:22:47 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1753 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:22:47.948435 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-8a5df559-90c1-4459-999b-641f42ed6f78 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:47.949445 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-8a5df559-90c1-4459-999b-641f42ed6f78 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:47.956811 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8a5df559-90c1-4459-999b-641f42ed6f78 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:47.957332 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8a5df559-90c1-4459-999b-641f42ed6f78 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:47.958356 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8a5df559-90c1-4459-999b-641f42ed6f78 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:47.958980 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8a5df559-90c1-4459-999b-641f42ed6f78 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:48.230784 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-8a5df559-90c1-4459-999b-641f42ed6f78 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:48.243720 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-8a5df559-90c1-4459-999b-641f42ed6f78 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1724 microversion: 2.1 time: 0.299851 May 24 15:22:48.244318 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 212/412] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:47 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1724 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:48.389758 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e8744667-4a7c-46bc-a492-59621655af71 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:48.390419 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-e8744667-4a7c-46bc-a492-59621655af71 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] [instance: a140e45c-3e7e-488d-a0ec-3229ca34fbcf] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:48.397603 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e8744667-4a7c-46bc-a492-59621655af71 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:48.398058 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e8744667-4a7c-46bc-a492-59621655af71 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:48.398835 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e8744667-4a7c-46bc-a492-59621655af71 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:48.399497 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e8744667-4a7c-46bc-a492-59621655af71 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:48.416334 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.wsgi [None req-e8744667-4a7c-46bc-a492-59621655af71 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] HTTP exception thrown: Instance a140e45c-3e7e-488d-a0ec-3229ca34fbcf could not be found. May 24 15:22:48.418933 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e8744667-4a7c-46bc-a492-59621655af71 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Request method failure captured: May 24 15:22:48.418933 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: request: GET /compute/v2.1/servers/a140e45c-3e7e-488d-a0ec-3229ca34fbcf HTTP/1.1 May 24 15:22:48.418933 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Accept: application/json May 24 15:22:48.418933 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Accept-Encoding: identity May 24 15:22:48.418933 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Connection: close May 24 15:22:48.418933 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Content-Length: 0 May 24 15:22:48.418933 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Content-Type: application/json May 24 15:22:48.418933 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Host: 10.222.0.45 May 24 15:22:48.418933 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Openstack-System-Scope: None May 24 15:22:48.418933 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: User-Agent: python-urllib3/1.26.9 May 24 15:22:48.418933 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Auth-Token: gAAAAABijPf-q_mXcnokr_SQQO45R_M-PIO2RwtbbG-OF08i_RCbZbfbQwMS880uqpjJaYjj_W3ZNsaEztzwyflDmLNIz3bjVcoc_xIq8FMAZdGXqzCFUpZaYZ1m37gyeBr8FG-KO7rQ6yv0rySPIVt5tUcEG_NU7ZSaeaGGdNuDsWiMEsXcvk0 May 24 15:22:48.418933 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Domain-Id: None May 24 15:22:48.418933 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Domain-Name: None May 24 15:22:48.418933 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Identity-Status: Confirmed May 24 15:22:48.418933 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Is-Admin-Project: True May 24 15:22:48.418933 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Domain-Id: default May 24 15:22:48.418933 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Domain-Name: Default May 24 15:22:48.418933 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Id: f7c8c75b264644b7af9831e14cbf7841 May 24 15:22:48.418933 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Name: tempest-VolumesActionsTest-1184662138 May 24 15:22:48.418933 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Role: reader,member May 24 15:22:48.418933 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Roles: reader,member May 24 15:22:48.420462 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f7c8c75b264644b7af9831e14cbf7841"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f7c8c75b264644b7af9831e14cbf7841"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f7c8c75b264644b7af9831e14cbf7841"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f7c8c75b264644b7af9831e14cbf7841"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 24 15:22:48.420462 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant: tempest-VolumesActionsTest-1184662138 May 24 15:22:48.420462 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant-Id: f7c8c75b264644b7af9831e14cbf7841 May 24 15:22:48.420462 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant-Name: tempest-VolumesActionsTest-1184662138 May 24 15:22:48.420462 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User: tempest-VolumesActionsTest-1184662138-project May 24 15:22:48.420462 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Domain-Id: default May 24 15:22:48.420462 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Domain-Name: Default May 24 15:22:48.420462 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Id: 2b27ee7d15ca42bca6a09dd18751f01e May 24 15:22:48.420462 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Name: tempest-VolumesActionsTest-1184662138-project May 24 15:22:48.420462 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: method: > May 24 15:22:48.420462 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: exception: Instance a140e45c-3e7e-488d-a0ec-3229ca34fbcf could not be found. May 24 15:22:48.420462 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: action_args: {'id': 'a140e45c-3e7e-488d-a0ec-3229ca34fbcf'} May 24 15:22:48.421166 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:22:48.421166 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:22:48.421166 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:22:48.421166 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:22:48.421166 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:22:48.421166 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:22:48.421166 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:22:48.421166 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:22:48.421166 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:22:48.421166 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:22:48.421166 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a140e45c-3e7e-488d-a0ec-3229ca34fbcf could not be found. May 24 15:22:48.421166 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:22:48.421166 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:22:48.421166 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:22:48.421166 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:22:48.421166 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:22:48.421166 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:22:48.421166 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:22:48.421166 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:22:48.421166 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:22:48.422403 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:22:48.422403 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 15:22:48.422403 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 15:22:48.422403 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:22:48.422403 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:22:48.422403 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:22:48.422403 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:22:48.422403 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a140e45c-3e7e-488d-a0ec-3229ca34fbcf could not be found. May 24 15:22:48.422403 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:22:48.422403 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:22:48.422403 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:22:48.422403 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:22:48.422403 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:22:48.422403 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:22:48.422403 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:22:48.422403 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:22:48.422403 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a140e45c-3e7e-488d-a0ec-3229ca34fbcf could not be found. May 24 15:22:48.422403 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:22:48.425085 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e8744667-4a7c-46bc-a492-59621655af71 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] Returning 404 to user: Instance a140e45c-3e7e-488d-a0ec-3229ca34fbcf could not be found. {{(pid=117699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:22:48.426476 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-e8744667-4a7c-46bc-a492-59621655af71 tempest-VolumesActionsTest-1184662138 tempest-VolumesActionsTest-1184662138-project] 10.222.0.45 "GET /compute/v2.1/servers/a140e45c-3e7e-488d-a0ec-3229ca34fbcf" status: 404 len: 111 microversion: 2.1 time: 0.040322 May 24 15:22:48.432549 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 201/413] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:48 2022] GET /compute/v2.1/servers/a140e45c-3e7e-488d-a0ec-3229ca34fbcf => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:22:48.639465 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-b4a679c8-1aa4-4094-96fb-b74a15210fb5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:48.640145 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-b4a679c8-1aa4-4094-96fb-b74a15210fb5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:48.647914 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b4a679c8-1aa4-4094-96fb-b74a15210fb5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:48.648710 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b4a679c8-1aa4-4094-96fb-b74a15210fb5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:48.649495 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b4a679c8-1aa4-4094-96fb-b74a15210fb5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:48.649945 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b4a679c8-1aa4-4094-96fb-b74a15210fb5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:49.000675 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-b4a679c8-1aa4-4094-96fb-b74a15210fb5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:49.010462 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-b4a679c8-1aa4-4094-96fb-b74a15210fb5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:49.012876 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-b4a679c8-1aa4-4094-96fb-b74a15210fb5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:49.014279 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-b4a679c8-1aa4-4094-96fb-b74a15210fb5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1809 microversion: 2.20 time: 0.382375 May 24 15:22:49.015402 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 213/414] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:22:48 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1809 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:22:49.216849 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-cf87363d-6d64-4ef8-94e9-5b6d2ebfd73e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-314768579"}} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:22:49.217530 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-cf87363d-6d64-4ef8-94e9-5b6d2ebfd73e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:49.223833 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cf87363d-6d64-4ef8-94e9-5b6d2ebfd73e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:49.224601 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cf87363d-6d64-4ef8-94e9-5b6d2ebfd73e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:49.225468 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cf87363d-6d64-4ef8-94e9-5b6d2ebfd73e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:49.225906 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cf87363d-6d64-4ef8-94e9-5b6d2ebfd73e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:49.260348 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-45c5a04b-aeee-40db-b2ab-3d1cea2b2b81 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:49.262093 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-45c5a04b-aeee-40db-b2ab-3d1cea2b2b81 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:49.269485 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-45c5a04b-aeee-40db-b2ab-3d1cea2b2b81 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:49.270214 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-45c5a04b-aeee-40db-b2ab-3d1cea2b2b81 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:49.271481 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-45c5a04b-aeee-40db-b2ab-3d1cea2b2b81 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:49.272345 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-45c5a04b-aeee-40db-b2ab-3d1cea2b2b81 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:49.381116 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.network.security_group_api [None req-cf87363d-6d64-4ef8-94e9-5b6d2ebfd73e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Adding security group ee9d65a8-0b87-4f60-b65c-f6ddf08427ee to port 3b9228a9-f1b9-4ba1-9526-b1b918986c1b May 24 15:22:49.419877 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-45c5a04b-aeee-40db-b2ab-3d1cea2b2b81 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:49.427891 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-45c5a04b-aeee-40db-b2ab-3d1cea2b2b81 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1724 microversion: 2.1 time: 0.171418 May 24 15:22:49.428482 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 214/415] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:49 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:22:49.774959 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-cf87363d-6d64-4ef8-94e9-5b6d2ebfd73e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "POST /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/action" status: 202 len: 0 microversion: 2.1 time: 0.562661 May 24 15:22:49.775745 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 202/416] 10.222.0.45 () {60 vars in 1277 bytes} [Tue May 24 15:22:49 2022] POST /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/action => generated 0 bytes in 564 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 15:22:49.786255 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-5232b37d-0af6-4c25-a702-7bcd3358e8ae tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:49.786879 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-5232b37d-0af6-4c25-a702-7bcd3358e8ae tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:49.789736 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [req-067282df-3135-439c-8cf3-87a7a7402a2f req-502a1fa1-46b7-4e0e-aea8-28455b3ccbf1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c395e512-b693-4a96-8301-640831fee66f", "tag": "3b9228a9-f1b9-4ba1-9526-b1b918986c1b"}]} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:22:49.799183 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5232b37d-0af6-4c25-a702-7bcd3358e8ae tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:49.800635 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5232b37d-0af6-4c25-a702-7bcd3358e8ae tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:49.801524 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-067282df-3135-439c-8cf3-87a7a7402a2f req-502a1fa1-46b7-4e0e-aea8-28455b3ccbf1 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:49.801745 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5232b37d-0af6-4c25-a702-7bcd3358e8ae tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:49.802125 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5232b37d-0af6-4c25-a702-7bcd3358e8ae tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:49.802239 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-067282df-3135-439c-8cf3-87a7a7402a2f req-502a1fa1-46b7-4e0e-aea8-28455b3ccbf1 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:49.819060 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.compute.server_external_events [req-067282df-3135-439c-8cf3-87a7a7402a2f req-502a1fa1-46b7-4e0e-aea8-28455b3ccbf1 service nova] Creating event network-changed:3b9228a9-f1b9-4ba1-9526-b1b918986c1b for instance c395e512-b693-4a96-8301-640831fee66f on hv-cinder-84315 May 24 15:22:49.825430 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [req-067282df-3135-439c-8cf3-87a7a7402a2f req-502a1fa1-46b7-4e0e-aea8-28455b3ccbf1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040696 May 24 15:22:49.826152 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 203/417] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:22:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:22:50.004666 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-5232b37d-0af6-4c25-a702-7bcd3358e8ae tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:50.013207 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-5232b37d-0af6-4c25-a702-7bcd3358e8ae tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1759 microversion: 2.1 time: 0.232843 May 24 15:22:50.014719 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 215/418] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:49 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1759 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:50.033561 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-176bfdf6-026e-48fb-b719-c7771465fa04 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:50.034258 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-176bfdf6-026e-48fb-b719-c7771465fa04 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:50.040422 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-176bfdf6-026e-48fb-b719-c7771465fa04 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:50.040861 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-176bfdf6-026e-48fb-b719-c7771465fa04 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:50.041612 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-176bfdf6-026e-48fb-b719-c7771465fa04 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:50.042043 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-176bfdf6-026e-48fb-b719-c7771465fa04 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:50.176084 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-176bfdf6-026e-48fb-b719-c7771465fa04 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:50.185893 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-176bfdf6-026e-48fb-b719-c7771465fa04 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:50.187431 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-176bfdf6-026e-48fb-b719-c7771465fa04 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:50.188695 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-176bfdf6-026e-48fb-b719-c7771465fa04 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1809 microversion: 2.20 time: 0.159302 May 24 15:22:50.189260 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 204/419] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:22:50 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:22:50.444531 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e558ab61-2a71-41fd-9ee7-cab722d99b87 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:50.445542 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e558ab61-2a71-41fd-9ee7-cab722d99b87 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:50.451668 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e558ab61-2a71-41fd-9ee7-cab722d99b87 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:50.452119 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e558ab61-2a71-41fd-9ee7-cab722d99b87 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:50.452905 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e558ab61-2a71-41fd-9ee7-cab722d99b87 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:50.453343 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e558ab61-2a71-41fd-9ee7-cab722d99b87 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:50.580827 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e558ab61-2a71-41fd-9ee7-cab722d99b87 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:50.588748 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e558ab61-2a71-41fd-9ee7-cab722d99b87 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1724 microversion: 2.1 time: 0.147984 May 24 15:22:50.589311 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 216/420] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:50 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:51.207100 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-53a30f20-8f0b-4f9d-acb7-9ddf94ed8965 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:51.207722 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-53a30f20-8f0b-4f9d-acb7-9ddf94ed8965 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:51.214853 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-53a30f20-8f0b-4f9d-acb7-9ddf94ed8965 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:51.215308 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-53a30f20-8f0b-4f9d-acb7-9ddf94ed8965 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:51.216054 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-53a30f20-8f0b-4f9d-acb7-9ddf94ed8965 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:51.216511 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-53a30f20-8f0b-4f9d-acb7-9ddf94ed8965 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:51.344752 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-53a30f20-8f0b-4f9d-acb7-9ddf94ed8965 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:51.352956 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-53a30f20-8f0b-4f9d-acb7-9ddf94ed8965 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:51.354444 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-53a30f20-8f0b-4f9d-acb7-9ddf94ed8965 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:51.355586 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-53a30f20-8f0b-4f9d-acb7-9ddf94ed8965 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1809 microversion: 2.20 time: 0.152417 May 24 15:22:51.356147 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 205/421] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:22:51 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:22:51.606285 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-b6976d70-524a-4ebd-8c8e-ffdc9dd9aa95 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:51.606845 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-b6976d70-524a-4ebd-8c8e-ffdc9dd9aa95 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:51.613617 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b6976d70-524a-4ebd-8c8e-ffdc9dd9aa95 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:51.614065 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b6976d70-524a-4ebd-8c8e-ffdc9dd9aa95 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:51.614823 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b6976d70-524a-4ebd-8c8e-ffdc9dd9aa95 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:51.615258 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b6976d70-524a-4ebd-8c8e-ffdc9dd9aa95 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:51.738606 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-b6976d70-524a-4ebd-8c8e-ffdc9dd9aa95 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:51.747081 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-b6976d70-524a-4ebd-8c8e-ffdc9dd9aa95 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1724 microversion: 2.1 time: 0.145286 May 24 15:22:51.747650 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 217/422] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:51 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1724 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:52.374112 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-64c1eb1e-8183-417e-9115-41b24d784831 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:52.374712 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-64c1eb1e-8183-417e-9115-41b24d784831 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:52.381366 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-64c1eb1e-8183-417e-9115-41b24d784831 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:52.382040 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-64c1eb1e-8183-417e-9115-41b24d784831 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:52.382816 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-64c1eb1e-8183-417e-9115-41b24d784831 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:52.383255 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-64c1eb1e-8183-417e-9115-41b24d784831 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:52.536556 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-64c1eb1e-8183-417e-9115-41b24d784831 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:52.545825 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-64c1eb1e-8183-417e-9115-41b24d784831 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:52.547835 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-64c1eb1e-8183-417e-9115-41b24d784831 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:52.549738 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-64c1eb1e-8183-417e-9115-41b24d784831 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1809 microversion: 2.20 time: 0.179433 May 24 15:22:52.560942 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 206/423] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:22:52 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1809 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:22:52.765672 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-0b7d3ed4-4458-499b-86a8-5c367eeeaefc tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:52.766356 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-0b7d3ed4-4458-499b-86a8-5c367eeeaefc tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:52.775537 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0b7d3ed4-4458-499b-86a8-5c367eeeaefc tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:52.775985 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0b7d3ed4-4458-499b-86a8-5c367eeeaefc tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:52.776982 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0b7d3ed4-4458-499b-86a8-5c367eeeaefc tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:52.777751 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0b7d3ed4-4458-499b-86a8-5c367eeeaefc tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:52.932092 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-0b7d3ed4-4458-499b-86a8-5c367eeeaefc tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:52.941205 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-0b7d3ed4-4458-499b-86a8-5c367eeeaefc tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1724 microversion: 2.1 time: 0.180690 May 24 15:22:52.953065 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 218/424] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:52 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1724 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:53.570069 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-2ae25d39-2622-4734-b33c-cb23af059621 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:53.570671 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-2ae25d39-2622-4734-b33c-cb23af059621 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:53.581941 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2ae25d39-2622-4734-b33c-cb23af059621 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:53.581941 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2ae25d39-2622-4734-b33c-cb23af059621 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:53.581941 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2ae25d39-2622-4734-b33c-cb23af059621 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:53.581941 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2ae25d39-2622-4734-b33c-cb23af059621 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:53.826761 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-2ae25d39-2622-4734-b33c-cb23af059621 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:53.836336 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-2ae25d39-2622-4734-b33c-cb23af059621 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:53.839051 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-2ae25d39-2622-4734-b33c-cb23af059621 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:53.840904 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-2ae25d39-2622-4734-b33c-cb23af059621 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1809 microversion: 2.20 time: 0.274872 May 24 15:22:53.852180 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 207/425] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:22:53 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1809 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:22:53.963697 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-de608a81-fd81-4a0d-bce1-53950277de44 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:53.965200 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-de608a81-fd81-4a0d-bce1-53950277de44 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:53.977761 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-de608a81-fd81-4a0d-bce1-53950277de44 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:53.978589 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-de608a81-fd81-4a0d-bce1-53950277de44 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:53.979385 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-de608a81-fd81-4a0d-bce1-53950277de44 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:53.981633 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-de608a81-fd81-4a0d-bce1-53950277de44 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:54.273142 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-de608a81-fd81-4a0d-bce1-53950277de44 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:54.281701 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-de608a81-fd81-4a0d-bce1-53950277de44 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1724 microversion: 2.1 time: 0.324680 May 24 15:22:54.291665 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 219/426] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:53 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1724 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:54.860050 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-b58eeeb4-d7f2-47fd-a7ef-84a260c6eb55 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:54.861279 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-b58eeeb4-d7f2-47fd-a7ef-84a260c6eb55 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:54.868353 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b58eeeb4-d7f2-47fd-a7ef-84a260c6eb55 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:54.869116 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b58eeeb4-d7f2-47fd-a7ef-84a260c6eb55 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:54.870131 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b58eeeb4-d7f2-47fd-a7ef-84a260c6eb55 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:54.870891 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b58eeeb4-d7f2-47fd-a7ef-84a260c6eb55 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:55.048281 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-b58eeeb4-d7f2-47fd-a7ef-84a260c6eb55 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:55.058997 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-b58eeeb4-d7f2-47fd-a7ef-84a260c6eb55 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:55.062045 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-b58eeeb4-d7f2-47fd-a7ef-84a260c6eb55 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:55.063691 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-b58eeeb4-d7f2-47fd-a7ef-84a260c6eb55 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1809 microversion: 2.20 time: 0.207927 May 24 15:22:55.074380 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 208/427] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:22:54 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1809 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:22:55.301770 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-243a0162-0a32-45f2-bb80-47874fe83ff0 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:55.303368 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-243a0162-0a32-45f2-bb80-47874fe83ff0 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:55.314062 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-243a0162-0a32-45f2-bb80-47874fe83ff0 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:55.320899 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-243a0162-0a32-45f2-bb80-47874fe83ff0 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:55.322266 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-243a0162-0a32-45f2-bb80-47874fe83ff0 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:55.322917 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-243a0162-0a32-45f2-bb80-47874fe83ff0 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:55.489392 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-243a0162-0a32-45f2-bb80-47874fe83ff0 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:55.500225 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-243a0162-0a32-45f2-bb80-47874fe83ff0 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1724 microversion: 2.1 time: 0.204362 May 24 15:22:55.509804 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 220/428] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:55 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1724 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:56.088081 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-011466b8-19fc-4270-940f-c5407e72a1c6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:56.088780 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-011466b8-19fc-4270-940f-c5407e72a1c6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:56.099305 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-011466b8-19fc-4270-940f-c5407e72a1c6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:56.099752 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-011466b8-19fc-4270-940f-c5407e72a1c6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:56.100583 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-011466b8-19fc-4270-940f-c5407e72a1c6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:56.101011 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-011466b8-19fc-4270-940f-c5407e72a1c6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:56.302929 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-011466b8-19fc-4270-940f-c5407e72a1c6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:56.325393 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-011466b8-19fc-4270-940f-c5407e72a1c6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:56.326841 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-011466b8-19fc-4270-940f-c5407e72a1c6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:56.327969 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-011466b8-19fc-4270-940f-c5407e72a1c6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1809 microversion: 2.20 time: 0.250282 May 24 15:22:56.333396 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 209/429] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:22:56 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1809 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:22:56.518589 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-61023fc5-ced1-45b3-90c0-fc7d1114ed80 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:56.519840 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-61023fc5-ced1-45b3-90c0-fc7d1114ed80 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:56.529191 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-61023fc5-ced1-45b3-90c0-fc7d1114ed80 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:56.529908 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-61023fc5-ced1-45b3-90c0-fc7d1114ed80 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:56.530848 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-61023fc5-ced1-45b3-90c0-fc7d1114ed80 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:56.531438 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-61023fc5-ced1-45b3-90c0-fc7d1114ed80 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:56.699596 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-61023fc5-ced1-45b3-90c0-fc7d1114ed80 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:56.709632 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-61023fc5-ced1-45b3-90c0-fc7d1114ed80 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1724 microversion: 2.1 time: 0.195510 May 24 15:22:56.722444 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 221/430] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:56 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1724 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:57.346844 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f0f68289-fc43-42fc-90f8-190dcc42fcc5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:57.348336 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f0f68289-fc43-42fc-90f8-190dcc42fcc5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:57.355924 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f0f68289-fc43-42fc-90f8-190dcc42fcc5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:57.357005 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f0f68289-fc43-42fc-90f8-190dcc42fcc5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:57.358432 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f0f68289-fc43-42fc-90f8-190dcc42fcc5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:57.359049 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f0f68289-fc43-42fc-90f8-190dcc42fcc5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:57.364075 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:22:57.556939 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-f0f68289-fc43-42fc-90f8-190dcc42fcc5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:57.570695 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-f0f68289-fc43-42fc-90f8-190dcc42fcc5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:57.572652 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-f0f68289-fc43-42fc-90f8-190dcc42fcc5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:57.574842 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f0f68289-fc43-42fc-90f8-190dcc42fcc5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1809 microversion: 2.20 time: 0.232772 May 24 15:22:57.586764 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 210/431] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:22:57 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1809 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:22:57.730204 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-304eb486-1c23-41e6-bbe8-49726f567728 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:57.731059 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-304eb486-1c23-41e6-bbe8-49726f567728 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:57.738529 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-304eb486-1c23-41e6-bbe8-49726f567728 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:57.739230 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-304eb486-1c23-41e6-bbe8-49726f567728 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:57.740006 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-304eb486-1c23-41e6-bbe8-49726f567728 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:57.740467 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-304eb486-1c23-41e6-bbe8-49726f567728 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:58.065666 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-304eb486-1c23-41e6-bbe8-49726f567728 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:58.079524 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-304eb486-1c23-41e6-bbe8-49726f567728 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1724 microversion: 2.1 time: 0.353341 May 24 15:22:58.090783 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 222/432] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:57 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1724 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:58.597868 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-08c42de8-4c89-48bd-93ea-a6d365613c0f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:58.599828 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-08c42de8-4c89-48bd-93ea-a6d365613c0f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:58.611526 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-08c42de8-4c89-48bd-93ea-a6d365613c0f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:58.612988 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-08c42de8-4c89-48bd-93ea-a6d365613c0f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:58.614054 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-08c42de8-4c89-48bd-93ea-a6d365613c0f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:58.614758 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-08c42de8-4c89-48bd-93ea-a6d365613c0f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:58.814015 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-08c42de8-4c89-48bd-93ea-a6d365613c0f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:58.827895 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-08c42de8-4c89-48bd-93ea-a6d365613c0f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:58.831182 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-08c42de8-4c89-48bd-93ea-a6d365613c0f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:58.834366 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-08c42de8-4c89-48bd-93ea-a6d365613c0f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1809 microversion: 2.20 time: 0.245056 May 24 15:22:58.838306 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 211/433] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:22:58 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1809 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:22:59.098881 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d7f0917f-e078-4834-9df7-bde9f7d0bb5e tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:59.099519 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d7f0917f-e078-4834-9df7-bde9f7d0bb5e tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:59.107419 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d7f0917f-e078-4834-9df7-bde9f7d0bb5e tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:59.108539 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d7f0917f-e078-4834-9df7-bde9f7d0bb5e tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:59.109902 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d7f0917f-e078-4834-9df7-bde9f7d0bb5e tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:59.110716 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d7f0917f-e078-4834-9df7-bde9f7d0bb5e tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:59.338982 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-d7f0917f-e078-4834-9df7-bde9f7d0bb5e tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:22:59.351513 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d7f0917f-e078-4834-9df7-bde9f7d0bb5e tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1724 microversion: 2.1 time: 0.256740 May 24 15:22:59.359212 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 223/434] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:22:59 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1724 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:22:59.855758 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d15858e4-bb64-4e9e-ab1d-6024ca453ac8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:22:59.856379 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d15858e4-bb64-4e9e-ab1d-6024ca453ac8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:22:59.863531 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d15858e4-bb64-4e9e-ab1d-6024ca453ac8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:59.864056 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d15858e4-bb64-4e9e-ab1d-6024ca453ac8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:22:59.864940 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d15858e4-bb64-4e9e-ab1d-6024ca453ac8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:22:59.865374 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d15858e4-bb64-4e9e-ab1d-6024ca453ac8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:00.128943 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-d15858e4-bb64-4e9e-ab1d-6024ca453ac8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:00.138546 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-d15858e4-bb64-4e9e-ab1d-6024ca453ac8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:00.141248 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-d15858e4-bb64-4e9e-ab1d-6024ca453ac8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:00.142567 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d15858e4-bb64-4e9e-ab1d-6024ca453ac8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1809 microversion: 2.20 time: 0.291345 May 24 15:23:00.143222 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 212/435] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:22:59 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1809 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:23:00.377831 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-9209582d-bcb5-4e70-bc2e-8fe738d8d5ed tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:00.378463 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-9209582d-bcb5-4e70-bc2e-8fe738d8d5ed tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:00.391435 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9209582d-bcb5-4e70-bc2e-8fe738d8d5ed tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:00.392227 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9209582d-bcb5-4e70-bc2e-8fe738d8d5ed tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:00.393765 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9209582d-bcb5-4e70-bc2e-8fe738d8d5ed tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:00.394447 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9209582d-bcb5-4e70-bc2e-8fe738d8d5ed tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:00.397949 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:23:00.587178 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-9209582d-bcb5-4e70-bc2e-8fe738d8d5ed tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:00.596333 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-9209582d-bcb5-4e70-bc2e-8fe738d8d5ed tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1724 microversion: 2.1 time: 0.222533 May 24 15:23:00.597326 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 224/436] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:00 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:23:01.162098 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-b275b52f-7409-415b-b136-90c0e24ce16c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:01.162937 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-b275b52f-7409-415b-b136-90c0e24ce16c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:01.165063 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_api:SELECT=81 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:23:01.180719 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b275b52f-7409-415b-b136-90c0e24ce16c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:01.181553 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b275b52f-7409-415b-b136-90c0e24ce16c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:01.182569 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b275b52f-7409-415b-b136-90c0e24ce16c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:01.183782 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b275b52f-7409-415b-b136-90c0e24ce16c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:01.420574 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-b275b52f-7409-415b-b136-90c0e24ce16c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:01.436103 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-b275b52f-7409-415b-b136-90c0e24ce16c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:01.437750 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-b275b52f-7409-415b-b136-90c0e24ce16c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:01.438926 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-b275b52f-7409-415b-b136-90c0e24ce16c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1809 microversion: 2.20 time: 0.281034 May 24 15:23:01.451455 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 213/437] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:23:01 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1809 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:23:01.614621 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-fdc2d309-183c-4f15-8144-c8a0fca85262 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:01.615934 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-fdc2d309-183c-4f15-8144-c8a0fca85262 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:01.623414 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fdc2d309-183c-4f15-8144-c8a0fca85262 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:01.623950 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fdc2d309-183c-4f15-8144-c8a0fca85262 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:01.624986 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fdc2d309-183c-4f15-8144-c8a0fca85262 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:01.625500 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fdc2d309-183c-4f15-8144-c8a0fca85262 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:01.827383 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-fdc2d309-183c-4f15-8144-c8a0fca85262 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:01.837314 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-fdc2d309-183c-4f15-8144-c8a0fca85262 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1724 microversion: 2.1 time: 0.226475 May 24 15:23:01.837997 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 225/438] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:01 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1724 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:23:02.471044 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-305c3ea9-7498-4237-95fc-7c56614daa05 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:02.472275 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-305c3ea9-7498-4237-95fc-7c56614daa05 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:02.482626 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-305c3ea9-7498-4237-95fc-7c56614daa05 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:02.485134 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-305c3ea9-7498-4237-95fc-7c56614daa05 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:02.488191 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-305c3ea9-7498-4237-95fc-7c56614daa05 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:02.488191 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-305c3ea9-7498-4237-95fc-7c56614daa05 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:02.654617 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-305c3ea9-7498-4237-95fc-7c56614daa05 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:02.663871 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-305c3ea9-7498-4237-95fc-7c56614daa05 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:02.665485 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-305c3ea9-7498-4237-95fc-7c56614daa05 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:02.666667 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-305c3ea9-7498-4237-95fc-7c56614daa05 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1809 microversion: 2.20 time: 0.201772 May 24 15:23:02.679619 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 214/439] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:23:02 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1809 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:23:02.856444 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d11aa43b-e75c-42a8-94e0-41c39056a263 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:02.857047 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d11aa43b-e75c-42a8-94e0-41c39056a263 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:02.868119 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d11aa43b-e75c-42a8-94e0-41c39056a263 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:02.868602 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d11aa43b-e75c-42a8-94e0-41c39056a263 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:02.869381 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d11aa43b-e75c-42a8-94e0-41c39056a263 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:02.869816 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d11aa43b-e75c-42a8-94e0-41c39056a263 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:03.032636 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-d11aa43b-e75c-42a8-94e0-41c39056a263 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:03.041497 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d11aa43b-e75c-42a8-94e0-41c39056a263 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1701 microversion: 2.1 time: 0.190332 May 24 15:23:03.044667 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 226/440] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:02 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1701 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:23:03.059535 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-3942beb7-76d8-4fe8-935e-6bd8d9e4105d tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:23:03.066532 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3942beb7-76d8-4fe8-935e-6bd8d9e4105d tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:03.066985 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3942beb7-76d8-4fe8-935e-6bd8d9e4105d tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:03.093306 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-3942beb7-76d8-4fe8-935e-6bd8d9e4105d tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Going to try to start instance {{(pid=117699) start /opt/stack/nova/nova/compute/api.py:2730}} May 24 15:23:03.142883 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-3942beb7-76d8-4fe8-935e-6bd8d9e4105d tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "POST /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa/action" status: 202 len: 0 microversion: 2.1 time: 0.087670 May 24 15:23:03.144001 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 215/441] 10.222.0.45 () {60 vars in 1277 bytes} [Tue May 24 15:23:03 2022] POST /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 15:23:03.155653 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-6da182b3-eba9-43a6-9655-42539c47fc68 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:03.156771 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-6da182b3-eba9-43a6-9655-42539c47fc68 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:03.166716 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6da182b3-eba9-43a6-9655-42539c47fc68 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:03.168198 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6da182b3-eba9-43a6-9655-42539c47fc68 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:03.169256 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6da182b3-eba9-43a6-9655-42539c47fc68 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:03.169750 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6da182b3-eba9-43a6-9655-42539c47fc68 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:03.325485 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-6da182b3-eba9-43a6-9655-42539c47fc68 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:03.334186 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-6da182b3-eba9-43a6-9655-42539c47fc68 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1710 microversion: 2.1 time: 0.185704 May 24 15:23:03.334960 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 227/442] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:03 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1710 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:23:03.686821 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f324aaad-b779-4e28-982b-dfbc15ba0717 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:03.687682 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f324aaad-b779-4e28-982b-dfbc15ba0717 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:03.697101 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f324aaad-b779-4e28-982b-dfbc15ba0717 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:03.700512 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f324aaad-b779-4e28-982b-dfbc15ba0717 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:03.701343 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f324aaad-b779-4e28-982b-dfbc15ba0717 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:03.701795 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f324aaad-b779-4e28-982b-dfbc15ba0717 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:03.986004 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-f324aaad-b779-4e28-982b-dfbc15ba0717 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:03.997643 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-f324aaad-b779-4e28-982b-dfbc15ba0717 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:03.999505 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-f324aaad-b779-4e28-982b-dfbc15ba0717 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:04.003338 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f324aaad-b779-4e28-982b-dfbc15ba0717 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1809 microversion: 2.20 time: 0.319433 May 24 15:23:04.004133 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 216/443] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:23:03 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1809 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:23:04.351371 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d5308a79-f053-457f-8a47-28efc6af5085 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:04.352188 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d5308a79-f053-457f-8a47-28efc6af5085 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:04.370953 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d5308a79-f053-457f-8a47-28efc6af5085 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:04.371328 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d5308a79-f053-457f-8a47-28efc6af5085 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:04.373795 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d5308a79-f053-457f-8a47-28efc6af5085 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:04.374254 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d5308a79-f053-457f-8a47-28efc6af5085 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:04.545324 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-d5308a79-f053-457f-8a47-28efc6af5085 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:04.554508 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d5308a79-f053-457f-8a47-28efc6af5085 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1710 microversion: 2.1 time: 0.206721 May 24 15:23:04.555322 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 228/444] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:04 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1710 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:23:05.022955 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-104bd45c-40c4-4824-aada-bac90d36ecd4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:05.024475 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-104bd45c-40c4-4824-aada-bac90d36ecd4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:05.034588 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-104bd45c-40c4-4824-aada-bac90d36ecd4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:05.035054 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-104bd45c-40c4-4824-aada-bac90d36ecd4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:05.035877 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-104bd45c-40c4-4824-aada-bac90d36ecd4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:05.036289 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-104bd45c-40c4-4824-aada-bac90d36ecd4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:05.225433 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-104bd45c-40c4-4824-aada-bac90d36ecd4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:05.235636 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-104bd45c-40c4-4824-aada-bac90d36ecd4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:05.237869 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-104bd45c-40c4-4824-aada-bac90d36ecd4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:05.239382 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-104bd45c-40c4-4824-aada-bac90d36ecd4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1809 microversion: 2.20 time: 0.221164 May 24 15:23:05.252494 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 217/445] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:23:05 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1809 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:23:05.571386 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-a92e09f6-b834-4a8f-ba2b-b777c25fd21b tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:05.572335 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-a92e09f6-b834-4a8f-ba2b-b777c25fd21b tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:05.582854 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a92e09f6-b834-4a8f-ba2b-b777c25fd21b tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:05.583522 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a92e09f6-b834-4a8f-ba2b-b777c25fd21b tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:05.584508 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a92e09f6-b834-4a8f-ba2b-b777c25fd21b tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:05.585167 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a92e09f6-b834-4a8f-ba2b-b777c25fd21b tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:06.033807 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-a92e09f6-b834-4a8f-ba2b-b777c25fd21b tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:06.042139 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-a92e09f6-b834-4a8f-ba2b-b777c25fd21b tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1710 microversion: 2.1 time: 0.474483 May 24 15:23:06.043558 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 229/446] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:05 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1710 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:23:06.259564 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-1213b418-3398-4b9b-a9ef-784bc550ee44 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:06.260174 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-1213b418-3398-4b9b-a9ef-784bc550ee44 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:06.267145 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1213b418-3398-4b9b-a9ef-784bc550ee44 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:06.267637 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1213b418-3398-4b9b-a9ef-784bc550ee44 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:06.268481 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1213b418-3398-4b9b-a9ef-784bc550ee44 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:06.268852 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1213b418-3398-4b9b-a9ef-784bc550ee44 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:06.419656 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-1213b418-3398-4b9b-a9ef-784bc550ee44 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:06.429387 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-1213b418-3398-4b9b-a9ef-784bc550ee44 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:06.431669 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-1213b418-3398-4b9b-a9ef-784bc550ee44 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:06.433561 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-1213b418-3398-4b9b-a9ef-784bc550ee44 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1809 microversion: 2.20 time: 0.177843 May 24 15:23:06.434106 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 218/447] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:23:06 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:23:07.060580 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-8a1fed56-47fe-45d7-b3e4-d3c162c80aa4 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:07.061168 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-8a1fed56-47fe-45d7-b3e4-d3c162c80aa4 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:07.067579 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8a1fed56-47fe-45d7-b3e4-d3c162c80aa4 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:07.068034 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8a1fed56-47fe-45d7-b3e4-d3c162c80aa4 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:07.068853 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8a1fed56-47fe-45d7-b3e4-d3c162c80aa4 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:07.077490 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8a1fed56-47fe-45d7-b3e4-d3c162c80aa4 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:07.233749 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-8a1fed56-47fe-45d7-b3e4-d3c162c80aa4 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:07.242530 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-8a1fed56-47fe-45d7-b3e4-d3c162c80aa4 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1714 microversion: 2.1 time: 0.186656 May 24 15:23:07.243332 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 230/448] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:07 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1714 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:23:07.454916 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-398354a7-60c2-4884-8f9a-f8cdd5205928 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:07.455535 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-398354a7-60c2-4884-8f9a-f8cdd5205928 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:07.462209 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-398354a7-60c2-4884-8f9a-f8cdd5205928 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:07.462654 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-398354a7-60c2-4884-8f9a-f8cdd5205928 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:07.463429 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-398354a7-60c2-4884-8f9a-f8cdd5205928 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:07.463854 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-398354a7-60c2-4884-8f9a-f8cdd5205928 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:07.625782 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-398354a7-60c2-4884-8f9a-f8cdd5205928 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:07.634331 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-398354a7-60c2-4884-8f9a-f8cdd5205928 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:07.635826 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-398354a7-60c2-4884-8f9a-f8cdd5205928 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:07.637509 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-398354a7-60c2-4884-8f9a-f8cdd5205928 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1809 microversion: 2.20 time: 0.186139 May 24 15:23:07.640880 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 219/449] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:23:07 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1809 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:23:08.654427 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c3cf07f8-79b0-4ae6-904a-1e8f91f943bb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:08.654993 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-c3cf07f8-79b0-4ae6-904a-1e8f91f943bb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:08.661456 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c3cf07f8-79b0-4ae6-904a-1e8f91f943bb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:08.661899 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c3cf07f8-79b0-4ae6-904a-1e8f91f943bb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:08.662644 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c3cf07f8-79b0-4ae6-904a-1e8f91f943bb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:08.663073 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c3cf07f8-79b0-4ae6-904a-1e8f91f943bb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:08.789571 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-c3cf07f8-79b0-4ae6-904a-1e8f91f943bb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:08.798043 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-c3cf07f8-79b0-4ae6-904a-1e8f91f943bb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:08.799558 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-c3cf07f8-79b0-4ae6-904a-1e8f91f943bb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:08.800723 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-c3cf07f8-79b0-4ae6-904a-1e8f91f943bb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1809 microversion: 2.20 time: 0.150259 May 24 15:23:08.801288 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 231/450] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:23:08 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:23:09.818788 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-8f619796-96fa-4f4a-bc2b-3b200b8bc8b3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:09.819390 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-8f619796-96fa-4f4a-bc2b-3b200b8bc8b3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:09.825941 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8f619796-96fa-4f4a-bc2b-3b200b8bc8b3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:09.826401 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8f619796-96fa-4f4a-bc2b-3b200b8bc8b3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:09.827138 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8f619796-96fa-4f4a-bc2b-3b200b8bc8b3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:09.827588 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8f619796-96fa-4f4a-bc2b-3b200b8bc8b3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:09.955361 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-8f619796-96fa-4f4a-bc2b-3b200b8bc8b3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:09.964916 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-8f619796-96fa-4f4a-bc2b-3b200b8bc8b3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:09.966412 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-8f619796-96fa-4f4a-bc2b-3b200b8bc8b3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:09.967570 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-8f619796-96fa-4f4a-bc2b-3b200b8bc8b3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1809 microversion: 2.20 time: 0.152627 May 24 15:23:09.968137 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 220/451] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:23:09 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:23:10.989489 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-5458ff9d-aa43-4c25-8d66-b9b4449b2d8c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:10.991099 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-5458ff9d-aa43-4c25-8d66-b9b4449b2d8c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:10.993294 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:23:10.999872 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5458ff9d-aa43-4c25-8d66-b9b4449b2d8c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:11.000480 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5458ff9d-aa43-4c25-8d66-b9b4449b2d8c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:11.001529 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5458ff9d-aa43-4c25-8d66-b9b4449b2d8c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:11.002071 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5458ff9d-aa43-4c25-8d66-b9b4449b2d8c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:11.228022 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-5458ff9d-aa43-4c25-8d66-b9b4449b2d8c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:11.237365 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-5458ff9d-aa43-4c25-8d66-b9b4449b2d8c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:11.238860 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-5458ff9d-aa43-4c25-8d66-b9b4449b2d8c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:11.240026 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-5458ff9d-aa43-4c25-8d66-b9b4449b2d8c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1809 microversion: 2.20 time: 0.257624 May 24 15:23:11.240611 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 232/452] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:23:10 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1809 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:23:12.258305 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-4bd0c60a-0dcc-4629-922b-10f0a84f80db tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:12.258902 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-4bd0c60a-0dcc-4629-922b-10f0a84f80db tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:12.266036 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4bd0c60a-0dcc-4629-922b-10f0a84f80db tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:12.266482 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4bd0c60a-0dcc-4629-922b-10f0a84f80db tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:12.267251 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4bd0c60a-0dcc-4629-922b-10f0a84f80db tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:12.267684 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4bd0c60a-0dcc-4629-922b-10f0a84f80db tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:12.403211 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-4bd0c60a-0dcc-4629-922b-10f0a84f80db tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:12.412114 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-4bd0c60a-0dcc-4629-922b-10f0a84f80db tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:12.414163 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-4bd0c60a-0dcc-4629-922b-10f0a84f80db tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:12.415447 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-4bd0c60a-0dcc-4629-922b-10f0a84f80db tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1809 microversion: 2.20 time: 0.161001 May 24 15:23:12.416529 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 221/453] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:23:12 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:23:12.502525 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [req-09ffcf1b-ad99-49a2-81df-c3def4b35132 req-cddf9119-66df-4d4a-ba3b-207d406ac6a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c54fc3c-070c-4cab-b181-081d80eeb078", "name": "network-vif-plugged", "status": "completed", "tag": "17e61d65-8da4-4259-8227-bdbecc4fa610"}]} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:23:12.512828 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-09ffcf1b-ad99-49a2-81df-c3def4b35132 req-cddf9119-66df-4d4a-ba3b-207d406ac6a8 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:12.513277 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-09ffcf1b-ad99-49a2-81df-c3def4b35132 req-cddf9119-66df-4d4a-ba3b-207d406ac6a8 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:12.527294 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.compute.server_external_events [req-09ffcf1b-ad99-49a2-81df-c3def4b35132 req-cddf9119-66df-4d4a-ba3b-207d406ac6a8 service nova] Creating event network-vif-plugged:17e61d65-8da4-4259-8227-bdbecc4fa610 for instance 6c54fc3c-070c-4cab-b181-081d80eeb078 on hv-cinder-84315 May 24 15:23:12.532769 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [req-09ffcf1b-ad99-49a2-81df-c3def4b35132 req-cddf9119-66df-4d4a-ba3b-207d406ac6a8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034826 May 24 15:23:12.533641 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 233/454] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:23:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:23:13.434257 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a8050aec-31ed-4f00-8258-1e82efc073f6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:13.434870 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a8050aec-31ed-4f00-8258-1e82efc073f6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:13.441479 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a8050aec-31ed-4f00-8258-1e82efc073f6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:13.441926 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a8050aec-31ed-4f00-8258-1e82efc073f6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:13.442682 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a8050aec-31ed-4f00-8258-1e82efc073f6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:13.443111 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a8050aec-31ed-4f00-8258-1e82efc073f6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:13.576480 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-a8050aec-31ed-4f00-8258-1e82efc073f6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:13.584879 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-a8050aec-31ed-4f00-8258-1e82efc073f6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:13.586450 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-a8050aec-31ed-4f00-8258-1e82efc073f6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:13.587711 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a8050aec-31ed-4f00-8258-1e82efc073f6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1809 microversion: 2.20 time: 0.157844 May 24 15:23:13.588415 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 222/455] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:23:13 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:23:14.607536 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-4d3194b4-115b-4f7a-a209-55bcff73ad7e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:14.608556 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-4d3194b4-115b-4f7a-a209-55bcff73ad7e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:14.614697 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4d3194b4-115b-4f7a-a209-55bcff73ad7e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:14.615143 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4d3194b4-115b-4f7a-a209-55bcff73ad7e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:14.615908 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4d3194b4-115b-4f7a-a209-55bcff73ad7e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:14.616366 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4d3194b4-115b-4f7a-a209-55bcff73ad7e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:14.747248 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-4d3194b4-115b-4f7a-a209-55bcff73ad7e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:14.755573 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-4d3194b4-115b-4f7a-a209-55bcff73ad7e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:14.757229 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-4d3194b4-115b-4f7a-a209-55bcff73ad7e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:14.758375 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-4d3194b4-115b-4f7a-a209-55bcff73ad7e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1809 microversion: 2.20 time: 0.156340 May 24 15:23:14.758929 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 234/456] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:23:14 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:23:15.226024 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e8f5e5f3-fecb-496b-a44d-574d7386bbbf tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-262243003", "imageRef": "f921f75e-bbd1-4d99-ab1e-5cce2d895148", "flavorRef": "452"}} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:23:15.279317 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.network.neutron [None req-e8f5e5f3-fecb-496b-a44d-574d7386bbbf tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] validate_networks() for None {{(pid=117699) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 15:23:15.771953 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.virt.hardware [None req-e8f5e5f3-fecb-496b-a44d-574d7386bbbf tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Flavor limits 0:0:0 {{(pid=117699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 15:23:15.772449 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.virt.hardware [None req-e8f5e5f3-fecb-496b-a44d-574d7386bbbf tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Image limits 0:0:0 {{(pid=117699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 15:23:15.772920 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.virt.hardware [None req-e8f5e5f3-fecb-496b-a44d-574d7386bbbf tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Flavor pref 0:0:0 {{(pid=117699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 15:23:15.773685 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.virt.hardware [None req-e8f5e5f3-fecb-496b-a44d-574d7386bbbf tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Image pref 0:0:0 {{(pid=117699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 15:23:15.774102 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.virt.hardware [None req-e8f5e5f3-fecb-496b-a44d-574d7386bbbf tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 15:23:15.777434 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-eab2578b-f23e-4686-baf3-d75e5737d110 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:15.778376 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-eab2578b-f23e-4686-baf3-d75e5737d110 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:15.784512 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e8f5e5f3-fecb-496b-a44d-574d7386bbbf tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:15.784958 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e8f5e5f3-fecb-496b-a44d-574d7386bbbf tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:15.785566 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-eab2578b-f23e-4686-baf3-d75e5737d110 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:15.785929 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e8f5e5f3-fecb-496b-a44d-574d7386bbbf tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:15.786422 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e8f5e5f3-fecb-496b-a44d-574d7386bbbf tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:15.787248 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-eab2578b-f23e-4686-baf3-d75e5737d110 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:15.788038 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-eab2578b-f23e-4686-baf3-d75e5737d110 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:15.788509 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-eab2578b-f23e-4686-baf3-d75e5737d110 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:15.803448 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.quota [None req-e8f5e5f3-fecb-496b-a44d-574d7386bbbf tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Getting quotas for project c71a42e029754231b2e00938acc6b7f3. Resources: {'instances', 'ram', 'cores'} {{(pid=117699) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 15:23:15.807461 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.quota [None req-e8f5e5f3-fecb-496b-a44d-574d7386bbbf tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Getting quotas for user e62db1d026f949eb82a425bc8dcd6377 and project c71a42e029754231b2e00938acc6b7f3. Resources: {'instances', 'ram', 'cores'} {{(pid=117699) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 15:23:15.818490 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-e8f5e5f3-fecb-496b-a44d-574d7386bbbf tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Going to run 1 instances... {{(pid=117699) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 15:23:15.820837 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-e8f5e5f3-fecb-496b-a44d-574d7386bbbf tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] [instance: 6175db54-93e8-4f85-9d45-c288cd5baee5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f921f75e-bbd1-4d99-ab1e-5cce2d895148',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 15:23:15.865106 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-e8f5e5f3-fecb-496b-a44d-574d7386bbbf tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.642862 May 24 15:23:15.870503 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 223/457] 10.222.0.45 () {60 vars in 1146 bytes} [Tue May 24 15:23:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 15:23:15.875544 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f7944711-ebd6-46ed-9eb6-5f38f8edf24f tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:15.876203 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f7944711-ebd6-46ed-9eb6-5f38f8edf24f tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] [instance: 6175db54-93e8-4f85-9d45-c288cd5baee5] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:15.931938 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-f7944711-ebd6-46ed-9eb6-5f38f8edf24f tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62db1d026f949eb82a425bc8dcd6377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c71a42e029754231b2e00938acc6b7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:15.932936 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-eab2578b-f23e-4686-baf3-d75e5737d110 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:15.938909 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f7944711-ebd6-46ed-9eb6-5f38f8edf24f tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] 10.222.0.45 "GET /compute/v2.1/servers/6175db54-93e8-4f85-9d45-c288cd5baee5" status: 200 len: 1214 microversion: 2.1 time: 0.067203 May 24 15:23:15.940030 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 224/458] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:15 2022] GET /compute/v2.1/servers/6175db54-93e8-4f85-9d45-c288cd5baee5 => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:23:15.942792 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-eab2578b-f23e-4686-baf3-d75e5737d110 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:15.944707 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-eab2578b-f23e-4686-baf3-d75e5737d110 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:15.946309 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-eab2578b-f23e-4686-baf3-d75e5737d110 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1809 microversion: 2.20 time: 0.173638 May 24 15:23:15.947347 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 235/459] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:23:15 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:23:16.957548 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d61e1362-7a69-474e-bfdf-0e78033b64df tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:16.958215 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d61e1362-7a69-474e-bfdf-0e78033b64df tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] [instance: 6175db54-93e8-4f85-9d45-c288cd5baee5] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:16.965180 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-29953f59-d6a9-4a5f-aa71-5d5e5951bb7b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:16.965876 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-29953f59-d6a9-4a5f-aa71-5d5e5951bb7b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:16.966028 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d61e1362-7a69-474e-bfdf-0e78033b64df tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:16.966676 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d61e1362-7a69-474e-bfdf-0e78033b64df tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:16.967878 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d61e1362-7a69-474e-bfdf-0e78033b64df tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:16.967878 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d61e1362-7a69-474e-bfdf-0e78033b64df tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:16.975529 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-29953f59-d6a9-4a5f-aa71-5d5e5951bb7b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:16.976183 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-29953f59-d6a9-4a5f-aa71-5d5e5951bb7b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:16.977124 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-29953f59-d6a9-4a5f-aa71-5d5e5951bb7b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:16.977713 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-29953f59-d6a9-4a5f-aa71-5d5e5951bb7b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:17.063484 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-d61e1362-7a69-474e-bfdf-0e78033b64df tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62db1d026f949eb82a425bc8dcd6377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c71a42e029754231b2e00938acc6b7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:17.071755 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d61e1362-7a69-474e-bfdf-0e78033b64df tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] 10.222.0.45 "GET /compute/v2.1/servers/6175db54-93e8-4f85-9d45-c288cd5baee5" status: 200 len: 1284 microversion: 2.1 time: 0.119126 May 24 15:23:17.077617 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 225/460] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:16 2022] GET /compute/v2.1/servers/6175db54-93e8-4f85-9d45-c288cd5baee5 => generated 1284 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:23:17.269740 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-29953f59-d6a9-4a5f-aa71-5d5e5951bb7b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:17.278678 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-29953f59-d6a9-4a5f-aa71-5d5e5951bb7b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:17.280170 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-29953f59-d6a9-4a5f-aa71-5d5e5951bb7b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:17.281361 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-29953f59-d6a9-4a5f-aa71-5d5e5951bb7b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1796 microversion: 2.20 time: 0.320930 May 24 15:23:17.281918 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 236/461] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:23:16 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1796 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:23:18.089592 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-2abbb5e1-13e5-47c8-9d9c-0e13cb43d95f tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:18.090246 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-2abbb5e1-13e5-47c8-9d9c-0e13cb43d95f tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] [instance: 6175db54-93e8-4f85-9d45-c288cd5baee5] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:18.096931 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2abbb5e1-13e5-47c8-9d9c-0e13cb43d95f tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:18.097454 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2abbb5e1-13e5-47c8-9d9c-0e13cb43d95f tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:18.098302 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2abbb5e1-13e5-47c8-9d9c-0e13cb43d95f tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:18.098808 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2abbb5e1-13e5-47c8-9d9c-0e13cb43d95f tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:18.225906 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-2abbb5e1-13e5-47c8-9d9c-0e13cb43d95f tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62db1d026f949eb82a425bc8dcd6377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c71a42e029754231b2e00938acc6b7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:18.233663 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-2abbb5e1-13e5-47c8-9d9c-0e13cb43d95f tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] 10.222.0.45 "GET /compute/v2.1/servers/6175db54-93e8-4f85-9d45-c288cd5baee5" status: 200 len: 1314 microversion: 2.1 time: 0.148650 May 24 15:23:18.234226 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 226/462] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:18 2022] GET /compute/v2.1/servers/6175db54-93e8-4f85-9d45-c288cd5baee5 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:23:18.540853 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [req-c8faf526-f3dc-4de9-a69d-1bc69f5a76e0 req-831621be-b320-44bd-a4a2-9246c4521284 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6175db54-93e8-4f85-9d45-c288cd5baee5", "tag": "6ce7ce8b-cd1c-41d9-80b5-0772ff64f09c"}]} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:23:18.558746 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-c8faf526-f3dc-4de9-a69d-1bc69f5a76e0 req-831621be-b320-44bd-a4a2-9246c4521284 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:18.559192 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-c8faf526-f3dc-4de9-a69d-1bc69f5a76e0 req-831621be-b320-44bd-a4a2-9246c4521284 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:18.575810 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.compute.server_external_events [req-c8faf526-f3dc-4de9-a69d-1bc69f5a76e0 req-831621be-b320-44bd-a4a2-9246c4521284 service nova] Creating event network-changed:6ce7ce8b-cd1c-41d9-80b5-0772ff64f09c for instance 6175db54-93e8-4f85-9d45-c288cd5baee5 on hv-cinder-84315 May 24 15:23:18.584513 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [req-c8faf526-f3dc-4de9-a69d-1bc69f5a76e0 req-831621be-b320-44bd-a4a2-9246c4521284 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049618 May 24 15:23:18.586262 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 237/463] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:23:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:23:19.250385 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-ba0f89e2-bcb5-4b23-9a8c-c9afa1d9f063 tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:19.250997 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-ba0f89e2-bcb5-4b23-9a8c-c9afa1d9f063 tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] [instance: 6175db54-93e8-4f85-9d45-c288cd5baee5] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:19.257494 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ba0f89e2-bcb5-4b23-9a8c-c9afa1d9f063 tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:19.257935 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ba0f89e2-bcb5-4b23-9a8c-c9afa1d9f063 tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:19.258690 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ba0f89e2-bcb5-4b23-9a8c-c9afa1d9f063 tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:19.259122 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ba0f89e2-bcb5-4b23-9a8c-c9afa1d9f063 tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:19.277099 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:23:19.389125 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-ba0f89e2-bcb5-4b23-9a8c-c9afa1d9f063 tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62db1d026f949eb82a425bc8dcd6377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c71a42e029754231b2e00938acc6b7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:19.396560 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-ba0f89e2-bcb5-4b23-9a8c-c9afa1d9f063 tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] 10.222.0.45 "GET /compute/v2.1/servers/6175db54-93e8-4f85-9d45-c288cd5baee5" status: 200 len: 1314 microversion: 2.1 time: 0.149951 May 24 15:23:19.397124 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 227/464] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:19 2022] GET /compute/v2.1/servers/6175db54-93e8-4f85-9d45-c288cd5baee5 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:23:20.414353 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-0a5b03f6-6da4-4c7e-8000-329687259860 tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:20.415104 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-0a5b03f6-6da4-4c7e-8000-329687259860 tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] [instance: 6175db54-93e8-4f85-9d45-c288cd5baee5] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:20.422331 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0a5b03f6-6da4-4c7e-8000-329687259860 tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:20.422782 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0a5b03f6-6da4-4c7e-8000-329687259860 tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:20.423548 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0a5b03f6-6da4-4c7e-8000-329687259860 tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:20.423993 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0a5b03f6-6da4-4c7e-8000-329687259860 tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:20.673069 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-0a5b03f6-6da4-4c7e-8000-329687259860 tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62db1d026f949eb82a425bc8dcd6377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c71a42e029754231b2e00938acc6b7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:20.680312 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-0a5b03f6-6da4-4c7e-8000-329687259860 tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] 10.222.0.45 "GET /compute/v2.1/servers/6175db54-93e8-4f85-9d45-c288cd5baee5" status: 200 len: 1314 microversion: 2.1 time: 0.270217 May 24 15:23:20.680884 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 238/465] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:20 2022] GET /compute/v2.1/servers/6175db54-93e8-4f85-9d45-c288cd5baee5 => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:23:21.696834 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-9093b5b6-6683-4899-aee0-5ad2ad520dbc tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:21.697493 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-9093b5b6-6683-4899-aee0-5ad2ad520dbc tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] [instance: 6175db54-93e8-4f85-9d45-c288cd5baee5] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:21.703968 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9093b5b6-6683-4899-aee0-5ad2ad520dbc tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:21.704454 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9093b5b6-6683-4899-aee0-5ad2ad520dbc tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:21.705215 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9093b5b6-6683-4899-aee0-5ad2ad520dbc tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:21.705717 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9093b5b6-6683-4899-aee0-5ad2ad520dbc tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:21.833554 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-9093b5b6-6683-4899-aee0-5ad2ad520dbc tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62db1d026f949eb82a425bc8dcd6377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c71a42e029754231b2e00938acc6b7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:21.840979 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-9093b5b6-6683-4899-aee0-5ad2ad520dbc tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] 10.222.0.45 "GET /compute/v2.1/servers/6175db54-93e8-4f85-9d45-c288cd5baee5" status: 200 len: 1314 microversion: 2.1 time: 0.147930 May 24 15:23:21.841548 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 228/466] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:21 2022] GET /compute/v2.1/servers/6175db54-93e8-4f85-9d45-c288cd5baee5 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:23:22.197549 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-432b2c40-0960-41d6-80f5-d33098f2d00e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:23:22.198492 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-432b2c40-0960-41d6-80f5-d33098f2d00e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:22.205067 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-432b2c40-0960-41d6-80f5-d33098f2d00e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:22.205505 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-432b2c40-0960-41d6-80f5-d33098f2d00e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:22.206246 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-432b2c40-0960-41d6-80f5-d33098f2d00e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:22.206672 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-432b2c40-0960-41d6-80f5-d33098f2d00e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:22.281869 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-432b2c40-0960-41d6-80f5-d33098f2d00e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "POST /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/action" status: 202 len: 0 microversion: 2.1 time: 0.088000 May 24 15:23:22.282573 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 239/467] 10.222.0.45 () {60 vars in 1277 bytes} [Tue May 24 15:23:22 2022] POST /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 15:23:22.290557 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-ad29dac4-27b4-4477-814a-9e231ed4b3e0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:22.291323 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-ad29dac4-27b4-4477-814a-9e231ed4b3e0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:22.305271 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ad29dac4-27b4-4477-814a-9e231ed4b3e0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:22.305713 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ad29dac4-27b4-4477-814a-9e231ed4b3e0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:22.306482 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ad29dac4-27b4-4477-814a-9e231ed4b3e0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:22.306914 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ad29dac4-27b4-4477-814a-9e231ed4b3e0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:22.458084 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-ad29dac4-27b4-4477-814a-9e231ed4b3e0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:22.468746 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-ad29dac4-27b4-4477-814a-9e231ed4b3e0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1751 microversion: 2.1 time: 0.181781 May 24 15:23:22.470188 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 229/468] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:22 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1751 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:23:22.528555 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [req-1ddfefdf-821f-4d91-846d-398d9a4f3665 req-b33bb033-aba2-4f54-9de0-ab776b824b31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6175db54-93e8-4f85-9d45-c288cd5baee5", "name": "network-vif-plugged", "status": "completed", "tag": "6ce7ce8b-cd1c-41d9-80b5-0772ff64f09c"}]} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:23:22.538068 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-1ddfefdf-821f-4d91-846d-398d9a4f3665 req-b33bb033-aba2-4f54-9de0-ab776b824b31 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:22.538516 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-1ddfefdf-821f-4d91-846d-398d9a4f3665 req-b33bb033-aba2-4f54-9de0-ab776b824b31 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:22.550027 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.compute.server_external_events [req-1ddfefdf-821f-4d91-846d-398d9a4f3665 req-b33bb033-aba2-4f54-9de0-ab776b824b31 service nova] Creating event network-vif-plugged:6ce7ce8b-cd1c-41d9-80b5-0772ff64f09c for instance 6175db54-93e8-4f85-9d45-c288cd5baee5 on hv-cinder-84315 May 24 15:23:22.554978 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [req-1ddfefdf-821f-4d91-846d-398d9a4f3665 req-b33bb033-aba2-4f54-9de0-ab776b824b31 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032546 May 24 15:23:22.555759 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 240/469] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:23:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:23:22.858741 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d26f7391-e80a-4101-89ac-3b0fb22b795a tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:22.859377 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d26f7391-e80a-4101-89ac-3b0fb22b795a tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] [instance: 6175db54-93e8-4f85-9d45-c288cd5baee5] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:22.866248 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d26f7391-e80a-4101-89ac-3b0fb22b795a tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:22.866690 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d26f7391-e80a-4101-89ac-3b0fb22b795a tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:22.867462 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d26f7391-e80a-4101-89ac-3b0fb22b795a tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:22.867896 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d26f7391-e80a-4101-89ac-3b0fb22b795a tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:23.008388 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-d26f7391-e80a-4101-89ac-3b0fb22b795a tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62db1d026f949eb82a425bc8dcd6377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c71a42e029754231b2e00938acc6b7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:23.016227 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d26f7391-e80a-4101-89ac-3b0fb22b795a tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] 10.222.0.45 "GET /compute/v2.1/servers/6175db54-93e8-4f85-9d45-c288cd5baee5" status: 200 len: 1314 microversion: 2.1 time: 0.162308 May 24 15:23:23.016835 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 230/470] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:22 2022] GET /compute/v2.1/servers/6175db54-93e8-4f85-9d45-c288cd5baee5 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:23:23.488136 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-3c1586ee-f7d3-4812-a377-7674b0fd920a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:23.488858 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-3c1586ee-f7d3-4812-a377-7674b0fd920a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:23.495527 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3c1586ee-f7d3-4812-a377-7674b0fd920a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:23.495971 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3c1586ee-f7d3-4812-a377-7674b0fd920a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:23.496761 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3c1586ee-f7d3-4812-a377-7674b0fd920a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:23.497197 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3c1586ee-f7d3-4812-a377-7674b0fd920a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:23.648670 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-3c1586ee-f7d3-4812-a377-7674b0fd920a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:23.650987 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:23:23.658378 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-3c1586ee-f7d3-4812-a377-7674b0fd920a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1751 microversion: 2.1 time: 0.174946 May 24 15:23:23.658973 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 241/471] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:23 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1751 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:23:23.690199 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-b45bcc1e-117d-4772-b6d3-c72593563dda tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "58202b9b-e8dd-4cc9-b7f8-d1b681e24558"}} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:23:23.691306 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-b45bcc1e-117d-4772-b6d3-c72593563dda tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:23.697387 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b45bcc1e-117d-4772-b6d3-c72593563dda tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:23.698479 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b45bcc1e-117d-4772-b6d3-c72593563dda tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:23.699229 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b45bcc1e-117d-4772-b6d3-c72593563dda tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:23.699659 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b45bcc1e-117d-4772-b6d3-c72593563dda tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:24.032261 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c4123a1a-893e-4540-9c65-06ed2635fa8c tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:24.032813 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-c4123a1a-893e-4540-9c65-06ed2635fa8c tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] [instance: 6175db54-93e8-4f85-9d45-c288cd5baee5] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:24.040091 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c4123a1a-893e-4540-9c65-06ed2635fa8c tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:24.040562 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c4123a1a-893e-4540-9c65-06ed2635fa8c tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:24.041865 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c4123a1a-893e-4540-9c65-06ed2635fa8c tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:24.042292 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c4123a1a-893e-4540-9c65-06ed2635fa8c tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:24.171463 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-c4123a1a-893e-4540-9c65-06ed2635fa8c tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62db1d026f949eb82a425bc8dcd6377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c71a42e029754231b2e00938acc6b7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:24.179390 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-c4123a1a-893e-4540-9c65-06ed2635fa8c tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] 10.222.0.45 "GET /compute/v2.1/servers/6175db54-93e8-4f85-9d45-c288cd5baee5" status: 200 len: 1314 microversion: 2.1 time: 0.150988 May 24 15:23:24.179969 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 242/472] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:24 2022] GET /compute/v2.1/servers/6175db54-93e8-4f85-9d45-c288cd5baee5 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:23:24.345658 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-b45bcc1e-117d-4772-b6d3-c72593563dda tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "POST /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.659114 May 24 15:23:24.346354 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 231/473] 10.222.0.45 () {60 vars in 1322 bytes} [Tue May 24 15:23:23 2022] POST /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 194 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:23:24.674976 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-bc10d6d8-6d20-45a7-bf44-8cfb520a84f8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:24.675531 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-bc10d6d8-6d20-45a7-bf44-8cfb520a84f8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:24.681961 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bc10d6d8-6d20-45a7-bf44-8cfb520a84f8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:24.682401 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bc10d6d8-6d20-45a7-bf44-8cfb520a84f8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:24.683765 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bc10d6d8-6d20-45a7-bf44-8cfb520a84f8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:24.684188 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bc10d6d8-6d20-45a7-bf44-8cfb520a84f8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:24.823303 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-bc10d6d8-6d20-45a7-bf44-8cfb520a84f8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:24.831189 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-bc10d6d8-6d20-45a7-bf44-8cfb520a84f8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1756 microversion: 2.1 time: 0.160058 May 24 15:23:24.831758 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 243/474] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:24 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:23:25.198647 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-9408a4bc-e27d-4fce-ad60-6ac5dee18412 tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:25.202233 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-9408a4bc-e27d-4fce-ad60-6ac5dee18412 tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] [instance: 6175db54-93e8-4f85-9d45-c288cd5baee5] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:25.209135 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9408a4bc-e27d-4fce-ad60-6ac5dee18412 tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:25.209533 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9408a4bc-e27d-4fce-ad60-6ac5dee18412 tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:25.210373 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9408a4bc-e27d-4fce-ad60-6ac5dee18412 tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:25.210806 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9408a4bc-e27d-4fce-ad60-6ac5dee18412 tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:25.339884 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-9408a4bc-e27d-4fce-ad60-6ac5dee18412 tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62db1d026f949eb82a425bc8dcd6377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c71a42e029754231b2e00938acc6b7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:25.347327 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-9408a4bc-e27d-4fce-ad60-6ac5dee18412 tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] 10.222.0.45 "GET /compute/v2.1/servers/6175db54-93e8-4f85-9d45-c288cd5baee5" status: 200 len: 1463 microversion: 2.1 time: 0.153825 May 24 15:23:25.347904 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 232/475] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:25 2022] GET /compute/v2.1/servers/6175db54-93e8-4f85-9d45-c288cd5baee5 => generated 1463 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:23:25.385684 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-0acac430-fbf2-4852-9981-2b3b9a88f3b9 tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:25.386686 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-0acac430-fbf2-4852-9981-2b3b9a88f3b9 tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] [instance: 6175db54-93e8-4f85-9d45-c288cd5baee5] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:25.392644 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0acac430-fbf2-4852-9981-2b3b9a88f3b9 tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:25.393087 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0acac430-fbf2-4852-9981-2b3b9a88f3b9 tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:25.393833 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0acac430-fbf2-4852-9981-2b3b9a88f3b9 tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:25.394258 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0acac430-fbf2-4852-9981-2b3b9a88f3b9 tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:25.419271 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-0acac430-fbf2-4852-9981-2b3b9a88f3b9 tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] [instance: 6175db54-93e8-4f85-9d45-c288cd5baee5] Going to try to terminate instance {{(pid=117698) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 15:23:25.493660 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-0acac430-fbf2-4852-9981-2b3b9a88f3b9 tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] 10.222.0.45 "DELETE /compute/v2.1/servers/6175db54-93e8-4f85-9d45-c288cd5baee5" status: 204 len: 0 microversion: 2.1 time: 0.111422 May 24 15:23:25.494299 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 244/476] 10.222.0.45 () {58 vars in 1238 bytes} [Tue May 24 15:23:25 2022] DELETE /compute/v2.1/servers/6175db54-93e8-4f85-9d45-c288cd5baee5 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 15:23:25.502923 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-8017a956-cdd2-4fe5-987e-11e5ff664d30 tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:25.503616 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-8017a956-cdd2-4fe5-987e-11e5ff664d30 tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] [instance: 6175db54-93e8-4f85-9d45-c288cd5baee5] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:25.511603 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8017a956-cdd2-4fe5-987e-11e5ff664d30 tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:25.512051 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8017a956-cdd2-4fe5-987e-11e5ff664d30 tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:25.512893 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8017a956-cdd2-4fe5-987e-11e5ff664d30 tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:25.513327 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8017a956-cdd2-4fe5-987e-11e5ff664d30 tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:25.648742 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-8017a956-cdd2-4fe5-987e-11e5ff664d30 tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62db1d026f949eb82a425bc8dcd6377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c71a42e029754231b2e00938acc6b7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:25.656752 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-8017a956-cdd2-4fe5-987e-11e5ff664d30 tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] 10.222.0.45 "GET /compute/v2.1/servers/6175db54-93e8-4f85-9d45-c288cd5baee5" status: 200 len: 1469 microversion: 2.1 time: 0.157955 May 24 15:23:25.657323 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 233/477] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:25 2022] GET /compute/v2.1/servers/6175db54-93e8-4f85-9d45-c288cd5baee5 => generated 1469 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:23:25.848773 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-8e37ea09-8698-4729-a6c6-f92095853fa2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:25.849403 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-8e37ea09-8698-4729-a6c6-f92095853fa2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:25.855762 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8e37ea09-8698-4729-a6c6-f92095853fa2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:25.856212 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8e37ea09-8698-4729-a6c6-f92095853fa2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:25.857007 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8e37ea09-8698-4729-a6c6-f92095853fa2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:25.857438 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8e37ea09-8698-4729-a6c6-f92095853fa2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:26.002278 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-8e37ea09-8698-4729-a6c6-f92095853fa2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:26.010218 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-8e37ea09-8698-4729-a6c6-f92095853fa2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1756 microversion: 2.1 time: 0.165716 May 24 15:23:26.010786 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 245/478] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:25 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:23:26.673833 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-c1edc44d-7c03-49fe-86a5-c775a89b6faf tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:26.674459 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-c1edc44d-7c03-49fe-86a5-c775a89b6faf tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] [instance: 6175db54-93e8-4f85-9d45-c288cd5baee5] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:26.676402 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell0:SELECT=2 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:23:26.677258 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell0:SELECT=8 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:23:26.683938 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c1edc44d-7c03-49fe-86a5-c775a89b6faf tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:26.684401 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c1edc44d-7c03-49fe-86a5-c775a89b6faf tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:26.685155 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c1edc44d-7c03-49fe-86a5-c775a89b6faf tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:26.685581 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c1edc44d-7c03-49fe-86a5-c775a89b6faf tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:26.810756 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-c1edc44d-7c03-49fe-86a5-c775a89b6faf tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62db1d026f949eb82a425bc8dcd6377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c71a42e029754231b2e00938acc6b7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:26.818064 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-c1edc44d-7c03-49fe-86a5-c775a89b6faf tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] 10.222.0.45 "GET /compute/v2.1/servers/6175db54-93e8-4f85-9d45-c288cd5baee5" status: 200 len: 1469 microversion: 2.1 time: 0.148161 May 24 15:23:26.818624 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 234/479] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:26 2022] GET /compute/v2.1/servers/6175db54-93e8-4f85-9d45-c288cd5baee5 => generated 1469 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:23:27.026943 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-5cbc580d-6fcb-4d17-82e3-276e0f1a2a25 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:27.027478 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-5cbc580d-6fcb-4d17-82e3-276e0f1a2a25 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:27.034032 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5cbc580d-6fcb-4d17-82e3-276e0f1a2a25 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:27.034480 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5cbc580d-6fcb-4d17-82e3-276e0f1a2a25 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:27.035237 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5cbc580d-6fcb-4d17-82e3-276e0f1a2a25 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:27.035668 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5cbc580d-6fcb-4d17-82e3-276e0f1a2a25 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:27.175716 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-5cbc580d-6fcb-4d17-82e3-276e0f1a2a25 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:27.184656 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-5cbc580d-6fcb-4d17-82e3-276e0f1a2a25 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1756 microversion: 2.1 time: 0.161603 May 24 15:23:27.185223 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 246/480] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:27 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:23:27.832607 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [req-0e7a2e08-63dd-4d67-ad39-e9950e8e3140 req-3a9d62bd-f6df-4023-9860-c48ca71d6bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6175db54-93e8-4f85-9d45-c288cd5baee5", "name": "network-vif-deleted", "tag": "6ce7ce8b-cd1c-41d9-80b5-0772ff64f09c"}]} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:23:27.835375 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e15e5ef6-ebb4-42df-b7ce-e1ae3f34a1f0 tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:27.835985 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e15e5ef6-ebb4-42df-b7ce-e1ae3f34a1f0 tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] [instance: 6175db54-93e8-4f85-9d45-c288cd5baee5] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:27.842793 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e15e5ef6-ebb4-42df-b7ce-e1ae3f34a1f0 tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:27.844591 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e15e5ef6-ebb4-42df-b7ce-e1ae3f34a1f0 tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:27.844742 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-0e7a2e08-63dd-4d67-ad39-e9950e8e3140 req-3a9d62bd-f6df-4023-9860-c48ca71d6bb6 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:27.845130 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-0e7a2e08-63dd-4d67-ad39-e9950e8e3140 req-3a9d62bd-f6df-4023-9860-c48ca71d6bb6 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:27.845982 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e15e5ef6-ebb4-42df-b7ce-e1ae3f34a1f0 tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:27.846557 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e15e5ef6-ebb4-42df-b7ce-e1ae3f34a1f0 tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:27.858984 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.compute.server_external_events [req-0e7a2e08-63dd-4d67-ad39-e9950e8e3140 req-3a9d62bd-f6df-4023-9860-c48ca71d6bb6 service nova] Creating event network-vif-deleted:6ce7ce8b-cd1c-41d9-80b5-0772ff64f09c for instance 6175db54-93e8-4f85-9d45-c288cd5baee5 on hv-cinder-84315 May 24 15:23:27.864745 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [req-0e7a2e08-63dd-4d67-ad39-e9950e8e3140 req-3a9d62bd-f6df-4023-9860-c48ca71d6bb6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039148 May 24 15:23:27.866298 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 235/481] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:23:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:23:27.918835 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e15e5ef6-ebb4-42df-b7ce-e1ae3f34a1f0 tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62db1d026f949eb82a425bc8dcd6377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c71a42e029754231b2e00938acc6b7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:27.928506 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e15e5ef6-ebb4-42df-b7ce-e1ae3f34a1f0 tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] 10.222.0.45 "GET /compute/v2.1/servers/6175db54-93e8-4f85-9d45-c288cd5baee5" status: 200 len: 1427 microversion: 2.1 time: 0.096223 May 24 15:23:27.929529 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 247/482] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:27 2022] GET /compute/v2.1/servers/6175db54-93e8-4f85-9d45-c288cd5baee5 => generated 1427 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:23:28.201940 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-dfbc0afa-f187-424c-a8e6-a6be63ef0f86 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:28.202657 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-dfbc0afa-f187-424c-a8e6-a6be63ef0f86 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:28.208831 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dfbc0afa-f187-424c-a8e6-a6be63ef0f86 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:28.209271 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dfbc0afa-f187-424c-a8e6-a6be63ef0f86 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:28.210012 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dfbc0afa-f187-424c-a8e6-a6be63ef0f86 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:28.210439 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dfbc0afa-f187-424c-a8e6-a6be63ef0f86 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:28.350852 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-dfbc0afa-f187-424c-a8e6-a6be63ef0f86 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:28.359890 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-dfbc0afa-f187-424c-a8e6-a6be63ef0f86 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1756 microversion: 2.1 time: 0.162123 May 24 15:23:28.360470 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 236/483] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:28 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:23:28.945575 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-dbaa242f-9877-49f0-ba6b-5bc0141064c2 tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:28.946086 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-dbaa242f-9877-49f0-ba6b-5bc0141064c2 tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] [instance: 6175db54-93e8-4f85-9d45-c288cd5baee5] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:28.952637 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dbaa242f-9877-49f0-ba6b-5bc0141064c2 tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:28.953086 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dbaa242f-9877-49f0-ba6b-5bc0141064c2 tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:28.953878 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dbaa242f-9877-49f0-ba6b-5bc0141064c2 tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:28.954308 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dbaa242f-9877-49f0-ba6b-5bc0141064c2 tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:28.967999 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.wsgi [None req-dbaa242f-9877-49f0-ba6b-5bc0141064c2 tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] HTTP exception thrown: Instance 6175db54-93e8-4f85-9d45-c288cd5baee5 could not be found. May 24 15:23:28.969636 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-dbaa242f-9877-49f0-ba6b-5bc0141064c2 tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Request method failure captured: May 24 15:23:28.969636 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: request: GET /compute/v2.1/servers/6175db54-93e8-4f85-9d45-c288cd5baee5 HTTP/1.1 May 24 15:23:28.969636 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Accept: application/json May 24 15:23:28.969636 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Accept-Encoding: identity May 24 15:23:28.969636 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Connection: close May 24 15:23:28.969636 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Content-Length: 0 May 24 15:23:28.969636 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Content-Type: application/json May 24 15:23:28.969636 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Host: 10.222.0.45 May 24 15:23:28.969636 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Openstack-System-Scope: None May 24 15:23:28.969636 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: User-Agent: python-urllib3/1.26.9 May 24 15:23:28.969636 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Auth-Token: gAAAAABijPhhC8GCKvSMZaLEb8dZC4CYTObqRunj1K8LdyP1ijiFg7Y7q8iSuYt8OMlBuIv6GIBQLQ8gkFJ9GSv4i7CXBrSOHlPh165RFJecBOUQGI74mUDQdHSzKwzdYoL0GYppw_VKs_a6rNq2yDa17MGhf0FxgtEVLtD1z-2BlV5WXPLrgMg May 24 15:23:28.969636 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Domain-Id: None May 24 15:23:28.969636 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Domain-Name: None May 24 15:23:28.969636 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Identity-Status: Confirmed May 24 15:23:28.969636 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Is-Admin-Project: True May 24 15:23:28.969636 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Domain-Id: default May 24 15:23:28.969636 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Domain-Name: Default May 24 15:23:28.969636 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Id: c71a42e029754231b2e00938acc6b7f3 May 24 15:23:28.969636 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Name: tempest-VolumesNegativeTest-1497430661 May 24 15:23:28.969636 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Role: reader,member May 24 15:23:28.969636 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Roles: reader,member May 24 15:23:28.971168 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c71a42e029754231b2e00938acc6b7f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c71a42e029754231b2e00938acc6b7f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c71a42e029754231b2e00938acc6b7f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c71a42e029754231b2e00938acc6b7f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 24 15:23:28.971168 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Tenant: tempest-VolumesNegativeTest-1497430661 May 24 15:23:28.971168 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Tenant-Id: c71a42e029754231b2e00938acc6b7f3 May 24 15:23:28.971168 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Tenant-Name: tempest-VolumesNegativeTest-1497430661 May 24 15:23:28.971168 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User: tempest-VolumesNegativeTest-1497430661-project May 24 15:23:28.971168 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Domain-Id: default May 24 15:23:28.971168 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Domain-Name: Default May 24 15:23:28.971168 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Id: e62db1d026f949eb82a425bc8dcd6377 May 24 15:23:28.971168 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Name: tempest-VolumesNegativeTest-1497430661-project May 24 15:23:28.971168 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: method: > May 24 15:23:28.971168 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: exception: Instance 6175db54-93e8-4f85-9d45-c288cd5baee5 could not be found. May 24 15:23:28.971168 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: action_args: {'id': '6175db54-93e8-4f85-9d45-c288cd5baee5'} May 24 15:23:28.972053 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:23:28.972053 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:23:28.972053 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:23:28.972053 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:23:28.972053 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:23:28.972053 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:23:28.972053 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:23:28.972053 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:23:28.972053 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:23:28.972053 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:23:28.972053 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6175db54-93e8-4f85-9d45-c288cd5baee5 could not be found. May 24 15:23:28.972053 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:23:28.972053 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:23:28.972053 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:23:28.972053 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:23:28.972053 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:23:28.972053 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:23:28.972053 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:23:28.972053 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:23:28.972053 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:23:28.973597 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:23:28.973597 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 15:23:28.973597 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 15:23:28.973597 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:23:28.973597 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:23:28.973597 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:23:28.973597 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:23:28.973597 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6175db54-93e8-4f85-9d45-c288cd5baee5 could not be found. May 24 15:23:28.973597 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:23:28.973597 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:23:28.973597 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:23:28.973597 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:23:28.973597 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:23:28.973597 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:23:28.973597 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:23:28.973597 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:23:28.973597 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6175db54-93e8-4f85-9d45-c288cd5baee5 could not be found. May 24 15:23:28.973597 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:23:28.974858 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-dbaa242f-9877-49f0-ba6b-5bc0141064c2 tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] Returning 404 to user: Instance 6175db54-93e8-4f85-9d45-c288cd5baee5 could not be found. {{(pid=117698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:23:28.974858 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-dbaa242f-9877-49f0-ba6b-5bc0141064c2 tempest-VolumesNegativeTest-1497430661 tempest-VolumesNegativeTest-1497430661-project] 10.222.0.45 "GET /compute/v2.1/servers/6175db54-93e8-4f85-9d45-c288cd5baee5" status: 404 len: 111 microversion: 2.1 time: 0.029379 May 24 15:23:28.974858 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 248/484] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:28 2022] GET /compute/v2.1/servers/6175db54-93e8-4f85-9d45-c288cd5baee5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:23:29.375736 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-afd923b3-54be-464a-869a-68a2b42df2b9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:29.376376 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-afd923b3-54be-464a-869a-68a2b42df2b9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:29.386499 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-afd923b3-54be-464a-869a-68a2b42df2b9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:29.387358 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-afd923b3-54be-464a-869a-68a2b42df2b9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:29.387713 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-afd923b3-54be-464a-869a-68a2b42df2b9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:29.388147 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-afd923b3-54be-464a-869a-68a2b42df2b9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:29.535589 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-afd923b3-54be-464a-869a-68a2b42df2b9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:29.545230 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-afd923b3-54be-464a-869a-68a2b42df2b9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1756 microversion: 2.1 time: 0.173230 May 24 15:23:29.545824 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 237/485] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:29 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:23:30.562782 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-97273d20-549b-45aa-ac84-34ebe6848198 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:30.563520 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-97273d20-549b-45aa-ac84-34ebe6848198 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:30.571311 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-97273d20-549b-45aa-ac84-34ebe6848198 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:30.571725 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-97273d20-549b-45aa-ac84-34ebe6848198 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:30.572649 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-97273d20-549b-45aa-ac84-34ebe6848198 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:30.573082 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-97273d20-549b-45aa-ac84-34ebe6848198 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:30.722547 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-97273d20-549b-45aa-ac84-34ebe6848198 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:30.731366 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-97273d20-549b-45aa-ac84-34ebe6848198 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1756 microversion: 2.1 time: 0.173120 May 24 15:23:30.731918 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 249/486] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:30 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:23:31.748804 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-0fc52fa2-3345-490b-b703-2201952be8bb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:31.749400 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-0fc52fa2-3345-490b-b703-2201952be8bb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:31.751882 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:23:31.757959 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0fc52fa2-3345-490b-b703-2201952be8bb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:31.759025 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0fc52fa2-3345-490b-b703-2201952be8bb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:31.759914 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0fc52fa2-3345-490b-b703-2201952be8bb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:31.760484 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0fc52fa2-3345-490b-b703-2201952be8bb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:31.903344 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-0fc52fa2-3345-490b-b703-2201952be8bb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:31.911221 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-0fc52fa2-3345-490b-b703-2201952be8bb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1756 microversion: 2.1 time: 0.166761 May 24 15:23:31.911778 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 238/487] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:31 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:23:32.927931 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-4102c53d-1545-4f7a-81e8-9d6cfbe67cd2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:32.928563 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-4102c53d-1545-4f7a-81e8-9d6cfbe67cd2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:32.934941 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4102c53d-1545-4f7a-81e8-9d6cfbe67cd2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:32.935380 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4102c53d-1545-4f7a-81e8-9d6cfbe67cd2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:32.936132 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4102c53d-1545-4f7a-81e8-9d6cfbe67cd2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:32.936586 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4102c53d-1545-4f7a-81e8-9d6cfbe67cd2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:33.091173 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-4102c53d-1545-4f7a-81e8-9d6cfbe67cd2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:33.103906 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-4102c53d-1545-4f7a-81e8-9d6cfbe67cd2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1756 microversion: 2.1 time: 0.179653 May 24 15:23:33.104586 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 250/488] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:32 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:23:33.950179 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-72ad8a39-ba6f-4c8d-a708-2fe7233b880c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:23:33.951199 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-72ad8a39-ba6f-4c8d-a708-2fe7233b880c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:33.957548 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-72ad8a39-ba6f-4c8d-a708-2fe7233b880c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:33.957988 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-72ad8a39-ba6f-4c8d-a708-2fe7233b880c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:33.958754 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-72ad8a39-ba6f-4c8d-a708-2fe7233b880c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:33.959179 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-72ad8a39-ba6f-4c8d-a708-2fe7233b880c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:33.986108 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.objects.instance [None req-72ad8a39-ba6f-4c8d-a708-2fe7233b880c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lazy-loading 'flavor' on Instance uuid 3017990e-8735-4d85-a686-1eebb1484dd3 {{(pid=117699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 15:23:34.121609 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c34542de-768b-415b-9b38-459380306db0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:34.122855 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-c34542de-768b-415b-9b38-459380306db0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:34.130871 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c34542de-768b-415b-9b38-459380306db0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:34.131196 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c34542de-768b-415b-9b38-459380306db0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:34.132076 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c34542de-768b-415b-9b38-459380306db0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:34.132528 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c34542de-768b-415b-9b38-459380306db0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:34.157515 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-72ad8a39-ba6f-4c8d-a708-2fe7233b880c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "POST /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/action" status: 200 len: 32 microversion: 2.1 time: 0.211543 May 24 15:23:34.158761 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 239/489] 10.222.0.45 () {60 vars in 1277 bytes} [Tue May 24 15:23:33 2022] POST /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/action => generated 32 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 24 15:23:34.170070 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-cf2114b5-6fb2-44a9-897d-96927b7caf75 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:34.171187 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-cf2114b5-6fb2-44a9-897d-96927b7caf75 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:34.177902 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cf2114b5-6fb2-44a9-897d-96927b7caf75 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:34.178680 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cf2114b5-6fb2-44a9-897d-96927b7caf75 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:34.179834 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cf2114b5-6fb2-44a9-897d-96927b7caf75 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:34.180537 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cf2114b5-6fb2-44a9-897d-96927b7caf75 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:34.354545 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-c34542de-768b-415b-9b38-459380306db0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:34.364748 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-cf2114b5-6fb2-44a9-897d-96927b7caf75 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:34.366075 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-c34542de-768b-415b-9b38-459380306db0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1756 microversion: 2.1 time: 0.248505 May 24 15:23:34.375312 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-cf2114b5-6fb2-44a9-897d-96927b7caf75 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.211279 May 24 15:23:34.377206 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 240/490] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:34 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:23:34.387997 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 251/491] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:34 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1756 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:23:35.383148 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-67873e4a-530a-4d4d-aac3-a5b7cdb9b251 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:35.383777 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-67873e4a-530a-4d4d-aac3-a5b7cdb9b251 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:35.390402 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-67873e4a-530a-4d4d-aac3-a5b7cdb9b251 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:35.390855 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-67873e4a-530a-4d4d-aac3-a5b7cdb9b251 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:35.391588 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-67873e4a-530a-4d4d-aac3-a5b7cdb9b251 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:35.392012 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-67873e4a-530a-4d4d-aac3-a5b7cdb9b251 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:35.394025 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-895f1a6d-4e31-4f16-ba42-68dc855bbc2a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:35.394635 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-895f1a6d-4e31-4f16-ba42-68dc855bbc2a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:35.401526 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-895f1a6d-4e31-4f16-ba42-68dc855bbc2a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:35.401993 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-895f1a6d-4e31-4f16-ba42-68dc855bbc2a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:35.403111 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-895f1a6d-4e31-4f16-ba42-68dc855bbc2a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:35.403553 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-895f1a6d-4e31-4f16-ba42-68dc855bbc2a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:35.412414 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:23:35.532268 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-895f1a6d-4e31-4f16-ba42-68dc855bbc2a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:35.541161 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-895f1a6d-4e31-4f16-ba42-68dc855bbc2a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.150981 May 24 15:23:35.541792 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 252/492] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:35 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:23:35.541914 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-67873e4a-530a-4d4d-aac3-a5b7cdb9b251 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:35.550626 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-67873e4a-530a-4d4d-aac3-a5b7cdb9b251 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1756 microversion: 2.1 time: 0.171377 May 24 15:23:35.551186 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 241/493] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:35 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:23:36.033426 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-fe375a29-90bf-4d36-bf43-1148add8e648 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-24390721", "imageRef": "f921f75e-bbd1-4d99-ab1e-5cce2d895148", "flavorRef": "452", "networks": [{"uuid": "5ceb8d09-e3f6-42b6-a8d9-7ccaacafd9e2"}]}} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:23:36.083612 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.network.neutron [None req-fe375a29-90bf-4d36-bf43-1148add8e648 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] validate_networks() for [('5ceb8d09-e3f6-42b6-a8d9-7ccaacafd9e2', None, None, None, None, None)] {{(pid=117698) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 15:23:36.418259 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.virt.hardware [None req-fe375a29-90bf-4d36-bf43-1148add8e648 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Flavor limits 0:0:0 {{(pid=117698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 15:23:36.418826 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.virt.hardware [None req-fe375a29-90bf-4d36-bf43-1148add8e648 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Image limits 0:0:0 {{(pid=117698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 15:23:36.419134 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.virt.hardware [None req-fe375a29-90bf-4d36-bf43-1148add8e648 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Flavor pref 0:0:0 {{(pid=117698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 15:23:36.419534 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.virt.hardware [None req-fe375a29-90bf-4d36-bf43-1148add8e648 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Image pref 0:0:0 {{(pid=117698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 15:23:36.419969 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.virt.hardware [None req-fe375a29-90bf-4d36-bf43-1148add8e648 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 15:23:36.429334 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fe375a29-90bf-4d36-bf43-1148add8e648 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:36.429771 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fe375a29-90bf-4d36-bf43-1148add8e648 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:36.430548 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fe375a29-90bf-4d36-bf43-1148add8e648 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:36.430973 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fe375a29-90bf-4d36-bf43-1148add8e648 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:36.446955 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.quota [None req-fe375a29-90bf-4d36-bf43-1148add8e648 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Getting quotas for project 44674730e48240da874cc5fb9662455d. Resources: {'instances', 'ram', 'cores'} {{(pid=117698) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 15:23:36.450829 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.quota [None req-fe375a29-90bf-4d36-bf43-1148add8e648 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Getting quotas for user e754dd9099b54fa4ac8debfbc4a645b9 and project 44674730e48240da874cc5fb9662455d. Resources: {'instances', 'ram', 'cores'} {{(pid=117698) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 15:23:36.461619 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-fe375a29-90bf-4d36-bf43-1148add8e648 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Going to run 1 instances... {{(pid=117698) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 15:23:36.463743 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-fe375a29-90bf-4d36-bf43-1148add8e648 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f921f75e-bbd1-4d99-ab1e-5cce2d895148',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 15:23:36.509888 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-fe375a29-90bf-4d36-bf43-1148add8e648 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.480218 May 24 15:23:36.510521 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 253/494] 10.222.0.45 () {60 vars in 1146 bytes} [Tue May 24 15:23:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 481 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 15:23:36.520364 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-6026581a-be23-4a75-9e37-b671eb1a31e1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:36.521192 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-6026581a-be23-4a75-9e37-b671eb1a31e1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:36.559054 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-5881f510-3b3d-4f58-bb9c-63c4179bfa55 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:36.559654 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-5881f510-3b3d-4f58-bb9c-63c4179bfa55 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:36.566071 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5881f510-3b3d-4f58-bb9c-63c4179bfa55 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:36.566510 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5881f510-3b3d-4f58-bb9c-63c4179bfa55 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:36.567267 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5881f510-3b3d-4f58-bb9c-63c4179bfa55 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:36.567698 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5881f510-3b3d-4f58-bb9c-63c4179bfa55 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:36.579197 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-6026581a-be23-4a75-9e37-b671eb1a31e1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:36.586824 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-6026581a-be23-4a75-9e37-b671eb1a31e1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1217 microversion: 2.1 time: 0.070365 May 24 15:23:36.597364 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 242/495] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:36 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1217 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:23:36.597364 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-3ab329fe-db67-4327-846b-85286e1f1d6c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:36.597364 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-3ab329fe-db67-4327-846b-85286e1f1d6c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:36.601210 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3ab329fe-db67-4327-846b-85286e1f1d6c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:36.601795 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3ab329fe-db67-4327-846b-85286e1f1d6c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:36.602680 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3ab329fe-db67-4327-846b-85286e1f1d6c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:36.603186 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3ab329fe-db67-4327-846b-85286e1f1d6c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:36.710860 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-5881f510-3b3d-4f58-bb9c-63c4179bfa55 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:36.720148 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-5881f510-3b3d-4f58-bb9c-63c4179bfa55 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.164998 May 24 15:23:36.730695 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 254/496] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:36 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:23:36.760687 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-3ab329fe-db67-4327-846b-85286e1f1d6c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:36.769067 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-3ab329fe-db67-4327-846b-85286e1f1d6c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1756 microversion: 2.1 time: 0.180413 May 24 15:23:36.769629 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 243/497] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:36 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:23:37.607470 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-0d68e402-3892-4288-874a-41e4200e296b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:37.609695 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-0d68e402-3892-4288-874a-41e4200e296b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:37.616375 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0d68e402-3892-4288-874a-41e4200e296b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:37.616945 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0d68e402-3892-4288-874a-41e4200e296b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:37.617809 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0d68e402-3892-4288-874a-41e4200e296b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:37.618616 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0d68e402-3892-4288-874a-41e4200e296b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:37.696991 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-0d68e402-3892-4288-874a-41e4200e296b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:37.706368 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-0d68e402-3892-4288-874a-41e4200e296b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1277 microversion: 2.1 time: 0.106031 May 24 15:23:37.706944 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 255/498] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:37 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1277 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:23:37.738719 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-3c7a2123-4a07-4641-86ee-40d3ea3794db tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:37.739357 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-3c7a2123-4a07-4641-86ee-40d3ea3794db tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:37.746053 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3c7a2123-4a07-4641-86ee-40d3ea3794db tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:37.746491 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3c7a2123-4a07-4641-86ee-40d3ea3794db tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:37.747332 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3c7a2123-4a07-4641-86ee-40d3ea3794db tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:37.747761 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3c7a2123-4a07-4641-86ee-40d3ea3794db tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:37.786754 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-8a98838e-83cb-4439-978f-7925f0b6c3a5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:37.787587 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-8a98838e-83cb-4439-978f-7925f0b6c3a5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:37.794952 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8a98838e-83cb-4439-978f-7925f0b6c3a5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:37.795653 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8a98838e-83cb-4439-978f-7925f0b6c3a5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:37.796565 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8a98838e-83cb-4439-978f-7925f0b6c3a5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:37.797007 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8a98838e-83cb-4439-978f-7925f0b6c3a5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:37.880578 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-3c7a2123-4a07-4641-86ee-40d3ea3794db tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:37.894010 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-3c7a2123-4a07-4641-86ee-40d3ea3794db tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.154952 May 24 15:23:37.894010 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 244/499] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:37 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:23:38.022119 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-8a98838e-83cb-4439-978f-7925f0b6c3a5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:38.030107 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-8a98838e-83cb-4439-978f-7925f0b6c3a5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1756 microversion: 2.1 time: 0.247142 May 24 15:23:38.030670 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 256/500] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:37 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1756 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:23:38.723845 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-374b0cb5-ddc6-4467-95b5-9afbc5463390 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:38.724601 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-374b0cb5-ddc6-4467-95b5-9afbc5463390 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:38.730600 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-374b0cb5-ddc6-4467-95b5-9afbc5463390 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:38.731154 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-374b0cb5-ddc6-4467-95b5-9afbc5463390 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:38.732572 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-374b0cb5-ddc6-4467-95b5-9afbc5463390 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:38.733292 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-374b0cb5-ddc6-4467-95b5-9afbc5463390 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:38.867442 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-374b0cb5-ddc6-4467-95b5-9afbc5463390 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:38.875319 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-374b0cb5-ddc6-4467-95b5-9afbc5463390 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1317 microversion: 2.1 time: 0.155357 May 24 15:23:38.875897 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 245/501] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:38 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:23:38.909690 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d7773d42-6c2a-488f-bad3-0f709d112780 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:38.910377 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d7773d42-6c2a-488f-bad3-0f709d112780 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:38.917233 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d7773d42-6c2a-488f-bad3-0f709d112780 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:38.917685 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d7773d42-6c2a-488f-bad3-0f709d112780 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:38.918438 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d7773d42-6c2a-488f-bad3-0f709d112780 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:38.918864 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d7773d42-6c2a-488f-bad3-0f709d112780 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:39.046878 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-9b16683c-4284-47cd-a17b-d6635c81bb32 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:39.047780 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-9b16683c-4284-47cd-a17b-d6635c81bb32 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:39.053812 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9b16683c-4284-47cd-a17b-d6635c81bb32 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:39.054253 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9b16683c-4284-47cd-a17b-d6635c81bb32 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:39.055008 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9b16683c-4284-47cd-a17b-d6635c81bb32 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:39.055436 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9b16683c-4284-47cd-a17b-d6635c81bb32 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:39.119514 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-d7773d42-6c2a-488f-bad3-0f709d112780 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:39.132419 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d7773d42-6c2a-488f-bad3-0f709d112780 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.226553 May 24 15:23:39.133277 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 257/502] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:38 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:23:39.139223 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [req-fc5d4f96-2a0b-45f9-89df-4163733097e0 req-7cc44690-e099-4819-bdc6-fc7c43094a56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "916e547e-8501-44fe-8429-5f9086c85992", "tag": "47dec4a5-f4a8-4396-821c-6a9d55b5dde0"}]} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:23:39.149264 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-fc5d4f96-2a0b-45f9-89df-4163733097e0 req-7cc44690-e099-4819-bdc6-fc7c43094a56 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:39.149824 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-fc5d4f96-2a0b-45f9-89df-4163733097e0 req-7cc44690-e099-4819-bdc6-fc7c43094a56 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:39.154798 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:23:39.163732 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.compute.server_external_events [req-fc5d4f96-2a0b-45f9-89df-4163733097e0 req-7cc44690-e099-4819-bdc6-fc7c43094a56 service nova] Creating event network-changed:47dec4a5-f4a8-4396-821c-6a9d55b5dde0 for instance 916e547e-8501-44fe-8429-5f9086c85992 on hv-cinder-84315 May 24 15:23:39.169885 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [req-fc5d4f96-2a0b-45f9-89df-4163733097e0 req-7cc44690-e099-4819-bdc6-fc7c43094a56 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034874 May 24 15:23:39.170558 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 258/503] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:23:39.205738 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-9b16683c-4284-47cd-a17b-d6635c81bb32 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:39.214021 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-9b16683c-4284-47cd-a17b-d6635c81bb32 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1756 microversion: 2.1 time: 0.170965 May 24 15:23:39.214894 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 246/504] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:39 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:23:39.892942 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-3b420f4e-9630-43c5-a5ff-d1fd7e359985 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:39.893632 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-3b420f4e-9630-43c5-a5ff-d1fd7e359985 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:39.900620 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3b420f4e-9630-43c5-a5ff-d1fd7e359985 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:39.901064 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3b420f4e-9630-43c5-a5ff-d1fd7e359985 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:39.901811 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3b420f4e-9630-43c5-a5ff-d1fd7e359985 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:39.902240 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3b420f4e-9630-43c5-a5ff-d1fd7e359985 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:40.029128 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-3b420f4e-9630-43c5-a5ff-d1fd7e359985 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:40.036380 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-3b420f4e-9630-43c5-a5ff-d1fd7e359985 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1317 microversion: 2.1 time: 0.147553 May 24 15:23:40.036937 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 259/505] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:39 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:23:40.150225 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-27ec1422-24ab-40ec-9986-3ee91348e5b9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:40.150796 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-27ec1422-24ab-40ec-9986-3ee91348e5b9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:40.157773 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-27ec1422-24ab-40ec-9986-3ee91348e5b9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:40.158219 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-27ec1422-24ab-40ec-9986-3ee91348e5b9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:40.158964 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-27ec1422-24ab-40ec-9986-3ee91348e5b9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:40.159391 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-27ec1422-24ab-40ec-9986-3ee91348e5b9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:40.230810 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-12dde036-c19e-4c45-b1d1-ec8461017064 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:40.232082 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-12dde036-c19e-4c45-b1d1-ec8461017064 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:40.238534 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-12dde036-c19e-4c45-b1d1-ec8461017064 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:40.238696 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-12dde036-c19e-4c45-b1d1-ec8461017064 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:40.239450 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-12dde036-c19e-4c45-b1d1-ec8461017064 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:40.239879 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-12dde036-c19e-4c45-b1d1-ec8461017064 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:40.289467 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-27ec1422-24ab-40ec-9986-3ee91348e5b9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:40.298168 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-27ec1422-24ab-40ec-9986-3ee91348e5b9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.151798 May 24 15:23:40.298735 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 247/506] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:40 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:23:40.376292 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-12dde036-c19e-4c45-b1d1-ec8461017064 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:40.384239 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-12dde036-c19e-4c45-b1d1-ec8461017064 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1756 microversion: 2.1 time: 0.157218 May 24 15:23:40.385004 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 260/507] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:40 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1756 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:23:41.053614 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-484bd571-cfa2-499f-abcb-3bedd6603556 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:41.054220 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-484bd571-cfa2-499f-abcb-3bedd6603556 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:41.060916 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-484bd571-cfa2-499f-abcb-3bedd6603556 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:41.061358 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-484bd571-cfa2-499f-abcb-3bedd6603556 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:41.062114 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-484bd571-cfa2-499f-abcb-3bedd6603556 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:41.062542 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-484bd571-cfa2-499f-abcb-3bedd6603556 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:41.187088 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-484bd571-cfa2-499f-abcb-3bedd6603556 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:41.194504 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-484bd571-cfa2-499f-abcb-3bedd6603556 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1317 microversion: 2.1 time: 0.144771 May 24 15:23:41.195067 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 248/508] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:41 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1317 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:23:41.315709 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-0ac53b20-d13c-4aea-83d0-eb60c761a180 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:41.316228 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-0ac53b20-d13c-4aea-83d0-eb60c761a180 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:41.318656 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:23:41.324193 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0ac53b20-d13c-4aea-83d0-eb60c761a180 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:41.324724 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0ac53b20-d13c-4aea-83d0-eb60c761a180 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:41.325483 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0ac53b20-d13c-4aea-83d0-eb60c761a180 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:41.325915 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0ac53b20-d13c-4aea-83d0-eb60c761a180 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:41.401703 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a11520a6-21fc-43de-a806-3c965dc6a458 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:41.402693 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a11520a6-21fc-43de-a806-3c965dc6a458 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:41.409386 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a11520a6-21fc-43de-a806-3c965dc6a458 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:41.409838 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a11520a6-21fc-43de-a806-3c965dc6a458 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:41.410617 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a11520a6-21fc-43de-a806-3c965dc6a458 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:41.411052 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a11520a6-21fc-43de-a806-3c965dc6a458 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:41.496000 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-0ac53b20-d13c-4aea-83d0-eb60c761a180 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:41.504240 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-0ac53b20-d13c-4aea-83d0-eb60c761a180 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.192443 May 24 15:23:41.504826 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 261/509] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:41 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:23:41.564949 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-a11520a6-21fc-43de-a806-3c965dc6a458 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:41.572927 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a11520a6-21fc-43de-a806-3c965dc6a458 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1759 microversion: 2.1 time: 0.175086 May 24 15:23:41.573436 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 249/510] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:41 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1759 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:23:42.210910 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-6f1098b3-6dd0-4e1e-aca1-8a9e4118eb5c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:42.211422 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-6f1098b3-6dd0-4e1e-aca1-8a9e4118eb5c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:42.217965 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6f1098b3-6dd0-4e1e-aca1-8a9e4118eb5c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:42.218409 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6f1098b3-6dd0-4e1e-aca1-8a9e4118eb5c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:42.219164 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6f1098b3-6dd0-4e1e-aca1-8a9e4118eb5c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:42.219596 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6f1098b3-6dd0-4e1e-aca1-8a9e4118eb5c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:42.347560 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-6f1098b3-6dd0-4e1e-aca1-8a9e4118eb5c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:42.354853 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-6f1098b3-6dd0-4e1e-aca1-8a9e4118eb5c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1317 microversion: 2.1 time: 0.147880 May 24 15:23:42.355416 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 262/511] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:42 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:23:42.521549 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-614a80f8-3a32-43ee-ae68-b4ff5f36ee19 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:42.522160 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-614a80f8-3a32-43ee-ae68-b4ff5f36ee19 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:42.529310 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-614a80f8-3a32-43ee-ae68-b4ff5f36ee19 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:42.529783 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-614a80f8-3a32-43ee-ae68-b4ff5f36ee19 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:42.530541 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-614a80f8-3a32-43ee-ae68-b4ff5f36ee19 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:42.530973 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-614a80f8-3a32-43ee-ae68-b4ff5f36ee19 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:42.659726 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-614a80f8-3a32-43ee-ae68-b4ff5f36ee19 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:42.668113 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-614a80f8-3a32-43ee-ae68-b4ff5f36ee19 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.150385 May 24 15:23:42.669086 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 250/512] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:42 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:23:43.372427 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-283d7cc5-b08e-4b73-84c0-91db4200004d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:43.372959 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-283d7cc5-b08e-4b73-84c0-91db4200004d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:43.379678 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-283d7cc5-b08e-4b73-84c0-91db4200004d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:43.380120 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-283d7cc5-b08e-4b73-84c0-91db4200004d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:43.380902 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-283d7cc5-b08e-4b73-84c0-91db4200004d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:43.381360 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-283d7cc5-b08e-4b73-84c0-91db4200004d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:43.506681 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-283d7cc5-b08e-4b73-84c0-91db4200004d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:43.513965 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-283d7cc5-b08e-4b73-84c0-91db4200004d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1317 microversion: 2.1 time: 0.146086 May 24 15:23:43.514513 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 263/513] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:43 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1317 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:23:43.685762 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-787f85d0-032b-4488-9079-25f226c055eb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:43.686286 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-787f85d0-032b-4488-9079-25f226c055eb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:43.692715 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-787f85d0-032b-4488-9079-25f226c055eb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:43.693155 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-787f85d0-032b-4488-9079-25f226c055eb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:43.693904 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-787f85d0-032b-4488-9079-25f226c055eb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:43.694328 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-787f85d0-032b-4488-9079-25f226c055eb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:43.819966 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-787f85d0-032b-4488-9079-25f226c055eb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:43.827789 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-787f85d0-032b-4488-9079-25f226c055eb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.146504 May 24 15:23:43.828365 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 251/514] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:43 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:23:44.529973 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-9b01df50-b548-4218-8a89-750c0c849ed2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:44.530585 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-9b01df50-b548-4218-8a89-750c0c849ed2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:44.537032 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9b01df50-b548-4218-8a89-750c0c849ed2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:44.537473 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9b01df50-b548-4218-8a89-750c0c849ed2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:44.538224 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9b01df50-b548-4218-8a89-750c0c849ed2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:44.538655 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9b01df50-b548-4218-8a89-750c0c849ed2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:44.661936 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [req-6a22e454-67ee-4c14-ad4b-51f7920a4ebd req-e98aa6bf-9d49-4728-bdc0-c069b564ff66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "916e547e-8501-44fe-8429-5f9086c85992", "name": "network-vif-plugged", "status": "completed", "tag": "47dec4a5-f4a8-4396-821c-6a9d55b5dde0"}]} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:23:44.675333 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-9b01df50-b548-4218-8a89-750c0c849ed2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:44.678802 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-6a22e454-67ee-4c14-ad4b-51f7920a4ebd req-e98aa6bf-9d49-4728-bdc0-c069b564ff66 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:44.682959 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-9b01df50-b548-4218-8a89-750c0c849ed2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1317 microversion: 2.1 time: 0.156891 May 24 15:23:44.683430 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-6a22e454-67ee-4c14-ad4b-51f7920a4ebd req-e98aa6bf-9d49-4728-bdc0-c069b564ff66 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:44.688749 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 264/515] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:44 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:23:44.696722 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.compute.server_external_events [req-6a22e454-67ee-4c14-ad4b-51f7920a4ebd req-e98aa6bf-9d49-4728-bdc0-c069b564ff66 service nova] Creating event network-vif-plugged:47dec4a5-f4a8-4396-821c-6a9d55b5dde0 for instance 916e547e-8501-44fe-8429-5f9086c85992 on hv-cinder-84315 May 24 15:23:44.702437 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [req-6a22e454-67ee-4c14-ad4b-51f7920a4ebd req-e98aa6bf-9d49-4728-bdc0-c069b564ff66 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045123 May 24 15:23:44.703118 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 252/516] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:23:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:23:44.844848 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d4be19f5-365b-48e0-bf42-3f06ed0768c3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:44.845445 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d4be19f5-365b-48e0-bf42-3f06ed0768c3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:44.851331 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d4be19f5-365b-48e0-bf42-3f06ed0768c3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:44.851768 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d4be19f5-365b-48e0-bf42-3f06ed0768c3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:44.852538 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d4be19f5-365b-48e0-bf42-3f06ed0768c3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:44.852968 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d4be19f5-365b-48e0-bf42-3f06ed0768c3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:45.282330 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-d4be19f5-365b-48e0-bf42-3f06ed0768c3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:45.290185 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d4be19f5-365b-48e0-bf42-3f06ed0768c3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.449286 May 24 15:23:45.290742 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 265/517] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:44 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:23:45.706131 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-acbe4403-1bb6-43b1-a42b-838ed5950bdf tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:45.706820 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-acbe4403-1bb6-43b1-a42b-838ed5950bdf tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:45.712958 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-acbe4403-1bb6-43b1-a42b-838ed5950bdf tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:45.713392 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-acbe4403-1bb6-43b1-a42b-838ed5950bdf tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:45.714144 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-acbe4403-1bb6-43b1-a42b-838ed5950bdf tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:45.714571 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-acbe4403-1bb6-43b1-a42b-838ed5950bdf tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:45.845246 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-acbe4403-1bb6-43b1-a42b-838ed5950bdf tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:45.852512 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-acbe4403-1bb6-43b1-a42b-838ed5950bdf tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1317 microversion: 2.1 time: 0.151011 May 24 15:23:45.853067 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 253/518] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:45 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:23:46.306743 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-76541276-534c-4ddd-bdae-07c40daf823b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:46.307356 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-76541276-534c-4ddd-bdae-07c40daf823b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:46.314449 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-76541276-534c-4ddd-bdae-07c40daf823b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:46.314898 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-76541276-534c-4ddd-bdae-07c40daf823b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:46.315649 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-76541276-534c-4ddd-bdae-07c40daf823b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:46.316090 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-76541276-534c-4ddd-bdae-07c40daf823b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:46.438427 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell0:SELECT=2 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:23:46.443079 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-76541276-534c-4ddd-bdae-07c40daf823b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:46.451281 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-76541276-534c-4ddd-bdae-07c40daf823b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.148361 May 24 15:23:46.451850 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 266/519] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:46 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:23:46.868775 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-8fa0b849-f47b-434b-a6e5-290946f7470f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:46.869410 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-8fa0b849-f47b-434b-a6e5-290946f7470f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:46.871351 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell0:SELECT=2 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:23:46.877080 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8fa0b849-f47b-434b-a6e5-290946f7470f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:46.877530 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8fa0b849-f47b-434b-a6e5-290946f7470f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:46.878311 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8fa0b849-f47b-434b-a6e5-290946f7470f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:46.878700 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8fa0b849-f47b-434b-a6e5-290946f7470f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:47.005965 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-8fa0b849-f47b-434b-a6e5-290946f7470f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:47.013756 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-8fa0b849-f47b-434b-a6e5-290946f7470f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1317 microversion: 2.1 time: 0.148523 May 24 15:23:47.014756 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 254/520] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:46 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:23:47.467958 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-712688dd-62db-49ff-9ea7-e0dba1acd591 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:47.468598 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-712688dd-62db-49ff-9ea7-e0dba1acd591 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:47.470421 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell0:SELECT=6 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:23:47.476132 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-712688dd-62db-49ff-9ea7-e0dba1acd591 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:47.476602 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-712688dd-62db-49ff-9ea7-e0dba1acd591 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:47.477361 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-712688dd-62db-49ff-9ea7-e0dba1acd591 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:47.477823 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-712688dd-62db-49ff-9ea7-e0dba1acd591 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:47.610127 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-712688dd-62db-49ff-9ea7-e0dba1acd591 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:47.618092 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-712688dd-62db-49ff-9ea7-e0dba1acd591 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.154096 May 24 15:23:47.618693 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 267/521] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:47 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:23:48.030833 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-ba838f75-b5a1-45e2-9dbe-99d02dffd8c8 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:48.031435 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-ba838f75-b5a1-45e2-9dbe-99d02dffd8c8 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:48.037979 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ba838f75-b5a1-45e2-9dbe-99d02dffd8c8 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:48.038452 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ba838f75-b5a1-45e2-9dbe-99d02dffd8c8 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:48.039230 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ba838f75-b5a1-45e2-9dbe-99d02dffd8c8 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:48.039660 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ba838f75-b5a1-45e2-9dbe-99d02dffd8c8 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:48.168093 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-ba838f75-b5a1-45e2-9dbe-99d02dffd8c8 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:48.176017 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-ba838f75-b5a1-45e2-9dbe-99d02dffd8c8 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1507 microversion: 2.1 time: 0.149044 May 24 15:23:48.176620 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 255/522] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:48 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:23:48.635196 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-efe60bbd-2c61-4acf-8399-12374fc880c3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:48.636025 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-efe60bbd-2c61-4acf-8399-12374fc880c3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:48.643520 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-efe60bbd-2c61-4acf-8399-12374fc880c3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:48.643962 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-efe60bbd-2c61-4acf-8399-12374fc880c3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:48.644742 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-efe60bbd-2c61-4acf-8399-12374fc880c3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:48.645172 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-efe60bbd-2c61-4acf-8399-12374fc880c3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:48.770917 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-efe60bbd-2c61-4acf-8399-12374fc880c3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:48.779376 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-efe60bbd-2c61-4acf-8399-12374fc880c3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.148142 May 24 15:23:48.779954 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 268/523] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:48 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:23:49.797389 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-0c01bd41-d5e4-4f5c-8e38-e5d318ae390b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:49.797994 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-0c01bd41-d5e4-4f5c-8e38-e5d318ae390b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:49.804599 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0c01bd41-d5e4-4f5c-8e38-e5d318ae390b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:49.805049 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0c01bd41-d5e4-4f5c-8e38-e5d318ae390b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:49.805804 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0c01bd41-d5e4-4f5c-8e38-e5d318ae390b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:49.806241 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0c01bd41-d5e4-4f5c-8e38-e5d318ae390b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:49.936203 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-0c01bd41-d5e4-4f5c-8e38-e5d318ae390b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:49.944717 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-0c01bd41-d5e4-4f5c-8e38-e5d318ae390b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1715 microversion: 2.1 time: 0.151686 May 24 15:23:49.945300 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 256/524] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:49 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1715 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:23:50.047826 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-478db230-00a6-460d-90c7-811d8081a4c2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:50.048377 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-478db230-00a6-460d-90c7-811d8081a4c2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:50.054302 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-478db230-00a6-460d-90c7-811d8081a4c2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:50.054746 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-478db230-00a6-460d-90c7-811d8081a4c2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:50.055501 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-478db230-00a6-460d-90c7-811d8081a4c2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:50.055935 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-478db230-00a6-460d-90c7-811d8081a4c2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:50.183786 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.wsgi [None req-478db230-00a6-460d-90c7-811d8081a4c2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] HTTP exception thrown: Cannot 'detach_volume' instance 3017990e-8735-4d85-a686-1eebb1484dd3 while it is in vm_state rescued May 24 15:23:50.185641 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-478db230-00a6-460d-90c7-811d8081a4c2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Request method failure captured: May 24 15:23:50.185641 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: request: DELETE /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments/58202b9b-e8dd-4cc9-b7f8-d1b681e24558 HTTP/1.1 May 24 15:23:50.185641 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Accept: application/json May 24 15:23:50.185641 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Accept-Encoding: identity May 24 15:23:50.185641 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Connection: close May 24 15:23:50.185641 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Content-Length: 0 May 24 15:23:50.185641 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Content-Type: application/json May 24 15:23:50.185641 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Host: 10.222.0.45 May 24 15:23:50.185641 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Openstack-System-Scope: None May 24 15:23:50.185641 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: User-Agent: python-urllib3/1.26.9 May 24 15:23:50.185641 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Auth-Token: gAAAAABijPekO_FEqvEt__l4I8WEGx17L4yqtzpCAeEc3y4CnbJAHyL1DySC4YIlKQDTV1hsPFcvsVRhAbutvBRf9w65KzCkRaS-QYMp5wOBtVk4LwevMnKVJp-p3Ycug9G9UYw2xMBk2TmyRPXhISTuFKrt-_kc3sLkHf7ee14Z1I5hnTaBDlA May 24 15:23:50.185641 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Domain-Id: None May 24 15:23:50.185641 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Domain-Name: None May 24 15:23:50.185641 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Identity-Status: Confirmed May 24 15:23:50.185641 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Is-Admin-Project: True May 24 15:23:50.185641 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Domain-Id: default May 24 15:23:50.185641 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Domain-Name: Default May 24 15:23:50.185641 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Id: e8d86717f1954ab7a59cdef0cf13556c May 24 15:23:50.185641 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1254703915 May 24 15:23:50.185641 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Role: reader,member May 24 15:23:50.185641 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Roles: reader,member May 24 15:23:50.187178 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e8d86717f1954ab7a59cdef0cf13556c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e8d86717f1954ab7a59cdef0cf13556c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e8d86717f1954ab7a59cdef0cf13556c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e8d86717f1954ab7a59cdef0cf13556c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 24 15:23:50.187178 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1254703915 May 24 15:23:50.187178 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Tenant-Id: e8d86717f1954ab7a59cdef0cf13556c May 24 15:23:50.187178 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1254703915 May 24 15:23:50.187178 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User: tempest-ServerRescueNegativeTestJSON-1254703915-project May 24 15:23:50.187178 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Domain-Id: default May 24 15:23:50.187178 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Domain-Name: Default May 24 15:23:50.187178 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Id: 2d8a7414fd254ec981d35b417dc373cd May 24 15:23:50.187178 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1254703915-project May 24 15:23:50.187178 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: method: > May 24 15:23:50.187178 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: exception: Cannot 'detach_volume' instance 3017990e-8735-4d85-a686-1eebb1484dd3 while it is in vm_state rescued May 24 15:23:50.187969 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: action_args: {'server_id': '3017990e-8735-4d85-a686-1eebb1484dd3', 'id': '58202b9b-e8dd-4cc9-b7f8-d1b681e24558'} May 24 15:23:50.187969 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:23:50.187969 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:23:50.187969 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 24 15:23:50.187969 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 24 15:23:50.187969 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 24 15:23:50.187969 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 24 15:23:50.187969 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 24 15:23:50.187969 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 24 15:23:50.187969 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3017990e-8735-4d85-a686-1eebb1484dd3 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 24 15:23:50.187969 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:23:50.187969 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:23:50.187969 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:23:50.187969 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:23:50.187969 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:23:50.187969 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:23:50.187969 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:23:50.187969 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:23:50.187969 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:23:50.187969 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:23:50.189477 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 24 15:23:50.189477 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 24 15:23:50.189477 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 24 15:23:50.189477 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 24 15:23:50.189477 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 3017990e-8735-4d85-a686-1eebb1484dd3 while it is in vm_state rescued May 24 15:23:50.189477 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:23:50.189477 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:23:50.189477 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:23:50.189477 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:23:50.189477 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:23:50.189477 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:23:50.189477 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:23:50.189477 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:23:50.189477 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 3017990e-8735-4d85-a686-1eebb1484dd3 while it is in vm_state rescued May 24 15:23:50.189477 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:23:50.189477 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-478db230-00a6-460d-90c7-811d8081a4c2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Returning 409 to user: Cannot 'detach_volume' instance 3017990e-8735-4d85-a686-1eebb1484dd3 while it is in vm_state rescued {{(pid=117698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:23:50.190598 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-478db230-00a6-460d-90c7-811d8081a4c2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "DELETE /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments/58202b9b-e8dd-4cc9-b7f8-d1b681e24558" status: 409 len: 152 microversion: 2.1 time: 0.143969 May 24 15:23:50.190598 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 269/525] 10.222.0.45 () {58 vars in 1415 bytes} [Tue May 24 15:23:50 2022] DELETE /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments/58202b9b-e8dd-4cc9-b7f8-d1b681e24558 => generated 152 bytes in 145 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 24 15:23:50.195882 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-572523dd-1052-4f74-aef8-6a16c4b73ec6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:23:50.196453 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-572523dd-1052-4f74-aef8-6a16c4b73ec6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:50.202929 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-572523dd-1052-4f74-aef8-6a16c4b73ec6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:50.203374 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-572523dd-1052-4f74-aef8-6a16c4b73ec6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:50.204136 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-572523dd-1052-4f74-aef8-6a16c4b73ec6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:50.204606 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-572523dd-1052-4f74-aef8-6a16c4b73ec6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:50.269345 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-572523dd-1052-4f74-aef8-6a16c4b73ec6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "POST /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/action" status: 202 len: 0 microversion: 2.1 time: 0.077081 May 24 15:23:50.270026 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 257/526] 10.222.0.45 () {60 vars in 1277 bytes} [Tue May 24 15:23:50 2022] POST /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 15:23:50.278808 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-47f10a8e-81a2-4b30-b9b9-732732e0e985 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:50.279425 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-47f10a8e-81a2-4b30-b9b9-732732e0e985 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:50.286909 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-47f10a8e-81a2-4b30-b9b9-732732e0e985 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:50.287371 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-47f10a8e-81a2-4b30-b9b9-732732e0e985 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:50.288164 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-47f10a8e-81a2-4b30-b9b9-732732e0e985 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:50.288660 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-47f10a8e-81a2-4b30-b9b9-732732e0e985 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:50.513080 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-47f10a8e-81a2-4b30-b9b9-732732e0e985 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:50.521018 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-47f10a8e-81a2-4b30-b9b9-732732e0e985 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1723 microversion: 2.1 time: 0.246706 May 24 15:23:50.521579 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 270/527] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:50 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1723 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:23:51.539444 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-c76fe7b5-2e96-4485-a047-ac001f8bb387 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:51.540144 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-c76fe7b5-2e96-4485-a047-ac001f8bb387 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:51.547068 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c76fe7b5-2e96-4485-a047-ac001f8bb387 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:51.547516 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c76fe7b5-2e96-4485-a047-ac001f8bb387 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:51.548281 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c76fe7b5-2e96-4485-a047-ac001f8bb387 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:51.548745 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c76fe7b5-2e96-4485-a047-ac001f8bb387 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:51.681242 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-c76fe7b5-2e96-4485-a047-ac001f8bb387 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:51.684943 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:23:51.690425 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-c76fe7b5-2e96-4485-a047-ac001f8bb387 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1723 microversion: 2.1 time: 0.155736 May 24 15:23:51.690997 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 258/528] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:51 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:23:52.708105 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-5049e0ad-d571-4bb4-bf0f-0ea766524b90 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:52.708732 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-5049e0ad-d571-4bb4-bf0f-0ea766524b90 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:52.715711 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5049e0ad-d571-4bb4-bf0f-0ea766524b90 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:52.716154 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5049e0ad-d571-4bb4-bf0f-0ea766524b90 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:52.716930 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5049e0ad-d571-4bb4-bf0f-0ea766524b90 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:52.717384 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5049e0ad-d571-4bb4-bf0f-0ea766524b90 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:52.846902 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-5049e0ad-d571-4bb4-bf0f-0ea766524b90 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:52.855013 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-5049e0ad-d571-4bb4-bf0f-0ea766524b90 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1723 microversion: 2.1 time: 0.150662 May 24 15:23:52.855598 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 271/529] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:52 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:23:53.873770 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-5f9b69ce-ea19-4ed7-81df-4bfb2c7c92ea tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:53.874378 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-5f9b69ce-ea19-4ed7-81df-4bfb2c7c92ea tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:53.883849 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5f9b69ce-ea19-4ed7-81df-4bfb2c7c92ea tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:53.884367 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5f9b69ce-ea19-4ed7-81df-4bfb2c7c92ea tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:53.885165 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5f9b69ce-ea19-4ed7-81df-4bfb2c7c92ea tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:53.885605 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5f9b69ce-ea19-4ed7-81df-4bfb2c7c92ea tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:54.033131 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-5f9b69ce-ea19-4ed7-81df-4bfb2c7c92ea tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:54.041454 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-5f9b69ce-ea19-4ed7-81df-4bfb2c7c92ea tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1729 microversion: 2.1 time: 0.172279 May 24 15:23:54.042247 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 259/530] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:53 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:23:54.058343 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-80267359-ad21-4e08-b517-66c9a7233476 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:54.059461 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-80267359-ad21-4e08-b517-66c9a7233476 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:54.066045 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-80267359-ad21-4e08-b517-66c9a7233476 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:54.066487 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-80267359-ad21-4e08-b517-66c9a7233476 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:54.067245 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-80267359-ad21-4e08-b517-66c9a7233476 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:54.067677 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-80267359-ad21-4e08-b517-66c9a7233476 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:54.143986 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-80267359-ad21-4e08-b517-66c9a7233476 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089448 May 24 15:23:54.144735 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 272/531] 10.222.0.45 () {58 vars in 1274 bytes} [Tue May 24 15:23:54 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:23:55.039917 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [req-45cfddbe-362e-4334-8d65-82a88687417a req-0b31b7b8-6aa2-47b4-a325-9bf1af8014af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3017990e-8735-4d85-a686-1eebb1484dd3", "tag": "ca6cef6e-61fd-4449-934f-86f49e0487c0"}]} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:23:55.049686 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-45cfddbe-362e-4334-8d65-82a88687417a req-0b31b7b8-6aa2-47b4-a325-9bf1af8014af service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:55.051182 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-45cfddbe-362e-4334-8d65-82a88687417a req-0b31b7b8-6aa2-47b4-a325-9bf1af8014af service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:55.065487 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.compute.server_external_events [req-45cfddbe-362e-4334-8d65-82a88687417a req-0b31b7b8-6aa2-47b4-a325-9bf1af8014af service nova] Creating event network-changed:ca6cef6e-61fd-4449-934f-86f49e0487c0 for instance 3017990e-8735-4d85-a686-1eebb1484dd3 on hv-cinder-84315 May 24 15:23:55.070724 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [req-45cfddbe-362e-4334-8d65-82a88687417a req-0b31b7b8-6aa2-47b4-a325-9bf1af8014af service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034471 May 24 15:23:55.072273 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 260/532] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:23:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:23:55.104291 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-9ae3875f-d5ed-435e-bf23-4280e0527b54 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:55.104867 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-9ae3875f-d5ed-435e-bf23-4280e0527b54 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:55.112653 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9ae3875f-d5ed-435e-bf23-4280e0527b54 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:55.113099 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9ae3875f-d5ed-435e-bf23-4280e0527b54 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:55.113869 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9ae3875f-d5ed-435e-bf23-4280e0527b54 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:55.114304 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9ae3875f-d5ed-435e-bf23-4280e0527b54 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:55.203593 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.objects.instance [None req-9ae3875f-d5ed-435e-bf23-4280e0527b54 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lazy-loading 'services' on Instance uuid 4aeb46b7-2550-490d-b4a1-f393d14133fa {{(pid=117698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 15:23:55.328624 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-9ae3875f-d5ed-435e-bf23-4280e0527b54 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "DELETE /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa/os-volume_attachments/3feff41f-366d-45da-a249-196342605aca" status: 202 len: 0 microversion: 2.1 time: 0.228543 May 24 15:23:55.329516 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 273/533] 10.222.0.45 () {58 vars in 1415 bytes} [Tue May 24 15:23:55 2022] DELETE /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa/os-volume_attachments/3feff41f-366d-45da-a249-196342605aca => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 15:23:56.461134 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e4b6721f-efdd-4f42-a256-fa155eaa6785 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:23:56.467952 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e4b6721f-efdd-4f42-a256-fa155eaa6785 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:56.468433 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e4b6721f-efdd-4f42-a256-fa155eaa6785 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:56.496485 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-e4b6721f-efdd-4f42-a256-fa155eaa6785 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Going to try to stop instance {{(pid=117699) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 24 15:23:56.544199 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-e4b6721f-efdd-4f42-a256-fa155eaa6785 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "POST /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa/action" status: 202 len: 0 microversion: 2.1 time: 0.086997 May 24 15:23:56.545186 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 261/534] 10.222.0.45 () {60 vars in 1277 bytes} [Tue May 24 15:23:56 2022] POST /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 15:23:56.553885 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-ee9054e9-0d77-44e3-80ad-9701423269ba tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:56.554587 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-ee9054e9-0d77-44e3-80ad-9701423269ba tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:56.561495 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ee9054e9-0d77-44e3-80ad-9701423269ba tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:56.561946 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ee9054e9-0d77-44e3-80ad-9701423269ba tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:56.562717 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ee9054e9-0d77-44e3-80ad-9701423269ba tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:56.563146 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ee9054e9-0d77-44e3-80ad-9701423269ba tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:56.694855 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ee9054e9-0d77-44e3-80ad-9701423269ba tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:56.702583 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-ee9054e9-0d77-44e3-80ad-9701423269ba tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1678 microversion: 2.1 time: 0.152855 May 24 15:23:56.703152 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 274/535] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:56 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:23:57.086627 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [req-b6f3a106-ef90-4b8d-bda3-1b196b629026 req-fa87900d-80b2-46c4-a032-47caaccb4ba0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3017990e-8735-4d85-a686-1eebb1484dd3", "tag": "ca6cef6e-61fd-4449-934f-86f49e0487c0"}]} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:23:57.095662 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-b6f3a106-ef90-4b8d-bda3-1b196b629026 req-fa87900d-80b2-46c4-a032-47caaccb4ba0 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:57.096098 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-b6f3a106-ef90-4b8d-bda3-1b196b629026 req-fa87900d-80b2-46c4-a032-47caaccb4ba0 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:57.106793 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.compute.server_external_events [req-b6f3a106-ef90-4b8d-bda3-1b196b629026 req-fa87900d-80b2-46c4-a032-47caaccb4ba0 service nova] Creating event network-changed:ca6cef6e-61fd-4449-934f-86f49e0487c0 for instance 3017990e-8735-4d85-a686-1eebb1484dd3 on hv-cinder-84315 May 24 15:23:57.111836 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [req-b6f3a106-ef90-4b8d-bda3-1b196b629026 req-fa87900d-80b2-46c4-a032-47caaccb4ba0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029415 May 24 15:23:57.112420 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 262/536] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:23:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:23:57.718867 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-bd7a188b-121b-41ef-892f-09cddfa145a9 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:57.719496 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-bd7a188b-121b-41ef-892f-09cddfa145a9 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:57.726223 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bd7a188b-121b-41ef-892f-09cddfa145a9 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:57.726676 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bd7a188b-121b-41ef-892f-09cddfa145a9 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:57.727459 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bd7a188b-121b-41ef-892f-09cddfa145a9 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:57.727897 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bd7a188b-121b-41ef-892f-09cddfa145a9 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:57.731490 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:23:57.864654 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-bd7a188b-121b-41ef-892f-09cddfa145a9 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:57.872977 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-bd7a188b-121b-41ef-892f-09cddfa145a9 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1678 microversion: 2.1 time: 0.157936 May 24 15:23:57.873551 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 275/537] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:57 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:23:58.892489 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f8514919-50a3-4fe7-b743-e69a5fc637f2 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:23:58.893175 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f8514919-50a3-4fe7-b743-e69a5fc637f2 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:23:58.899325 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f8514919-50a3-4fe7-b743-e69a5fc637f2 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:58.899758 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f8514919-50a3-4fe7-b743-e69a5fc637f2 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:58.900535 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f8514919-50a3-4fe7-b743-e69a5fc637f2 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:23:58.900963 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f8514919-50a3-4fe7-b743-e69a5fc637f2 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:23:59.032922 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-f8514919-50a3-4fe7-b743-e69a5fc637f2 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:23:59.042310 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f8514919-50a3-4fe7-b743-e69a5fc637f2 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1678 microversion: 2.1 time: 0.154981 May 24 15:23:59.042903 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 263/538] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:23:58 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:24:00.059458 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-70f817e4-b9a4-40cb-85ea-fe0ef462add7 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:00.060070 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-70f817e4-b9a4-40cb-85ea-fe0ef462add7 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:00.066543 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-70f817e4-b9a4-40cb-85ea-fe0ef462add7 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:00.066994 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-70f817e4-b9a4-40cb-85ea-fe0ef462add7 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:00.067787 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-70f817e4-b9a4-40cb-85ea-fe0ef462add7 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:00.068217 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-70f817e4-b9a4-40cb-85ea-fe0ef462add7 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:00.199430 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-70f817e4-b9a4-40cb-85ea-fe0ef462add7 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:24:00.207465 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-70f817e4-b9a4-40cb-85ea-fe0ef462add7 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1678 microversion: 2.1 time: 0.151829 May 24 15:24:00.208021 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 276/539] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:24:00 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:24:01.224267 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-8d65b97a-ce0d-49ba-baac-de3ad1d583bf tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:01.224896 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-8d65b97a-ce0d-49ba-baac-de3ad1d583bf tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:01.231525 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8d65b97a-ce0d-49ba-baac-de3ad1d583bf tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:01.232600 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8d65b97a-ce0d-49ba-baac-de3ad1d583bf tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:01.233607 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8d65b97a-ce0d-49ba-baac-de3ad1d583bf tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:01.234117 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8d65b97a-ce0d-49ba-baac-de3ad1d583bf tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:01.359384 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-8d65b97a-ce0d-49ba-baac-de3ad1d583bf tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:24:01.366777 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-8d65b97a-ce0d-49ba-baac-de3ad1d583bf tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1678 microversion: 2.1 time: 0.146294 May 24 15:24:01.367339 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 264/540] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:24:01 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1678 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:24:02.383000 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-22a1b76d-42cc-4134-8287-7b9a05af174c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:02.383631 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-22a1b76d-42cc-4134-8287-7b9a05af174c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:02.391117 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-22a1b76d-42cc-4134-8287-7b9a05af174c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:02.391567 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-22a1b76d-42cc-4134-8287-7b9a05af174c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:02.392357 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-22a1b76d-42cc-4134-8287-7b9a05af174c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:02.392798 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-22a1b76d-42cc-4134-8287-7b9a05af174c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:02.523134 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-22a1b76d-42cc-4134-8287-7b9a05af174c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:24:02.531079 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-22a1b76d-42cc-4134-8287-7b9a05af174c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1678 microversion: 2.1 time: 0.151847 May 24 15:24:02.531915 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 277/541] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:24:02 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:24:03.548340 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a316d2c0-9e24-4778-b7fe-2bb5d17f8fa2 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:03.548950 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a316d2c0-9e24-4778-b7fe-2bb5d17f8fa2 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:03.551370 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_api:SELECT=56 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:24:03.556658 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a316d2c0-9e24-4778-b7fe-2bb5d17f8fa2 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:03.557105 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a316d2c0-9e24-4778-b7fe-2bb5d17f8fa2 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:03.557868 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a316d2c0-9e24-4778-b7fe-2bb5d17f8fa2 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:03.558301 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a316d2c0-9e24-4778-b7fe-2bb5d17f8fa2 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:03.681056 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-a316d2c0-9e24-4778-b7fe-2bb5d17f8fa2 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:24:03.688419 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a316d2c0-9e24-4778-b7fe-2bb5d17f8fa2 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1678 microversion: 2.1 time: 0.143962 May 24 15:24:03.688983 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 265/542] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:24:03 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1678 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:24:04.705117 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-9a802a99-f10d-4cd8-983a-9f51cbe894b6 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:04.705722 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-9a802a99-f10d-4cd8-983a-9f51cbe894b6 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:04.712218 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9a802a99-f10d-4cd8-983a-9f51cbe894b6 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:04.712696 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9a802a99-f10d-4cd8-983a-9f51cbe894b6 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:04.713446 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9a802a99-f10d-4cd8-983a-9f51cbe894b6 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:04.713874 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9a802a99-f10d-4cd8-983a-9f51cbe894b6 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:04.926832 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-9a802a99-f10d-4cd8-983a-9f51cbe894b6 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:24:04.934174 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-9a802a99-f10d-4cd8-983a-9f51cbe894b6 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1678 microversion: 2.1 time: 0.233030 May 24 15:24:04.934736 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 278/543] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:24:04 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1678 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:24:05.380631 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-68a5ed72-aa96-4e08-96e8-3b92b54f700e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "452abb5b-7074-4881-9fb9-b55772c9799b", "device": "/dev/sdb"}} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:24:05.382250 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-68a5ed72-aa96-4e08-96e8-3b92b54f700e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:05.389469 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-68a5ed72-aa96-4e08-96e8-3b92b54f700e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:05.389914 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-68a5ed72-aa96-4e08-96e8-3b92b54f700e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:05.390676 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-68a5ed72-aa96-4e08-96e8-3b92b54f700e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:05.391110 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-68a5ed72-aa96-4e08-96e8-3b92b54f700e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:05.644493 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-68a5ed72-aa96-4e08-96e8-3b92b54f700e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "POST /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.267372 May 24 15:24:05.645113 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 266/544] 10.222.0.45 () {60 vars in 1322 bytes} [Tue May 24 15:24:05 2022] POST /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:24:05.950500 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-5f7c4702-ac5c-4048-b9c2-64c0c9dcbc24 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:05.951056 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-5f7c4702-ac5c-4048-b9c2-64c0c9dcbc24 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:05.957734 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5f7c4702-ac5c-4048-b9c2-64c0c9dcbc24 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:05.958182 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5f7c4702-ac5c-4048-b9c2-64c0c9dcbc24 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:05.958941 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5f7c4702-ac5c-4048-b9c2-64c0c9dcbc24 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:05.959374 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5f7c4702-ac5c-4048-b9c2-64c0c9dcbc24 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:06.089224 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-5f7c4702-ac5c-4048-b9c2-64c0c9dcbc24 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:24:06.096640 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-5f7c4702-ac5c-4048-b9c2-64c0c9dcbc24 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1678 microversion: 2.1 time: 0.150010 May 24 15:24:06.097199 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 279/545] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:24:05 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:24:06.279757 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-55ddb9de-dbb7-4ab6-aa02-026cc3ed6887 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:06.280614 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-55ddb9de-dbb7-4ab6-aa02-026cc3ed6887 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:06.287293 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-55ddb9de-dbb7-4ab6-aa02-026cc3ed6887 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:06.287732 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-55ddb9de-dbb7-4ab6-aa02-026cc3ed6887 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:06.288515 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-55ddb9de-dbb7-4ab6-aa02-026cc3ed6887 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:06.288944 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-55ddb9de-dbb7-4ab6-aa02-026cc3ed6887 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:06.321510 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-55ddb9de-dbb7-4ab6-aa02-026cc3ed6887 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments/af4eab8c-4b6b-4224-b721-4b35deb155bd" status: 200 len: 194 microversion: 2.20 time: 0.047707 May 24 15:24:06.322069 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 267/546] 10.222.0.45 () {60 vars in 1453 bytes} [Tue May 24 15:24:06 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments/af4eab8c-4b6b-4224-b721-4b35deb155bd => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:24:06.383244 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d0228578-6243-4fed-a4b2-58f27db26cc7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:06.383736 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d0228578-6243-4fed-a4b2-58f27db26cc7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:06.389896 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d0228578-6243-4fed-a4b2-58f27db26cc7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:06.390344 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d0228578-6243-4fed-a4b2-58f27db26cc7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:06.391103 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d0228578-6243-4fed-a4b2-58f27db26cc7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:06.391562 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d0228578-6243-4fed-a4b2-58f27db26cc7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:06.472713 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.objects.instance [None req-d0228578-6243-4fed-a4b2-58f27db26cc7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lazy-loading 'services' on Instance uuid 6c54fc3c-070c-4cab-b181-081d80eeb078 {{(pid=117698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 15:24:06.542964 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d0228578-6243-4fed-a4b2-58f27db26cc7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "DELETE /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments/af4eab8c-4b6b-4224-b721-4b35deb155bd" status: 202 len: 0 microversion: 2.20 time: 0.163365 May 24 15:24:06.543499 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 280/547] 10.222.0.45 () {60 vars in 1456 bytes} [Tue May 24 15:24:06 2022] DELETE /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments/af4eab8c-4b6b-4224-b721-4b35deb155bd => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 24 15:24:06.552737 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f3b0fe25-8eaf-4dd1-9f7d-d47ba32fc73d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:06.553785 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f3b0fe25-8eaf-4dd1-9f7d-d47ba32fc73d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:06.560239 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f3b0fe25-8eaf-4dd1-9f7d-d47ba32fc73d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:06.560751 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f3b0fe25-8eaf-4dd1-9f7d-d47ba32fc73d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:06.561651 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f3b0fe25-8eaf-4dd1-9f7d-d47ba32fc73d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:06.562213 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f3b0fe25-8eaf-4dd1-9f7d-d47ba32fc73d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:06.594831 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f3b0fe25-8eaf-4dd1-9f7d-d47ba32fc73d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046870 May 24 15:24:06.595388 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 268/548] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:24:06 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:24:07.114924 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-3a5475bd-65bd-4957-b7fa-12b764c7f64e tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:07.115537 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-3a5475bd-65bd-4957-b7fa-12b764c7f64e tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:07.121645 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3a5475bd-65bd-4957-b7fa-12b764c7f64e tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:07.122607 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3a5475bd-65bd-4957-b7fa-12b764c7f64e tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:07.123351 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3a5475bd-65bd-4957-b7fa-12b764c7f64e tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:07.123778 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3a5475bd-65bd-4957-b7fa-12b764c7f64e tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:07.252764 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-3a5475bd-65bd-4957-b7fa-12b764c7f64e tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:24:07.260162 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-3a5475bd-65bd-4957-b7fa-12b764c7f64e tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1655 microversion: 2.1 time: 0.150005 May 24 15:24:07.261069 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 281/549] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:24:07 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1655 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:24:07.276853 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f6619135-b178-4c5f-8e3e-50c77f745cb9 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:24:07.283346 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f6619135-b178-4c5f-8e3e-50c77f745cb9 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:07.283789 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f6619135-b178-4c5f-8e3e-50c77f745cb9 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:07.305823 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f6619135-b178-4c5f-8e3e-50c77f745cb9 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Going to try to start instance {{(pid=117699) start /opt/stack/nova/nova/compute/api.py:2730}} May 24 15:24:07.346179 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f6619135-b178-4c5f-8e3e-50c77f745cb9 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "POST /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa/action" status: 202 len: 0 microversion: 2.1 time: 0.072959 May 24 15:24:07.346731 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 269/550] 10.222.0.45 () {60 vars in 1277 bytes} [Tue May 24 15:24:07 2022] POST /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 15:24:07.354709 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c7fda325-e54d-4eab-8a4e-98186254bac4 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:07.355321 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-c7fda325-e54d-4eab-8a4e-98186254bac4 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:07.362103 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c7fda325-e54d-4eab-8a4e-98186254bac4 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:07.362586 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c7fda325-e54d-4eab-8a4e-98186254bac4 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:07.363431 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c7fda325-e54d-4eab-8a4e-98186254bac4 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:07.363933 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c7fda325-e54d-4eab-8a4e-98186254bac4 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:07.500967 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-c7fda325-e54d-4eab-8a4e-98186254bac4 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:24:07.508463 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-c7fda325-e54d-4eab-8a4e-98186254bac4 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1664 microversion: 2.1 time: 0.157558 May 24 15:24:07.509031 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 282/551] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:24:07 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1664 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:24:07.607333 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-fab54180-995d-464c-96b3-19e830628e1e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:07.608626 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-fab54180-995d-464c-96b3-19e830628e1e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:07.615008 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fab54180-995d-464c-96b3-19e830628e1e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:07.615452 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fab54180-995d-464c-96b3-19e830628e1e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:07.616210 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fab54180-995d-464c-96b3-19e830628e1e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:07.616661 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fab54180-995d-464c-96b3-19e830628e1e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:07.645820 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-fab54180-995d-464c-96b3-19e830628e1e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043267 May 24 15:24:07.646377 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 270/552] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:24:07 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:24:08.525707 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-7cc6d378-8e41-4d1a-a298-09827b41dcca tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:08.526316 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-7cc6d378-8e41-4d1a-a298-09827b41dcca tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:08.533324 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7cc6d378-8e41-4d1a-a298-09827b41dcca tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:08.533765 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7cc6d378-8e41-4d1a-a298-09827b41dcca tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:08.534510 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7cc6d378-8e41-4d1a-a298-09827b41dcca tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:08.534940 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7cc6d378-8e41-4d1a-a298-09827b41dcca tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:08.658031 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-5cd4f792-3249-4209-a32e-4a5c23847993 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:08.659240 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-5cd4f792-3249-4209-a32e-4a5c23847993 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:08.663074 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-7cc6d378-8e41-4d1a-a298-09827b41dcca tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:24:08.665546 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5cd4f792-3249-4209-a32e-4a5c23847993 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:08.665996 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5cd4f792-3249-4209-a32e-4a5c23847993 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:08.666767 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5cd4f792-3249-4209-a32e-4a5c23847993 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:08.667199 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5cd4f792-3249-4209-a32e-4a5c23847993 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:08.671092 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-7cc6d378-8e41-4d1a-a298-09827b41dcca tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1664 microversion: 2.1 time: 0.149154 May 24 15:24:08.671666 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 283/553] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:24:08 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1664 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:24:08.712754 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-5cd4f792-3249-4209-a32e-4a5c23847993 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059158 May 24 15:24:08.713319 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 271/554] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:24:08 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 15:24:09.688104 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-3a5f204a-c347-4890-92df-9e295b829e2c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:09.688734 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-3a5f204a-c347-4890-92df-9e295b829e2c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:09.696041 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3a5f204a-c347-4890-92df-9e295b829e2c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:09.696546 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3a5f204a-c347-4890-92df-9e295b829e2c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:09.697301 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3a5f204a-c347-4890-92df-9e295b829e2c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:09.697736 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3a5f204a-c347-4890-92df-9e295b829e2c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:09.725024 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d9b21f56-fec1-4588-afa5-f8628a910045 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:09.725941 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d9b21f56-fec1-4588-afa5-f8628a910045 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:09.733300 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d9b21f56-fec1-4588-afa5-f8628a910045 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:09.733746 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d9b21f56-fec1-4588-afa5-f8628a910045 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:09.734500 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d9b21f56-fec1-4588-afa5-f8628a910045 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:09.734928 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d9b21f56-fec1-4588-afa5-f8628a910045 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:09.765182 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d9b21f56-fec1-4588-afa5-f8628a910045 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044093 May 24 15:24:09.765744 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 272/555] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:24:09 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 15:24:09.831427 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-3a5f204a-c347-4890-92df-9e295b829e2c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:24:09.838794 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-3a5f204a-c347-4890-92df-9e295b829e2c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1668 microversion: 2.1 time: 0.155244 May 24 15:24:09.839352 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 284/556] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:24:09 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1668 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:24:10.776799 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-3b18bb2c-a328-42b2-ab3b-63fce210976c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:10.777646 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-3b18bb2c-a328-42b2-ab3b-63fce210976c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:10.784165 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3b18bb2c-a328-42b2-ab3b-63fce210976c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:10.784635 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3b18bb2c-a328-42b2-ab3b-63fce210976c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:10.785393 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3b18bb2c-a328-42b2-ab3b-63fce210976c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:10.785825 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3b18bb2c-a328-42b2-ab3b-63fce210976c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:10.802004 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:24:10.816549 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-3b18bb2c-a328-42b2-ab3b-63fce210976c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043797 May 24 15:24:10.817132 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 273/557] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:24:10 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:24:11.827728 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d02ae9e8-7333-4e91-b930-dea9a09db4bb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:11.828718 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d02ae9e8-7333-4e91-b930-dea9a09db4bb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:11.831108 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_api:SELECT=48 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:24:11.836244 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d02ae9e8-7333-4e91-b930-dea9a09db4bb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:11.836715 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d02ae9e8-7333-4e91-b930-dea9a09db4bb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:11.837464 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d02ae9e8-7333-4e91-b930-dea9a09db4bb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:11.837890 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d02ae9e8-7333-4e91-b930-dea9a09db4bb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:11.866639 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d02ae9e8-7333-4e91-b930-dea9a09db4bb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043395 May 24 15:24:11.867177 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 285/558] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:24:11 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:24:12.879719 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-463eaab7-57a7-456b-ab83-61a67433ae58 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:12.880833 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-463eaab7-57a7-456b-ab83-61a67433ae58 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:12.888052 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-463eaab7-57a7-456b-ab83-61a67433ae58 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:12.888544 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-463eaab7-57a7-456b-ab83-61a67433ae58 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:12.889318 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-463eaab7-57a7-456b-ab83-61a67433ae58 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:12.889753 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-463eaab7-57a7-456b-ab83-61a67433ae58 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:12.921321 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-463eaab7-57a7-456b-ab83-61a67433ae58 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045733 May 24 15:24:12.922001 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 274/559] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:24:12 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:24:13.932703 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-5dfd87bd-bf11-4204-9c8a-3680dea30e5f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:13.933541 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-5dfd87bd-bf11-4204-9c8a-3680dea30e5f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:13.940550 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5dfd87bd-bf11-4204-9c8a-3680dea30e5f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:13.940994 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5dfd87bd-bf11-4204-9c8a-3680dea30e5f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:13.941748 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5dfd87bd-bf11-4204-9c8a-3680dea30e5f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:13.942177 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5dfd87bd-bf11-4204-9c8a-3680dea30e5f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:13.970886 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-5dfd87bd-bf11-4204-9c8a-3680dea30e5f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042207 May 24 15:24:13.971464 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 286/560] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:24:13 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:24:14.981788 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-8593944b-34fc-47f0-b4d7-ddfc4f5bdb4c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:14.982964 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-8593944b-34fc-47f0-b4d7-ddfc4f5bdb4c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:14.989452 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8593944b-34fc-47f0-b4d7-ddfc4f5bdb4c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:14.989888 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8593944b-34fc-47f0-b4d7-ddfc4f5bdb4c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:14.990635 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8593944b-34fc-47f0-b4d7-ddfc4f5bdb4c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:14.991059 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8593944b-34fc-47f0-b4d7-ddfc4f5bdb4c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:15.019115 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-8593944b-34fc-47f0-b4d7-ddfc4f5bdb4c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041378 May 24 15:24:15.019655 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 275/561] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:24:14 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:24:16.030792 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-127837e8-3beb-45ed-8054-fce7b669201d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:16.031708 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-127837e8-3beb-45ed-8054-fce7b669201d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:16.038236 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-127837e8-3beb-45ed-8054-fce7b669201d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:16.038681 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-127837e8-3beb-45ed-8054-fce7b669201d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:16.039435 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-127837e8-3beb-45ed-8054-fce7b669201d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:16.039866 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-127837e8-3beb-45ed-8054-fce7b669201d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:16.068649 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-127837e8-3beb-45ed-8054-fce7b669201d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041556 May 24 15:24:16.069753 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 287/562] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:24:16 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:24:17.079754 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-788c2c2a-33a6-4298-a6a2-32e44d22c423 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:17.080713 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-788c2c2a-33a6-4298-a6a2-32e44d22c423 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:17.087257 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-788c2c2a-33a6-4298-a6a2-32e44d22c423 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:17.087700 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-788c2c2a-33a6-4298-a6a2-32e44d22c423 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:17.088496 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-788c2c2a-33a6-4298-a6a2-32e44d22c423 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:17.088925 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-788c2c2a-33a6-4298-a6a2-32e44d22c423 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:17.117516 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-788c2c2a-33a6-4298-a6a2-32e44d22c423 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041826 May 24 15:24:17.118062 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 276/563] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:24:17 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:24:18.129210 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-64ab23cb-8a82-4f4b-9f92-9a58f7393406 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:18.130123 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-64ab23cb-8a82-4f4b-9f92-9a58f7393406 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:18.136708 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-64ab23cb-8a82-4f4b-9f92-9a58f7393406 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:18.137161 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-64ab23cb-8a82-4f4b-9f92-9a58f7393406 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:18.138540 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-64ab23cb-8a82-4f4b-9f92-9a58f7393406 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:18.138976 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-64ab23cb-8a82-4f4b-9f92-9a58f7393406 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:18.166697 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-64ab23cb-8a82-4f4b-9f92-9a58f7393406 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041504 May 24 15:24:18.167252 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 288/564] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:24:18 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:24:19.178420 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-2e5bf580-c50a-4dfe-9a08-94dfdc1e0e5d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:19.179330 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-2e5bf580-c50a-4dfe-9a08-94dfdc1e0e5d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:19.186052 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2e5bf580-c50a-4dfe-9a08-94dfdc1e0e5d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:19.186513 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2e5bf580-c50a-4dfe-9a08-94dfdc1e0e5d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:19.187285 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2e5bf580-c50a-4dfe-9a08-94dfdc1e0e5d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:19.187718 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2e5bf580-c50a-4dfe-9a08-94dfdc1e0e5d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:19.216170 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-2e5bf580-c50a-4dfe-9a08-94dfdc1e0e5d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041224 May 24 15:24:19.216817 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 277/565] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:24:19 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:24:20.227904 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-faef72cd-06b4-4c82-b8c0-4620f3eeee66 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:20.228884 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-faef72cd-06b4-4c82-b8c0-4620f3eeee66 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:20.235850 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-faef72cd-06b4-4c82-b8c0-4620f3eeee66 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:20.236316 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-faef72cd-06b4-4c82-b8c0-4620f3eeee66 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:20.237081 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-faef72cd-06b4-4c82-b8c0-4620f3eeee66 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:20.237511 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-faef72cd-06b4-4c82-b8c0-4620f3eeee66 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:20.268458 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-faef72cd-06b4-4c82-b8c0-4620f3eeee66 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044458 May 24 15:24:20.269010 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 289/566] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:24:20 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:24:21.280314 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-28e1c112-4819-438f-a3a8-e0e9784749da tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:21.281244 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-28e1c112-4819-438f-a3a8-e0e9784749da tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:21.287679 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-28e1c112-4819-438f-a3a8-e0e9784749da tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:21.288113 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-28e1c112-4819-438f-a3a8-e0e9784749da tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:21.288896 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-28e1c112-4819-438f-a3a8-e0e9784749da tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:21.289321 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-28e1c112-4819-438f-a3a8-e0e9784749da tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:21.319004 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-28e1c112-4819-438f-a3a8-e0e9784749da tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042712 May 24 15:24:21.319547 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 278/567] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:24:21 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:24:22.330619 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-5b23ceb9-f37f-4d19-afc8-8040eec00df1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:22.331496 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-5b23ceb9-f37f-4d19-afc8-8040eec00df1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:22.337880 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5b23ceb9-f37f-4d19-afc8-8040eec00df1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:22.338324 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5b23ceb9-f37f-4d19-afc8-8040eec00df1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:22.339072 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5b23ceb9-f37f-4d19-afc8-8040eec00df1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:22.339495 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5b23ceb9-f37f-4d19-afc8-8040eec00df1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:22.367970 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-5b23ceb9-f37f-4d19-afc8-8040eec00df1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041384 May 24 15:24:22.368545 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 290/568] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:24:22 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:24:23.379234 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-28d60bba-aa23-4715-a0c7-e616e9fd61c7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:23.380073 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-28d60bba-aa23-4715-a0c7-e616e9fd61c7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:23.386762 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-28d60bba-aa23-4715-a0c7-e616e9fd61c7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:23.387210 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-28d60bba-aa23-4715-a0c7-e616e9fd61c7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:23.388644 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-28d60bba-aa23-4715-a0c7-e616e9fd61c7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:23.389079 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-28d60bba-aa23-4715-a0c7-e616e9fd61c7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:23.417409 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-28d60bba-aa23-4715-a0c7-e616e9fd61c7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042234 May 24 15:24:23.417959 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 279/569] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:24:23 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:24:24.428865 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-fef74221-8501-4f65-9e40-53c26c2acd4a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:24.429705 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-fef74221-8501-4f65-9e40-53c26c2acd4a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:24.436182 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fef74221-8501-4f65-9e40-53c26c2acd4a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:24.436663 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fef74221-8501-4f65-9e40-53c26c2acd4a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:24.437414 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fef74221-8501-4f65-9e40-53c26c2acd4a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:24.437845 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fef74221-8501-4f65-9e40-53c26c2acd4a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:24.441390 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:24:24.466916 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-fef74221-8501-4f65-9e40-53c26c2acd4a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042157 May 24 15:24:24.467459 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 291/570] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:24:24 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 15:24:25.478584 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-9bbeb3a7-f713-47a8-a2b6-aafa73e67a49 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:25.479497 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-9bbeb3a7-f713-47a8-a2b6-aafa73e67a49 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:25.486711 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9bbeb3a7-f713-47a8-a2b6-aafa73e67a49 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:25.487150 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9bbeb3a7-f713-47a8-a2b6-aafa73e67a49 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:25.487894 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9bbeb3a7-f713-47a8-a2b6-aafa73e67a49 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:25.488335 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9bbeb3a7-f713-47a8-a2b6-aafa73e67a49 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:25.516442 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-9bbeb3a7-f713-47a8-a2b6-aafa73e67a49 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041849 May 24 15:24:25.516971 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 280/571] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:24:25 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:24:26.527031 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-b433d118-39dd-4c51-8a28-3c87dd499409 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:26.527943 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-b433d118-39dd-4c51-8a28-3c87dd499409 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:26.534473 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b433d118-39dd-4c51-8a28-3c87dd499409 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:26.534919 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b433d118-39dd-4c51-8a28-3c87dd499409 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:26.535679 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b433d118-39dd-4c51-8a28-3c87dd499409 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:26.536110 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b433d118-39dd-4c51-8a28-3c87dd499409 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:26.564536 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-b433d118-39dd-4c51-8a28-3c87dd499409 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041415 May 24 15:24:26.565084 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 292/572] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:24:26 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:24:27.576712 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-66c5260b-9a5f-4930-98dc-bda9b09033ab tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:27.577665 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-66c5260b-9a5f-4930-98dc-bda9b09033ab tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:27.584126 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-66c5260b-9a5f-4930-98dc-bda9b09033ab tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:27.584606 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-66c5260b-9a5f-4930-98dc-bda9b09033ab tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:27.585368 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-66c5260b-9a5f-4930-98dc-bda9b09033ab tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:27.585805 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-66c5260b-9a5f-4930-98dc-bda9b09033ab tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:27.614858 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-66c5260b-9a5f-4930-98dc-bda9b09033ab tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042687 May 24 15:24:27.615406 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 281/573] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:24:27 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:24:27.730716 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-62e35b5d-cfc0-4339-9d5a-dc38ffb17222 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-314768579"}} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:24:27.731254 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-62e35b5d-cfc0-4339-9d5a-dc38ffb17222 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:27.737965 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-62e35b5d-cfc0-4339-9d5a-dc38ffb17222 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:27.738409 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-62e35b5d-cfc0-4339-9d5a-dc38ffb17222 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:27.739166 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-62e35b5d-cfc0-4339-9d5a-dc38ffb17222 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:27.739596 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-62e35b5d-cfc0-4339-9d5a-dc38ffb17222 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:27.863468 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.network.security_group_api [None req-62e35b5d-cfc0-4339-9d5a-dc38ffb17222 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Removing security group ee9d65a8-0b87-4f60-b65c-f6ddf08427ee from port 3b9228a9-f1b9-4ba1-9526-b1b918986c1b May 24 15:24:28.234282 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-62e35b5d-cfc0-4339-9d5a-dc38ffb17222 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "POST /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/action" status: 202 len: 0 microversion: 2.1 time: 0.507256 May 24 15:24:28.242950 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [req-54d7d158-90ef-4fa8-9ce4-531b96695446 req-289cdadc-f830-4c2d-91e1-8931b2673223 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c395e512-b693-4a96-8301-640831fee66f", "tag": "3b9228a9-f1b9-4ba1-9526-b1b918986c1b"}]} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:24:28.248849 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 293/574] 10.222.0.45 () {60 vars in 1277 bytes} [Tue May 24 15:24:27 2022] POST /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/action => generated 0 bytes in 522 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 15:24:28.252719 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-54d7d158-90ef-4fa8-9ce4-531b96695446 req-289cdadc-f830-4c2d-91e1-8931b2673223 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:28.253157 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-54d7d158-90ef-4fa8-9ce4-531b96695446 req-289cdadc-f830-4c2d-91e1-8931b2673223 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:28.272744 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.compute.server_external_events [req-54d7d158-90ef-4fa8-9ce4-531b96695446 req-289cdadc-f830-4c2d-91e1-8931b2673223 service nova] Creating event network-changed:3b9228a9-f1b9-4ba1-9526-b1b918986c1b for instance c395e512-b693-4a96-8301-640831fee66f on hv-cinder-84315 May 24 15:24:28.283262 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [req-54d7d158-90ef-4fa8-9ce4-531b96695446 req-289cdadc-f830-4c2d-91e1-8931b2673223 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043460 May 24 15:24:28.283893 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 282/575] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:24:28.627134 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-64ff84fb-309f-468d-9924-41cf198ca5d5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:28.628608 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-64ff84fb-309f-468d-9924-41cf198ca5d5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:28.634930 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-64ff84fb-309f-468d-9924-41cf198ca5d5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:28.635673 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-64ff84fb-309f-468d-9924-41cf198ca5d5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:28.636695 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-64ff84fb-309f-468d-9924-41cf198ca5d5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:28.637777 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-64ff84fb-309f-468d-9924-41cf198ca5d5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:28.688225 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-64ff84fb-309f-468d-9924-41cf198ca5d5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064836 May 24 15:24:28.688921 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 294/576] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:24:28 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:24:29.500145 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-61f9608f-1a40-4964-a371-cc2f80db01a7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:29.500775 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-61f9608f-1a40-4964-a371-cc2f80db01a7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:29.501073 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [req-bbf90dc7-31b3-4e21-91f2-81703c659763 req-380cd774-e5ba-4b6f-8a4b-5dd90c5df1ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c395e512-b693-4a96-8301-640831fee66f", "tag": "3b9228a9-f1b9-4ba1-9526-b1b918986c1b"}]} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:24:29.507306 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-61f9608f-1a40-4964-a371-cc2f80db01a7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:29.507692 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-61f9608f-1a40-4964-a371-cc2f80db01a7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:29.508671 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-61f9608f-1a40-4964-a371-cc2f80db01a7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:29.509113 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-61f9608f-1a40-4964-a371-cc2f80db01a7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:29.510237 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-bbf90dc7-31b3-4e21-91f2-81703c659763 req-380cd774-e5ba-4b6f-8a4b-5dd90c5df1ac service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:29.510743 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-bbf90dc7-31b3-4e21-91f2-81703c659763 req-380cd774-e5ba-4b6f-8a4b-5dd90c5df1ac service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:29.521895 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.compute.server_external_events [req-bbf90dc7-31b3-4e21-91f2-81703c659763 req-380cd774-e5ba-4b6f-8a4b-5dd90c5df1ac service nova] Creating event network-changed:3b9228a9-f1b9-4ba1-9526-b1b918986c1b for instance c395e512-b693-4a96-8301-640831fee66f on hv-cinder-84315 May 24 15:24:29.527070 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [req-bbf90dc7-31b3-4e21-91f2-81703c659763 req-380cd774-e5ba-4b6f-8a4b-5dd90c5df1ac service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029707 May 24 15:24:29.527921 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 295/577] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:24:29.641051 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.objects.instance [None req-61f9608f-1a40-4964-a371-cc2f80db01a7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lazy-loading 'services' on Instance uuid c395e512-b693-4a96-8301-640831fee66f {{(pid=117699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 15:24:29.699649 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-3b697e06-cd97-4fd4-b158-babe84c5e172 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:29.700729 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-3b697e06-cd97-4fd4-b158-babe84c5e172 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:29.707533 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3b697e06-cd97-4fd4-b158-babe84c5e172 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:29.708078 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3b697e06-cd97-4fd4-b158-babe84c5e172 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:29.708952 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3b697e06-cd97-4fd4-b158-babe84c5e172 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:29.709477 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3b697e06-cd97-4fd4-b158-babe84c5e172 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:29.748009 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-3b697e06-cd97-4fd4-b158-babe84c5e172 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052572 May 24 15:24:29.752572 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 296/578] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:24:29 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 15:24:29.795853 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-61f9608f-1a40-4964-a371-cc2f80db01a7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments/3cbf20c3-d23e-45ec-9308-c45fc0665b2d" status: 202 len: 0 microversion: 2.1 time: 0.300550 May 24 15:24:29.796762 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 283/579] 10.222.0.45 () {58 vars in 1415 bytes} [Tue May 24 15:24:29 2022] DELETE /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments/3cbf20c3-d23e-45ec-9308-c45fc0665b2d => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 15:24:29.805897 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-6bf14ca5-153e-49eb-a094-4c2a165e66a4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:29.806839 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-6bf14ca5-153e-49eb-a094-4c2a165e66a4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:29.813540 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6bf14ca5-153e-49eb-a094-4c2a165e66a4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:29.813986 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6bf14ca5-153e-49eb-a094-4c2a165e66a4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:29.815110 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6bf14ca5-153e-49eb-a094-4c2a165e66a4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:29.815740 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6bf14ca5-153e-49eb-a094-4c2a165e66a4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:29.851341 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-6bf14ca5-153e-49eb-a094-4c2a165e66a4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049992 May 24 15:24:29.852411 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 297/580] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:24:29 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:24:30.760565 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-5c87ab8f-4d7b-4931-9085-86f101d3e857 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:30.761614 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-5c87ab8f-4d7b-4931-9085-86f101d3e857 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:30.768378 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5c87ab8f-4d7b-4931-9085-86f101d3e857 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:30.768823 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5c87ab8f-4d7b-4931-9085-86f101d3e857 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:30.769577 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5c87ab8f-4d7b-4931-9085-86f101d3e857 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:30.770011 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5c87ab8f-4d7b-4931-9085-86f101d3e857 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:30.801928 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-5c87ab8f-4d7b-4931-9085-86f101d3e857 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046151 May 24 15:24:30.802479 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 284/581] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:24:30 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:24:30.863287 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-42efd616-1946-41f2-bd12-888fe33bee0f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:30.864202 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-42efd616-1946-41f2-bd12-888fe33bee0f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:30.870698 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-42efd616-1946-41f2-bd12-888fe33bee0f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:30.871142 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-42efd616-1946-41f2-bd12-888fe33bee0f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:30.872411 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-42efd616-1946-41f2-bd12-888fe33bee0f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:30.872842 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-42efd616-1946-41f2-bd12-888fe33bee0f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:30.900964 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-42efd616-1946-41f2-bd12-888fe33bee0f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041683 May 24 15:24:30.901505 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 298/582] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:24:30 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:24:31.813418 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-04aa0001-50ad-4963-8de9-dee407481297 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:31.814332 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-04aa0001-50ad-4963-8de9-dee407481297 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:31.820842 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-04aa0001-50ad-4963-8de9-dee407481297 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:31.821287 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-04aa0001-50ad-4963-8de9-dee407481297 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:31.822045 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-04aa0001-50ad-4963-8de9-dee407481297 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:31.822480 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-04aa0001-50ad-4963-8de9-dee407481297 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:31.855962 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-04aa0001-50ad-4963-8de9-dee407481297 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046487 May 24 15:24:31.857124 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 285/583] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:24:31 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:24:31.913193 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e33034da-3b9c-4073-964a-88e6a192125c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:31.914110 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e33034da-3b9c-4073-964a-88e6a192125c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:31.921921 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e33034da-3b9c-4073-964a-88e6a192125c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:31.922365 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e33034da-3b9c-4073-964a-88e6a192125c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:31.923119 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e33034da-3b9c-4073-964a-88e6a192125c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:31.923544 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e33034da-3b9c-4073-964a-88e6a192125c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:31.951095 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e33034da-3b9c-4073-964a-88e6a192125c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041891 May 24 15:24:31.951640 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 299/584] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:24:31 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:24:32.868563 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f8293aac-8797-4bd2-a143-6240e310ffdf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:32.869486 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f8293aac-8797-4bd2-a143-6240e310ffdf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:32.878015 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f8293aac-8797-4bd2-a143-6240e310ffdf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:32.878516 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f8293aac-8797-4bd2-a143-6240e310ffdf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:32.879343 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f8293aac-8797-4bd2-a143-6240e310ffdf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:32.879767 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f8293aac-8797-4bd2-a143-6240e310ffdf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:32.909277 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f8293aac-8797-4bd2-a143-6240e310ffdf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044889 May 24 15:24:32.909832 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 286/585] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:24:32 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:24:32.962219 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-25b09672-3fdf-4334-a105-a19b38f1c9ea tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:32.963144 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-25b09672-3fdf-4334-a105-a19b38f1c9ea tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:32.972955 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-25b09672-3fdf-4334-a105-a19b38f1c9ea tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:32.974091 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-25b09672-3fdf-4334-a105-a19b38f1c9ea tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:32.974246 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-25b09672-3fdf-4334-a105-a19b38f1c9ea tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:32.974708 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-25b09672-3fdf-4334-a105-a19b38f1c9ea tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:33.002877 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-25b09672-3fdf-4334-a105-a19b38f1c9ea tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044590 May 24 15:24:33.003429 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 300/586] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:24:32 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:24:33.921917 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-4345c793-c5ae-4a39-a8d7-66dda11750de tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:33.922826 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-4345c793-c5ae-4a39-a8d7-66dda11750de tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:33.925239 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_api:SELECT=44 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:24:33.930577 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4345c793-c5ae-4a39-a8d7-66dda11750de tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:33.931016 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4345c793-c5ae-4a39-a8d7-66dda11750de tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:33.931766 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4345c793-c5ae-4a39-a8d7-66dda11750de tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:33.932192 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4345c793-c5ae-4a39-a8d7-66dda11750de tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:33.964507 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-4345c793-c5ae-4a39-a8d7-66dda11750de tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047086 May 24 15:24:33.965063 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 287/587] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:24:33 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:24:34.014205 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c347dd6a-2c0c-4a10-951b-4b4510187828 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:34.015163 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-c347dd6a-2c0c-4a10-951b-4b4510187828 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:34.021802 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c347dd6a-2c0c-4a10-951b-4b4510187828 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:34.022255 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c347dd6a-2c0c-4a10-951b-4b4510187828 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:34.023013 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c347dd6a-2c0c-4a10-951b-4b4510187828 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:34.023448 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c347dd6a-2c0c-4a10-951b-4b4510187828 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:34.054914 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-c347dd6a-2c0c-4a10-951b-4b4510187828 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044599 May 24 15:24:34.055465 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 301/588] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:24:34 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:24:34.976713 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-b9e4752c-a194-44f4-86e6-b1afa0a7f93c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:34.977621 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-b9e4752c-a194-44f4-86e6-b1afa0a7f93c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:34.984564 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b9e4752c-a194-44f4-86e6-b1afa0a7f93c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:34.985001 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b9e4752c-a194-44f4-86e6-b1afa0a7f93c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:34.985746 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b9e4752c-a194-44f4-86e6-b1afa0a7f93c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:34.986168 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b9e4752c-a194-44f4-86e6-b1afa0a7f93c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:35.015417 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-b9e4752c-a194-44f4-86e6-b1afa0a7f93c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042616 May 24 15:24:35.015969 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 288/589] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:24:34 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:24:35.066072 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-08a256b0-9995-419f-a1d7-c985256b26a6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:35.066986 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-08a256b0-9995-419f-a1d7-c985256b26a6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:35.073429 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-08a256b0-9995-419f-a1d7-c985256b26a6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:35.073869 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-08a256b0-9995-419f-a1d7-c985256b26a6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:35.074621 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-08a256b0-9995-419f-a1d7-c985256b26a6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:35.075506 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-08a256b0-9995-419f-a1d7-c985256b26a6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:35.103716 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-08a256b0-9995-419f-a1d7-c985256b26a6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041464 May 24 15:24:35.104195 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 302/590] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:24:35 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:24:35.892058 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-efbb078c-9092-4158-b68c-f038cf572a46 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:35.892578 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-efbb078c-9092-4158-b68c-f038cf572a46 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:35.898768 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-efbb078c-9092-4158-b68c-f038cf572a46 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:35.899222 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-efbb078c-9092-4158-b68c-f038cf572a46 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:35.899992 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-efbb078c-9092-4158-b68c-f038cf572a46 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:35.900461 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-efbb078c-9092-4158-b68c-f038cf572a46 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:35.980659 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.objects.instance [None req-efbb078c-9092-4158-b68c-f038cf572a46 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lazy-loading 'services' on Instance uuid 3017990e-8735-4d85-a686-1eebb1484dd3 {{(pid=117699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 15:24:35.984664 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:24:36.026831 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-ee52da93-8060-4c06-a847-2ff054f7679e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:36.027741 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-ee52da93-8060-4c06-a847-2ff054f7679e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:36.034934 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ee52da93-8060-4c06-a847-2ff054f7679e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:36.035354 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ee52da93-8060-4c06-a847-2ff054f7679e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:36.036147 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ee52da93-8060-4c06-a847-2ff054f7679e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:36.036645 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ee52da93-8060-4c06-a847-2ff054f7679e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:36.052224 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-efbb078c-9092-4158-b68c-f038cf572a46 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "DELETE /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments/58202b9b-e8dd-4cc9-b7f8-d1b681e24558" status: 202 len: 0 microversion: 2.1 time: 0.164405 May 24 15:24:36.052888 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 289/591] 10.222.0.45 () {58 vars in 1415 bytes} [Tue May 24 15:24:35 2022] DELETE /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments/58202b9b-e8dd-4cc9-b7f8-d1b681e24558 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 15:24:36.061489 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a384f38e-1d2b-47bf-b827-d12001ed750c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:36.062529 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a384f38e-1d2b-47bf-b827-d12001ed750c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:36.069061 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a384f38e-1d2b-47bf-b827-d12001ed750c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:36.069513 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a384f38e-1d2b-47bf-b827-d12001ed750c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:36.070498 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a384f38e-1d2b-47bf-b827-d12001ed750c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:36.070961 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a384f38e-1d2b-47bf-b827-d12001ed750c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:36.075870 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-ee52da93-8060-4c06-a847-2ff054f7679e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052778 May 24 15:24:36.077461 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 303/592] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:24:36 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 15:24:36.106477 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a384f38e-1d2b-47bf-b827-d12001ed750c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049018 May 24 15:24:36.106950 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 290/593] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:24:36 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:24:36.115722 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-da04cebf-3bc4-42bf-a40c-8b4e1d57f3ea tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:36.116762 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-da04cebf-3bc4-42bf-a40c-8b4e1d57f3ea tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:36.123445 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-da04cebf-3bc4-42bf-a40c-8b4e1d57f3ea tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:36.123897 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-da04cebf-3bc4-42bf-a40c-8b4e1d57f3ea tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:36.124680 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-da04cebf-3bc4-42bf-a40c-8b4e1d57f3ea tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:36.125116 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-da04cebf-3bc4-42bf-a40c-8b4e1d57f3ea tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:36.153650 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-da04cebf-3bc4-42bf-a40c-8b4e1d57f3ea tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042040 May 24 15:24:36.154196 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 304/594] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:24:36 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:24:37.088184 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-b84bc2e3-40fd-463a-9647-697ca122dd41 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:37.089124 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-b84bc2e3-40fd-463a-9647-697ca122dd41 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:37.095254 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b84bc2e3-40fd-463a-9647-697ca122dd41 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:37.095694 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b84bc2e3-40fd-463a-9647-697ca122dd41 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:37.096473 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b84bc2e3-40fd-463a-9647-697ca122dd41 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:37.096903 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b84bc2e3-40fd-463a-9647-697ca122dd41 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:37.118213 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d51979b6-96ea-480c-acb6-915e57dd6eff tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:37.119488 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d51979b6-96ea-480c-acb6-915e57dd6eff tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:37.125834 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-b84bc2e3-40fd-463a-9647-697ca122dd41 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041579 May 24 15:24:37.126399 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 291/595] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:24:37 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:24:37.127115 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d51979b6-96ea-480c-acb6-915e57dd6eff tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:37.127625 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d51979b6-96ea-480c-acb6-915e57dd6eff tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:37.128423 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d51979b6-96ea-480c-acb6-915e57dd6eff tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:37.128872 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d51979b6-96ea-480c-acb6-915e57dd6eff tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:37.157617 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d51979b6-96ea-480c-acb6-915e57dd6eff tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043268 May 24 15:24:37.158106 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 305/596] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:24:37 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:24:37.164480 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-809141bd-f84f-4fc9-a356-e7cb82fb6eac tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:37.165392 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-809141bd-f84f-4fc9-a356-e7cb82fb6eac tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:37.171451 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-809141bd-f84f-4fc9-a356-e7cb82fb6eac tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:37.171894 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-809141bd-f84f-4fc9-a356-e7cb82fb6eac tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:37.172681 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-809141bd-f84f-4fc9-a356-e7cb82fb6eac tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:37.173110 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-809141bd-f84f-4fc9-a356-e7cb82fb6eac tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:37.201692 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-809141bd-f84f-4fc9-a356-e7cb82fb6eac tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041024 May 24 15:24:37.202244 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 292/597] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:24:37 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:24:38.137768 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-8008f94d-648c-4497-84f6-34c2cf5589b7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:38.138673 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-8008f94d-648c-4497-84f6-34c2cf5589b7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:38.145190 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8008f94d-648c-4497-84f6-34c2cf5589b7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:38.145634 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8008f94d-648c-4497-84f6-34c2cf5589b7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:38.146378 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8008f94d-648c-4497-84f6-34c2cf5589b7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:38.146806 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8008f94d-648c-4497-84f6-34c2cf5589b7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:38.168876 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-c0a061c9-fd88-4470-bd42-5e0313e58574 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:38.169799 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-c0a061c9-fd88-4470-bd42-5e0313e58574 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:38.175660 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-8008f94d-648c-4497-84f6-34c2cf5589b7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042309 May 24 15:24:38.176217 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 306/598] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:24:38 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:24:38.176446 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c0a061c9-fd88-4470-bd42-5e0313e58574 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:38.176691 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c0a061c9-fd88-4470-bd42-5e0313e58574 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:38.177452 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c0a061c9-fd88-4470-bd42-5e0313e58574 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:38.177884 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c0a061c9-fd88-4470-bd42-5e0313e58574 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:38.206399 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-c0a061c9-fd88-4470-bd42-5e0313e58574 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041433 May 24 15:24:38.206880 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 293/599] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:24:38 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:24:38.212946 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-6a5c0a02-e72b-4d52-a292-8f17cc764881 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:38.213853 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-6a5c0a02-e72b-4d52-a292-8f17cc764881 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:38.220348 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6a5c0a02-e72b-4d52-a292-8f17cc764881 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:38.220798 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6a5c0a02-e72b-4d52-a292-8f17cc764881 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:38.221538 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6a5c0a02-e72b-4d52-a292-8f17cc764881 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:38.221963 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6a5c0a02-e72b-4d52-a292-8f17cc764881 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:38.249385 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-6a5c0a02-e72b-4d52-a292-8f17cc764881 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040329 May 24 15:24:38.249915 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 307/600] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:24:38 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:24:39.187077 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-755cd2a5-33c5-47f9-81b5-d25a4f29451b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:39.187981 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-755cd2a5-33c5-47f9-81b5-d25a4f29451b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:39.194420 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-755cd2a5-33c5-47f9-81b5-d25a4f29451b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:39.194858 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-755cd2a5-33c5-47f9-81b5-d25a4f29451b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:39.195600 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-755cd2a5-33c5-47f9-81b5-d25a4f29451b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:39.196023 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-755cd2a5-33c5-47f9-81b5-d25a4f29451b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:39.218907 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-ad789fa0-2b6f-4a08-b8c2-befa321b76e8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:39.219819 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-ad789fa0-2b6f-4a08-b8c2-befa321b76e8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:39.225656 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-755cd2a5-33c5-47f9-81b5-d25a4f29451b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042495 May 24 15:24:39.225928 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ad789fa0-2b6f-4a08-b8c2-befa321b76e8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:39.226219 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 294/601] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:24:39 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:24:39.226375 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ad789fa0-2b6f-4a08-b8c2-befa321b76e8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:39.227131 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ad789fa0-2b6f-4a08-b8c2-befa321b76e8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:39.227558 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ad789fa0-2b6f-4a08-b8c2-befa321b76e8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:39.252137 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:24:39.257009 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-ad789fa0-2b6f-4a08-b8c2-befa321b76e8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042507 May 24 15:24:39.257558 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 308/602] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:24:39 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:24:39.260630 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-ff229ffb-b282-410f-8750-a1264c55da6d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:39.261555 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-ff229ffb-b282-410f-8750-a1264c55da6d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:39.267425 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ff229ffb-b282-410f-8750-a1264c55da6d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:39.267869 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ff229ffb-b282-410f-8750-a1264c55da6d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:39.268724 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ff229ffb-b282-410f-8750-a1264c55da6d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:39.269158 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ff229ffb-b282-410f-8750-a1264c55da6d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:39.298075 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-ff229ffb-b282-410f-8750-a1264c55da6d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041213 May 24 15:24:39.298629 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 295/603] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:24:39 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:24:40.237840 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d531d3d8-77a8-4794-b09d-a2032720cb19 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:40.238663 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d531d3d8-77a8-4794-b09d-a2032720cb19 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:40.245282 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d531d3d8-77a8-4794-b09d-a2032720cb19 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:40.245731 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d531d3d8-77a8-4794-b09d-a2032720cb19 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:40.246987 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d531d3d8-77a8-4794-b09d-a2032720cb19 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:40.247418 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d531d3d8-77a8-4794-b09d-a2032720cb19 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:40.268875 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d95d7834-4830-4dd8-a574-2bef43b2b1a7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:40.269832 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d95d7834-4830-4dd8-a574-2bef43b2b1a7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:40.276549 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d95d7834-4830-4dd8-a574-2bef43b2b1a7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:40.276860 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d531d3d8-77a8-4794-b09d-a2032720cb19 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043278 May 24 15:24:40.277021 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d95d7834-4830-4dd8-a574-2bef43b2b1a7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:40.277429 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 309/604] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:24:40 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:24:40.277763 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d95d7834-4830-4dd8-a574-2bef43b2b1a7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:40.278193 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d95d7834-4830-4dd8-a574-2bef43b2b1a7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:40.309595 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d95d7834-4830-4dd8-a574-2bef43b2b1a7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044025 May 24 15:24:40.310342 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 296/605] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:24:40 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:24:40.310741 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-244106f1-2f71-4d6a-9092-41201cd38773 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:40.311720 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-244106f1-2f71-4d6a-9092-41201cd38773 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:40.317769 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-244106f1-2f71-4d6a-9092-41201cd38773 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:40.318210 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-244106f1-2f71-4d6a-9092-41201cd38773 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:40.318956 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-244106f1-2f71-4d6a-9092-41201cd38773 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:40.319380 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-244106f1-2f71-4d6a-9092-41201cd38773 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:40.346881 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-244106f1-2f71-4d6a-9092-41201cd38773 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040847 May 24 15:24:40.347426 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 310/606] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:24:40 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:24:41.288850 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d7354ae4-1567-4e70-84cf-8e2600a7abf0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:41.289804 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d7354ae4-1567-4e70-84cf-8e2600a7abf0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:41.296283 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d7354ae4-1567-4e70-84cf-8e2600a7abf0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:41.296759 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d7354ae4-1567-4e70-84cf-8e2600a7abf0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:41.297514 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d7354ae4-1567-4e70-84cf-8e2600a7abf0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:41.297943 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d7354ae4-1567-4e70-84cf-8e2600a7abf0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:41.326331 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d7354ae4-1567-4e70-84cf-8e2600a7abf0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041540 May 24 15:24:41.326887 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 297/607] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:24:41 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:24:41.332182 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-af01fd8b-c274-46d5-b6a1-7484bf61c512 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:41.333123 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-af01fd8b-c274-46d5-b6a1-7484bf61c512 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:41.339502 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-af01fd8b-c274-46d5-b6a1-7484bf61c512 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:41.339947 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-af01fd8b-c274-46d5-b6a1-7484bf61c512 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:41.341401 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-af01fd8b-c274-46d5-b6a1-7484bf61c512 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:41.341825 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-af01fd8b-c274-46d5-b6a1-7484bf61c512 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:41.358640 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-968c67a7-9305-4b45-9536-e23dea652b20 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:41.359556 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-968c67a7-9305-4b45-9536-e23dea652b20 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:41.365665 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-968c67a7-9305-4b45-9536-e23dea652b20 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:41.366112 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-968c67a7-9305-4b45-9536-e23dea652b20 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:41.366872 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-968c67a7-9305-4b45-9536-e23dea652b20 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:41.367302 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-968c67a7-9305-4b45-9536-e23dea652b20 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:41.370936 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-af01fd8b-c274-46d5-b6a1-7484bf61c512 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042670 May 24 15:24:41.371989 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 311/608] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:24:41 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:24:41.396535 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-968c67a7-9305-4b45-9536-e23dea652b20 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041966 May 24 15:24:41.397077 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 298/609] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:24:41 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:24:42.337366 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-7bea6a19-ed21-4056-a4bf-6a3618f49a92 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:42.338275 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-7bea6a19-ed21-4056-a4bf-6a3618f49a92 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:42.341099 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_api:SELECT=54 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:24:42.346284 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7bea6a19-ed21-4056-a4bf-6a3618f49a92 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:42.346723 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7bea6a19-ed21-4056-a4bf-6a3618f49a92 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:42.347473 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7bea6a19-ed21-4056-a4bf-6a3618f49a92 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:42.347898 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7bea6a19-ed21-4056-a4bf-6a3618f49a92 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:42.376970 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-7bea6a19-ed21-4056-a4bf-6a3618f49a92 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043560 May 24 15:24:42.377522 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 312/610] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:24:42 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:24:42.382859 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-2d8e8d5a-1f88-43cc-83dc-80fad87a627f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:42.383798 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-2d8e8d5a-1f88-43cc-83dc-80fad87a627f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:42.390264 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2d8e8d5a-1f88-43cc-83dc-80fad87a627f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:42.390700 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2d8e8d5a-1f88-43cc-83dc-80fad87a627f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:42.391449 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2d8e8d5a-1f88-43cc-83dc-80fad87a627f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:42.391874 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2d8e8d5a-1f88-43cc-83dc-80fad87a627f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:42.407581 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-49f6ecbf-4147-4e55-bc19-69af695a1f66 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:42.408542 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-49f6ecbf-4147-4e55-bc19-69af695a1f66 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:42.414514 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-49f6ecbf-4147-4e55-bc19-69af695a1f66 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:42.414956 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-49f6ecbf-4147-4e55-bc19-69af695a1f66 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:42.415708 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-49f6ecbf-4147-4e55-bc19-69af695a1f66 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:42.416137 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-49f6ecbf-4147-4e55-bc19-69af695a1f66 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:42.421101 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-2d8e8d5a-1f88-43cc-83dc-80fad87a627f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042027 May 24 15:24:42.421664 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 299/611] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:24:42 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:24:42.445486 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-49f6ecbf-4147-4e55-bc19-69af695a1f66 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042399 May 24 15:24:42.446027 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 313/612] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:24:42 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:24:43.388621 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-c82beb8f-d409-4759-9c35-a3bc27556cf9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:43.389482 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-c82beb8f-d409-4759-9c35-a3bc27556cf9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:43.395916 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c82beb8f-d409-4759-9c35-a3bc27556cf9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:43.396409 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c82beb8f-d409-4759-9c35-a3bc27556cf9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:43.397165 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c82beb8f-d409-4759-9c35-a3bc27556cf9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:43.397595 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c82beb8f-d409-4759-9c35-a3bc27556cf9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:43.425785 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-c82beb8f-d409-4759-9c35-a3bc27556cf9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041276 May 24 15:24:43.426339 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 300/613] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:24:43 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:24:43.432981 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-a3e1858e-e523-4f7b-bd9d-6db6934af0cb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:43.434532 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-a3e1858e-e523-4f7b-bd9d-6db6934af0cb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:43.440964 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a3e1858e-e523-4f7b-bd9d-6db6934af0cb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:43.441407 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a3e1858e-e523-4f7b-bd9d-6db6934af0cb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:43.442154 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a3e1858e-e523-4f7b-bd9d-6db6934af0cb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:43.442583 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a3e1858e-e523-4f7b-bd9d-6db6934af0cb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:43.456612 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f48764c8-3eac-4f24-97c9-1fea9592b5ef tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:43.457580 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f48764c8-3eac-4f24-97c9-1fea9592b5ef tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:43.463597 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f48764c8-3eac-4f24-97c9-1fea9592b5ef tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:43.464037 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f48764c8-3eac-4f24-97c9-1fea9592b5ef tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:43.464893 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f48764c8-3eac-4f24-97c9-1fea9592b5ef tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:43.465324 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f48764c8-3eac-4f24-97c9-1fea9592b5ef tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:43.470651 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-a3e1858e-e523-4f7b-bd9d-6db6934af0cb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041503 May 24 15:24:43.471211 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 314/614] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:24:43 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:24:43.493690 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f48764c8-3eac-4f24-97c9-1fea9592b5ef tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040835 May 24 15:24:43.494235 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 301/615] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:24:43 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:24:44.437855 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-024d804d-3772-4bce-b4a6-6b6578993059 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:44.438766 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-024d804d-3772-4bce-b4a6-6b6578993059 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:44.445207 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-024d804d-3772-4bce-b4a6-6b6578993059 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:44.445649 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-024d804d-3772-4bce-b4a6-6b6578993059 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:44.446395 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-024d804d-3772-4bce-b4a6-6b6578993059 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:44.446822 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-024d804d-3772-4bce-b4a6-6b6578993059 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:44.475067 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-024d804d-3772-4bce-b4a6-6b6578993059 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041691 May 24 15:24:44.475606 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 315/616] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:24:44 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:24:44.481940 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f7327456-124f-4a60-b659-566b3cd190c0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:44.483106 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f7327456-124f-4a60-b659-566b3cd190c0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:44.489501 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f7327456-124f-4a60-b659-566b3cd190c0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:44.489942 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f7327456-124f-4a60-b659-566b3cd190c0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:44.490689 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f7327456-124f-4a60-b659-566b3cd190c0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:44.491114 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f7327456-124f-4a60-b659-566b3cd190c0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:44.505808 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-cf4065bb-cb0c-4a15-b984-1c11d001e3e3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:44.506724 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-cf4065bb-cb0c-4a15-b984-1c11d001e3e3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:44.513279 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cf4065bb-cb0c-4a15-b984-1c11d001e3e3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:44.513721 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cf4065bb-cb0c-4a15-b984-1c11d001e3e3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:44.514472 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cf4065bb-cb0c-4a15-b984-1c11d001e3e3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:44.514895 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cf4065bb-cb0c-4a15-b984-1c11d001e3e3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:44.520764 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f7327456-124f-4a60-b659-566b3cd190c0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042561 May 24 15:24:44.521324 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 302/617] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:24:44 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:24:44.542396 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-cf4065bb-cb0c-4a15-b984-1c11d001e3e3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040422 May 24 15:24:44.542928 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 316/618] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:24:44 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:24:45.486860 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-650eb775-ee7e-4594-92f7-08457995ed1d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:45.487771 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-650eb775-ee7e-4594-92f7-08457995ed1d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:45.494231 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-650eb775-ee7e-4594-92f7-08457995ed1d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:45.494672 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-650eb775-ee7e-4594-92f7-08457995ed1d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:45.495423 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-650eb775-ee7e-4594-92f7-08457995ed1d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:45.495849 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-650eb775-ee7e-4594-92f7-08457995ed1d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:45.526471 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-650eb775-ee7e-4594-92f7-08457995ed1d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043777 May 24 15:24:45.527127 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 303/619] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:24:45 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:24:45.532272 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-09d26b5a-1dc9-4702-91bc-4ccb9176dc92 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:45.533213 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-09d26b5a-1dc9-4702-91bc-4ccb9176dc92 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:45.539592 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-09d26b5a-1dc9-4702-91bc-4ccb9176dc92 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:45.540040 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-09d26b5a-1dc9-4702-91bc-4ccb9176dc92 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:45.540827 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-09d26b5a-1dc9-4702-91bc-4ccb9176dc92 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:45.541262 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-09d26b5a-1dc9-4702-91bc-4ccb9176dc92 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:45.553779 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-28879f21-4f6c-431b-a75d-8b2f10b56836 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:45.554722 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-28879f21-4f6c-431b-a75d-8b2f10b56836 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:45.561245 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-28879f21-4f6c-431b-a75d-8b2f10b56836 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:45.561684 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-28879f21-4f6c-431b-a75d-8b2f10b56836 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:45.562441 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-28879f21-4f6c-431b-a75d-8b2f10b56836 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:45.562867 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-28879f21-4f6c-431b-a75d-8b2f10b56836 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:45.571561 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-09d26b5a-1dc9-4702-91bc-4ccb9176dc92 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043164 May 24 15:24:45.572126 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 317/620] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:24:45 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:24:45.590930 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-28879f21-4f6c-431b-a75d-8b2f10b56836 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041003 May 24 15:24:45.591474 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 304/621] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:24:45 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:24:46.538262 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-23b44c78-94ea-40f2-838c-61c41988029a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:46.539178 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-23b44c78-94ea-40f2-838c-61c41988029a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:46.545655 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-23b44c78-94ea-40f2-838c-61c41988029a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:46.546100 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-23b44c78-94ea-40f2-838c-61c41988029a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:46.546855 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-23b44c78-94ea-40f2-838c-61c41988029a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:46.547284 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-23b44c78-94ea-40f2-838c-61c41988029a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:46.576059 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-23b44c78-94ea-40f2-838c-61c41988029a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041764 May 24 15:24:46.576643 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 318/622] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:24:46 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:24:46.583014 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a269c62d-7d2e-419d-8526-1d4cf783681b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:46.583953 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a269c62d-7d2e-419d-8526-1d4cf783681b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:46.591142 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a269c62d-7d2e-419d-8526-1d4cf783681b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:46.591589 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a269c62d-7d2e-419d-8526-1d4cf783681b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:46.592379 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a269c62d-7d2e-419d-8526-1d4cf783681b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:46.592816 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a269c62d-7d2e-419d-8526-1d4cf783681b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:46.602297 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-2e17d821-3246-4d35-af25-045c41b46bf2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:46.603216 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-2e17d821-3246-4d35-af25-045c41b46bf2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:46.609541 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2e17d821-3246-4d35-af25-045c41b46bf2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:46.609987 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2e17d821-3246-4d35-af25-045c41b46bf2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:46.610745 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2e17d821-3246-4d35-af25-045c41b46bf2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:46.611176 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2e17d821-3246-4d35-af25-045c41b46bf2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:46.622548 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a269c62d-7d2e-419d-8526-1d4cf783681b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043428 May 24 15:24:46.623121 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 305/623] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:24:46 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:24:46.640762 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-2e17d821-3246-4d35-af25-045c41b46bf2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042295 May 24 15:24:46.641310 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 319/624] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:24:46 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:24:47.587819 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e5c6a032-ca3f-4354-89b6-a62c1fd95870 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:47.588770 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-e5c6a032-ca3f-4354-89b6-a62c1fd95870 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:47.595678 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e5c6a032-ca3f-4354-89b6-a62c1fd95870 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:47.596117 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e5c6a032-ca3f-4354-89b6-a62c1fd95870 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:47.596904 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e5c6a032-ca3f-4354-89b6-a62c1fd95870 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:47.597329 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e5c6a032-ca3f-4354-89b6-a62c1fd95870 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:47.600930 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:24:47.627171 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-e5c6a032-ca3f-4354-89b6-a62c1fd95870 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043416 May 24 15:24:47.627722 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 306/625] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:24:47 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:24:47.633622 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-6fbe5b62-1a0d-4c35-a0fb-e2a82bcc9b93 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:47.634529 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-6fbe5b62-1a0d-4c35-a0fb-e2a82bcc9b93 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:47.640869 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6fbe5b62-1a0d-4c35-a0fb-e2a82bcc9b93 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:47.641311 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6fbe5b62-1a0d-4c35-a0fb-e2a82bcc9b93 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:47.642053 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6fbe5b62-1a0d-4c35-a0fb-e2a82bcc9b93 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:47.642478 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6fbe5b62-1a0d-4c35-a0fb-e2a82bcc9b93 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:47.651952 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-17ec8dd2-cad6-48aa-b303-65c7c6e4909e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:47.653438 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-17ec8dd2-cad6-48aa-b303-65c7c6e4909e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:47.659346 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-17ec8dd2-cad6-48aa-b303-65c7c6e4909e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:47.659795 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-17ec8dd2-cad6-48aa-b303-65c7c6e4909e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:47.660573 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-17ec8dd2-cad6-48aa-b303-65c7c6e4909e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:47.661007 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-17ec8dd2-cad6-48aa-b303-65c7c6e4909e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:47.671832 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-6fbe5b62-1a0d-4c35-a0fb-e2a82bcc9b93 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041974 May 24 15:24:47.672402 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 320/626] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:24:47 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:24:47.689262 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-17ec8dd2-cad6-48aa-b303-65c7c6e4909e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041117 May 24 15:24:47.689801 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 307/627] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:24:47 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:24:48.638646 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-024c70fe-3ebd-4e52-91db-d0e1ad626a8c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:48.639488 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-024c70fe-3ebd-4e52-91db-d0e1ad626a8c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:48.646009 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-024c70fe-3ebd-4e52-91db-d0e1ad626a8c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:48.646450 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-024c70fe-3ebd-4e52-91db-d0e1ad626a8c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:48.647194 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-024c70fe-3ebd-4e52-91db-d0e1ad626a8c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:48.647619 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-024c70fe-3ebd-4e52-91db-d0e1ad626a8c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:48.676062 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-024c70fe-3ebd-4e52-91db-d0e1ad626a8c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041480 May 24 15:24:48.676641 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 321/628] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:24:48 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:24:48.682925 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-c89e99ec-5dfa-4a84-8d08-1549cded9f4b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:48.684546 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-c89e99ec-5dfa-4a84-8d08-1549cded9f4b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:48.690933 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c89e99ec-5dfa-4a84-8d08-1549cded9f4b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:48.691380 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c89e99ec-5dfa-4a84-8d08-1549cded9f4b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:48.692137 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c89e99ec-5dfa-4a84-8d08-1549cded9f4b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:48.692600 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c89e99ec-5dfa-4a84-8d08-1549cded9f4b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:48.699768 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-3e57d9ab-255b-43bd-b1f8-ecac7aaa23be tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:48.700710 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-3e57d9ab-255b-43bd-b1f8-ecac7aaa23be tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:48.706548 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3e57d9ab-255b-43bd-b1f8-ecac7aaa23be tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:48.706994 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3e57d9ab-255b-43bd-b1f8-ecac7aaa23be tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:48.707742 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3e57d9ab-255b-43bd-b1f8-ecac7aaa23be tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:48.708175 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3e57d9ab-255b-43bd-b1f8-ecac7aaa23be tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:48.720838 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-c89e99ec-5dfa-4a84-8d08-1549cded9f4b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041750 May 24 15:24:48.721406 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 308/629] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:24:48 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:24:48.736723 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-3e57d9ab-255b-43bd-b1f8-ecac7aaa23be tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040732 May 24 15:24:48.737264 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 322/630] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:24:48 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:24:49.021953 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-5591ac2f-4aa3-49f6-bdc8-6cb3482394ab tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:49.022913 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-5591ac2f-4aa3-49f6-bdc8-6cb3482394ab tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:49.029323 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5591ac2f-4aa3-49f6-bdc8-6cb3482394ab tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:49.029769 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5591ac2f-4aa3-49f6-bdc8-6cb3482394ab tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:49.030525 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5591ac2f-4aa3-49f6-bdc8-6cb3482394ab tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:49.030960 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5591ac2f-4aa3-49f6-bdc8-6cb3482394ab tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:49.059036 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-5591ac2f-4aa3-49f6-bdc8-6cb3482394ab tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041091 May 24 15:24:49.059579 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 309/631] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:24:49 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 24 15:24:49.116141 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d747a00c-4de6-4319-ae61-a460aa2b3501 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:49.116691 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d747a00c-4de6-4319-ae61-a460aa2b3501 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:49.122638 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d747a00c-4de6-4319-ae61-a460aa2b3501 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:49.123087 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d747a00c-4de6-4319-ae61-a460aa2b3501 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:49.123848 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d747a00c-4de6-4319-ae61-a460aa2b3501 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:49.124283 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d747a00c-4de6-4319-ae61-a460aa2b3501 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:49.148003 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d747a00c-4de6-4319-ae61-a460aa2b3501 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Going to try to terminate instance {{(pid=117698) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 15:24:49.197648 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:24:49.223903 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d747a00c-4de6-4319-ae61-a460aa2b3501 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "DELETE /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 204 len: 0 microversion: 2.1 time: 0.111252 May 24 15:24:49.224588 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 323/632] 10.222.0.45 () {58 vars in 1238 bytes} [Tue May 24 15:24:49 2022] DELETE /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 15:24:49.233637 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-af714ed1-9c92-4de5-9a25-1787f1d07ab8 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:49.234304 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-af714ed1-9c92-4de5-9a25-1787f1d07ab8 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:49.240196 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-af714ed1-9c92-4de5-9a25-1787f1d07ab8 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:49.240686 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-af714ed1-9c92-4de5-9a25-1787f1d07ab8 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:49.241450 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-af714ed1-9c92-4de5-9a25-1787f1d07ab8 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:49.241895 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-af714ed1-9c92-4de5-9a25-1787f1d07ab8 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:49.367384 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-af714ed1-9c92-4de5-9a25-1787f1d07ab8 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:24:49.374833 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-af714ed1-9c92-4de5-9a25-1787f1d07ab8 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1674 microversion: 2.1 time: 0.146114 May 24 15:24:49.375396 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 310/633] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:24:49 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1674 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:24:49.688224 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-4907d589-7ba9-4ea2-8cf7-1d028ff59582 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:49.689210 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-4907d589-7ba9-4ea2-8cf7-1d028ff59582 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:49.695545 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4907d589-7ba9-4ea2-8cf7-1d028ff59582 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:49.696000 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4907d589-7ba9-4ea2-8cf7-1d028ff59582 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:49.696760 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4907d589-7ba9-4ea2-8cf7-1d028ff59582 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:49.697186 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4907d589-7ba9-4ea2-8cf7-1d028ff59582 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:49.726461 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-4907d589-7ba9-4ea2-8cf7-1d028ff59582 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043150 May 24 15:24:49.727010 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 324/634] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:24:49 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:24:49.732108 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f0a0b6d9-5b70-4d2b-806f-976a214eb7a9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:49.733381 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f0a0b6d9-5b70-4d2b-806f-976a214eb7a9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:49.739710 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f0a0b6d9-5b70-4d2b-806f-976a214eb7a9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:49.740149 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f0a0b6d9-5b70-4d2b-806f-976a214eb7a9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:49.740987 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f0a0b6d9-5b70-4d2b-806f-976a214eb7a9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:49.741424 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f0a0b6d9-5b70-4d2b-806f-976a214eb7a9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:49.748351 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-df51bb4b-b0f3-4324-9751-82c7f09fcf53 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:49.749255 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-df51bb4b-b0f3-4324-9751-82c7f09fcf53 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:49.755119 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-df51bb4b-b0f3-4324-9751-82c7f09fcf53 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:49.755599 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-df51bb4b-b0f3-4324-9751-82c7f09fcf53 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:49.756372 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-df51bb4b-b0f3-4324-9751-82c7f09fcf53 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:49.756803 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-df51bb4b-b0f3-4324-9751-82c7f09fcf53 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:49.772891 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f0a0b6d9-5b70-4d2b-806f-976a214eb7a9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044805 May 24 15:24:49.773556 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 311/635] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:24:49 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:24:49.785397 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-df51bb4b-b0f3-4324-9751-82c7f09fcf53 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041256 May 24 15:24:49.785937 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 325/636] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:24:49 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:24:50.391001 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-791f893a-9ad0-4912-900c-a37ac9f221dd tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:50.391574 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-791f893a-9ad0-4912-900c-a37ac9f221dd tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:50.397752 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-791f893a-9ad0-4912-900c-a37ac9f221dd tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:50.398196 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-791f893a-9ad0-4912-900c-a37ac9f221dd tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:50.398950 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-791f893a-9ad0-4912-900c-a37ac9f221dd tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:50.399378 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-791f893a-9ad0-4912-900c-a37ac9f221dd tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:50.528035 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-791f893a-9ad0-4912-900c-a37ac9f221dd tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:24:50.535552 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-791f893a-9ad0-4912-900c-a37ac9f221dd tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1674 microversion: 2.1 time: 0.148477 May 24 15:24:50.536118 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 312/637] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:24:50 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1674 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:24:50.738137 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-b44360fe-8c57-437f-a71e-a7a4b18ef3dd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:50.739084 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-b44360fe-8c57-437f-a71e-a7a4b18ef3dd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:50.745569 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b44360fe-8c57-437f-a71e-a7a4b18ef3dd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:50.746022 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b44360fe-8c57-437f-a71e-a7a4b18ef3dd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:50.746840 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b44360fe-8c57-437f-a71e-a7a4b18ef3dd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:50.747276 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b44360fe-8c57-437f-a71e-a7a4b18ef3dd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:50.775651 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-b44360fe-8c57-437f-a71e-a7a4b18ef3dd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041496 May 24 15:24:50.776196 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 326/638] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:24:50 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:24:50.784481 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f7d14341-9114-4f8c-ada9-6e61b115071b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:50.785397 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f7d14341-9114-4f8c-ada9-6e61b115071b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:50.792075 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f7d14341-9114-4f8c-ada9-6e61b115071b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:50.792575 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f7d14341-9114-4f8c-ada9-6e61b115071b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:50.793416 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f7d14341-9114-4f8c-ada9-6e61b115071b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:50.793855 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f7d14341-9114-4f8c-ada9-6e61b115071b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:50.796706 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d46b16e3-2ce4-4e07-8795-155ba9c793a0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:50.797609 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d46b16e3-2ce4-4e07-8795-155ba9c793a0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:50.803490 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d46b16e3-2ce4-4e07-8795-155ba9c793a0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:50.803934 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d46b16e3-2ce4-4e07-8795-155ba9c793a0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:50.804709 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d46b16e3-2ce4-4e07-8795-155ba9c793a0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:50.805138 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d46b16e3-2ce4-4e07-8795-155ba9c793a0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:50.822596 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f7d14341-9114-4f8c-ada9-6e61b115071b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041994 May 24 15:24:50.823165 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 313/639] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:24:50 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:24:50.833166 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d46b16e3-2ce4-4e07-8795-155ba9c793a0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040666 May 24 15:24:50.833702 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 327/640] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:24:50 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:24:51.553486 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-bbe33163-ec43-40e4-b0ec-3f3b0552cf40 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:51.554091 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-bbe33163-ec43-40e4-b0ec-3f3b0552cf40 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:51.560651 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bbe33163-ec43-40e4-b0ec-3f3b0552cf40 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:51.561101 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bbe33163-ec43-40e4-b0ec-3f3b0552cf40 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:51.561847 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bbe33163-ec43-40e4-b0ec-3f3b0552cf40 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:51.562275 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bbe33163-ec43-40e4-b0ec-3f3b0552cf40 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:51.687601 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-bbe33163-ec43-40e4-b0ec-3f3b0552cf40 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:24:51.695201 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-bbe33163-ec43-40e4-b0ec-3f3b0552cf40 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1674 microversion: 2.1 time: 0.145536 May 24 15:24:51.695765 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 314/641] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:24:51 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1674 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:24:51.787445 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-872c0db4-f9f4-4b27-a2b7-fbecf367978e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:51.788399 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-872c0db4-f9f4-4b27-a2b7-fbecf367978e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:51.795347 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-872c0db4-f9f4-4b27-a2b7-fbecf367978e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:51.795811 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-872c0db4-f9f4-4b27-a2b7-fbecf367978e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:51.796584 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-872c0db4-f9f4-4b27-a2b7-fbecf367978e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:51.797022 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-872c0db4-f9f4-4b27-a2b7-fbecf367978e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:51.826103 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-872c0db4-f9f4-4b27-a2b7-fbecf367978e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042787 May 24 15:24:51.826587 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 328/642] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:24:51 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:24:51.834547 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d39ce140-e9f3-467a-b0d7-f4aa37c7d736 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:51.835495 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d39ce140-e9f3-467a-b0d7-f4aa37c7d736 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:51.841931 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d39ce140-e9f3-467a-b0d7-f4aa37c7d736 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:51.842378 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d39ce140-e9f3-467a-b0d7-f4aa37c7d736 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:51.843133 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d39ce140-e9f3-467a-b0d7-f4aa37c7d736 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:51.843560 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d39ce140-e9f3-467a-b0d7-f4aa37c7d736 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:51.844885 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-dc175e3e-2563-44eb-a2f7-b5da6991e9b7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:51.846432 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-dc175e3e-2563-44eb-a2f7-b5da6991e9b7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:51.852438 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dc175e3e-2563-44eb-a2f7-b5da6991e9b7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:51.853021 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dc175e3e-2563-44eb-a2f7-b5da6991e9b7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:51.853794 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dc175e3e-2563-44eb-a2f7-b5da6991e9b7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:51.854233 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dc175e3e-2563-44eb-a2f7-b5da6991e9b7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:51.877323 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d39ce140-e9f3-467a-b0d7-f4aa37c7d736 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046733 May 24 15:24:51.878134 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 315/643] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:24:51 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:24:51.884582 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-dc175e3e-2563-44eb-a2f7-b5da6991e9b7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043887 May 24 15:24:51.885167 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 329/644] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:24:51 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:24:52.501991 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [req-2f48d5e7-5881-4213-9bd2-7cc352a8a16f req-0b42b563-719b-474d-9f45-101c33e5b366 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aeb46b7-2550-490d-b4a1-f393d14133fa", "name": "network-vif-deleted", "tag": "36441b98-6b49-49ee-b389-faf88d9ea47c"}]} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:24:52.520813 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-2f48d5e7-5881-4213-9bd2-7cc352a8a16f req-0b42b563-719b-474d-9f45-101c33e5b366 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:52.525344 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-2f48d5e7-5881-4213-9bd2-7cc352a8a16f req-0b42b563-719b-474d-9f45-101c33e5b366 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:52.538395 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.compute.server_external_events [req-2f48d5e7-5881-4213-9bd2-7cc352a8a16f req-0b42b563-719b-474d-9f45-101c33e5b366 service nova] Creating event network-vif-deleted:36441b98-6b49-49ee-b389-faf88d9ea47c for instance 4aeb46b7-2550-490d-b4a1-f393d14133fa on hv-cinder-84315 May 24 15:24:52.544141 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [req-2f48d5e7-5881-4213-9bd2-7cc352a8a16f req-0b42b563-719b-474d-9f45-101c33e5b366 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045299 May 24 15:24:52.545162 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 316/645] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:24:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:24:52.712365 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-221da6a5-341e-4e8e-a95a-3454fbef98e7 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:52.712917 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-221da6a5-341e-4e8e-a95a-3454fbef98e7 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:52.719163 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-221da6a5-341e-4e8e-a95a-3454fbef98e7 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:52.719711 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-221da6a5-341e-4e8e-a95a-3454fbef98e7 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:52.720745 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-221da6a5-341e-4e8e-a95a-3454fbef98e7 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:52.721277 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-221da6a5-341e-4e8e-a95a-3454fbef98e7 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:52.752734 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-221da6a5-341e-4e8e-a95a-3454fbef98e7 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:52.753173 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-221da6a5-341e-4e8e-a95a-3454fbef98e7 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:52.753616 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.objects.instance [None req-221da6a5-341e-4e8e-a95a-3454fbef98e7 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lazy-loading 'fault' on Instance uuid 4aeb46b7-2550-490d-b4a1-f393d14133fa {{(pid=117698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 15:24:52.801355 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-221da6a5-341e-4e8e-a95a-3454fbef98e7 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:24:52.809369 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-221da6a5-341e-4e8e-a95a-3454fbef98e7 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 200 len: 1328 microversion: 2.1 time: 0.100434 May 24 15:24:52.809935 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 330/646] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:24:52 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 1328 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:24:52.838196 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-c4a98329-1704-45ef-bbbc-f08e50eaa4b6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:52.839292 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-c4a98329-1704-45ef-bbbc-f08e50eaa4b6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:52.846097 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c4a98329-1704-45ef-bbbc-f08e50eaa4b6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:52.846622 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c4a98329-1704-45ef-bbbc-f08e50eaa4b6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:52.847452 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c4a98329-1704-45ef-bbbc-f08e50eaa4b6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:52.848048 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c4a98329-1704-45ef-bbbc-f08e50eaa4b6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:52.878754 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-c4a98329-1704-45ef-bbbc-f08e50eaa4b6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044880 May 24 15:24:52.879341 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 317/647] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:24:52 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:24:52.891040 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-37026004-f97d-44c1-9288-9946e2cc0a00 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:52.891259 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-37026004-f97d-44c1-9288-9946e2cc0a00 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:52.897174 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-86fb6b71-7a19-4a5d-86c2-b2e8446925f8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:52.898104 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-86fb6b71-7a19-4a5d-86c2-b2e8446925f8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:52.898439 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-37026004-f97d-44c1-9288-9946e2cc0a00 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:52.898799 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-37026004-f97d-44c1-9288-9946e2cc0a00 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:52.899708 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-37026004-f97d-44c1-9288-9946e2cc0a00 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:52.899983 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-37026004-f97d-44c1-9288-9946e2cc0a00 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:52.904237 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-86fb6b71-7a19-4a5d-86c2-b2e8446925f8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:52.904718 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-86fb6b71-7a19-4a5d-86c2-b2e8446925f8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:52.905489 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-86fb6b71-7a19-4a5d-86c2-b2e8446925f8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:52.905919 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-86fb6b71-7a19-4a5d-86c2-b2e8446925f8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:52.930213 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-37026004-f97d-44c1-9288-9946e2cc0a00 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044677 May 24 15:24:52.935446 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 331/648] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:24:52 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:24:52.936638 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-86fb6b71-7a19-4a5d-86c2-b2e8446925f8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043756 May 24 15:24:52.937205 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 318/649] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:24:52 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:24:53.826816 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-8093cf61-be19-46bc-aa41-83ce9c755f99 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:53.827447 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-8093cf61-be19-46bc-aa41-83ce9c755f99 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:53.834211 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8093cf61-be19-46bc-aa41-83ce9c755f99 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:53.834651 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8093cf61-be19-46bc-aa41-83ce9c755f99 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:53.835431 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8093cf61-be19-46bc-aa41-83ce9c755f99 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:53.835891 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8093cf61-be19-46bc-aa41-83ce9c755f99 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:53.849922 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.wsgi [None req-8093cf61-be19-46bc-aa41-83ce9c755f99 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] HTTP exception thrown: Instance 4aeb46b7-2550-490d-b4a1-f393d14133fa could not be found. May 24 15:24:53.851604 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-8093cf61-be19-46bc-aa41-83ce9c755f99 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Request method failure captured: May 24 15:24:53.851604 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: request: GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa HTTP/1.1 May 24 15:24:53.851604 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Accept: application/json May 24 15:24:53.851604 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Accept-Encoding: identity May 24 15:24:53.851604 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Connection: close May 24 15:24:53.851604 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Content-Length: 0 May 24 15:24:53.851604 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Content-Type: application/json May 24 15:24:53.851604 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Host: 10.222.0.45 May 24 15:24:53.851604 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Openstack-System-Scope: None May 24 15:24:53.851604 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: User-Agent: python-urllib3/1.26.9 May 24 15:24:53.851604 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Auth-Token: gAAAAABijPenpuB3nhOrbi-s3yxL7m-sBG8ZJZ51rBJ3imPzJ57HWeKwFeyebtAB5n2bRdpBGRV3d5i1o5IlYb6fCewd8gSuMgbjsTvWfWnQ_U8M7n-X8RXyXojhl7q-zYypOQ1v7H4itKL87AzjyCIaWDLZ-yW18KI11cscCi_s9fBvwKCcm3E May 24 15:24:53.851604 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Domain-Id: None May 24 15:24:53.851604 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Domain-Name: None May 24 15:24:53.851604 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Identity-Status: Confirmed May 24 15:24:53.851604 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Is-Admin-Project: True May 24 15:24:53.851604 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Domain-Id: default May 24 15:24:53.851604 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Domain-Name: Default May 24 15:24:53.851604 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Id: 0812b13a287c43259d7e09b0c658d4c8 May 24 15:24:53.851604 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Name: tempest-AttachVolumeTestJSON-590500594 May 24 15:24:53.851604 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Role: reader,member May 24 15:24:53.851604 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Roles: reader,member May 24 15:24:53.852956 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0812b13a287c43259d7e09b0c658d4c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0812b13a287c43259d7e09b0c658d4c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0812b13a287c43259d7e09b0c658d4c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0812b13a287c43259d7e09b0c658d4c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 24 15:24:53.852956 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Tenant: tempest-AttachVolumeTestJSON-590500594 May 24 15:24:53.852956 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Tenant-Id: 0812b13a287c43259d7e09b0c658d4c8 May 24 15:24:53.852956 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Tenant-Name: tempest-AttachVolumeTestJSON-590500594 May 24 15:24:53.852956 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User: tempest-AttachVolumeTestJSON-590500594-project May 24 15:24:53.852956 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Domain-Id: default May 24 15:24:53.852956 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Domain-Name: Default May 24 15:24:53.852956 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Id: 2befe74ad06542b785d326101fc06d0b May 24 15:24:53.852956 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Name: tempest-AttachVolumeTestJSON-590500594-project May 24 15:24:53.852956 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: method: > May 24 15:24:53.852956 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: exception: Instance 4aeb46b7-2550-490d-b4a1-f393d14133fa could not be found. May 24 15:24:53.852956 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: action_args: {'id': '4aeb46b7-2550-490d-b4a1-f393d14133fa'} May 24 15:24:53.853707 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:24:53.853707 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:24:53.853707 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:24:53.853707 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:24:53.853707 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:24:53.853707 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:24:53.853707 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:24:53.853707 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:24:53.853707 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:24:53.853707 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:24:53.853707 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4aeb46b7-2550-490d-b4a1-f393d14133fa could not be found. May 24 15:24:53.853707 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:24:53.853707 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:24:53.853707 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:24:53.853707 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:24:53.853707 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:24:53.853707 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:24:53.853707 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:24:53.853707 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:24:53.853707 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:24:53.854914 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:24:53.854914 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 15:24:53.854914 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 15:24:53.854914 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:24:53.854914 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:24:53.854914 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:24:53.854914 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:24:53.854914 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4aeb46b7-2550-490d-b4a1-f393d14133fa could not be found. May 24 15:24:53.854914 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:24:53.854914 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:24:53.854914 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:24:53.854914 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:24:53.854914 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:24:53.854914 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:24:53.854914 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:24:53.854914 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:24:53.854914 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4aeb46b7-2550-490d-b4a1-f393d14133fa could not be found. May 24 15:24:53.854914 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:24:53.856025 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-8093cf61-be19-46bc-aa41-83ce9c755f99 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Returning 404 to user: Instance 4aeb46b7-2550-490d-b4a1-f393d14133fa could not be found. {{(pid=117698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:24:53.856025 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-8093cf61-be19-46bc-aa41-83ce9c755f99 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 404 len: 111 microversion: 2.1 time: 0.030824 May 24 15:24:53.856025 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 332/650] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:24:53 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:24:53.862408 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f76393a1-42c9-4b1a-b725-1e68aba33361 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '.version_select at 0x7f2dd2c860d0>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:53.880621 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f76393a1-42c9-4b1a-b725-1e68aba33361 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1913796150" status: 202 len: 0 microversion: 2.1 time: 0.021992 May 24 15:24:53.881189 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 319/651] 10.222.0.45 () {58 vars in 1220 bytes} [Tue May 24 15:24:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1913796150 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 15:24:53.891061 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-aeb684a4-ab11-48c9-9ce5-64357ba6d960 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:53.891990 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-aeb684a4-ab11-48c9-9ce5-64357ba6d960 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:53.898059 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-aeb684a4-ab11-48c9-9ce5-64357ba6d960 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:53.898506 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-aeb684a4-ab11-48c9-9ce5-64357ba6d960 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:53.899273 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-aeb684a4-ab11-48c9-9ce5-64357ba6d960 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:53.899695 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-aeb684a4-ab11-48c9-9ce5-64357ba6d960 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:53.930362 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-aeb684a4-ab11-48c9-9ce5-64357ba6d960 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043599 May 24 15:24:53.930841 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 333/652] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:24:53 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:24:53.942564 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-de21b49a-472d-4403-bed8-51441cb81167 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:53.944084 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-de21b49a-472d-4403-bed8-51441cb81167 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:53.947844 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-148c973f-dff0-4aa2-b264-ce09cfbdfca4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:53.949064 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-148c973f-dff0-4aa2-b264-ce09cfbdfca4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:53.953413 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-de21b49a-472d-4403-bed8-51441cb81167 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:53.954160 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-de21b49a-472d-4403-bed8-51441cb81167 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:53.955840 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-de21b49a-472d-4403-bed8-51441cb81167 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:53.956555 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-de21b49a-472d-4403-bed8-51441cb81167 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:53.956673 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-148c973f-dff0-4aa2-b264-ce09cfbdfca4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:53.957125 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-148c973f-dff0-4aa2-b264-ce09cfbdfca4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:53.957890 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-148c973f-dff0-4aa2-b264-ce09cfbdfca4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:53.958545 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-148c973f-dff0-4aa2-b264-ce09cfbdfca4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:53.991568 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-de21b49a-472d-4403-bed8-51441cb81167 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052971 May 24 15:24:53.992609 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 320/653] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:24:53 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:24:53.997328 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-148c973f-dff0-4aa2-b264-ce09cfbdfca4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053609 May 24 15:24:53.998245 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 334/654] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:24:53 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:24:54.522938 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-152e717a-20e3-4a72-afe9-afd9f47420c5 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Action: 'create', calling method: .version_select at 0x7f2dd2cde430>, body: {"keypair": {"name": "tempest-keypair-1460515207", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJCOx6nKG2zmVJxLfHJKhdrXmiwuYuOp4/DnC/Gc9Z1Wj3I0Mn9vY1SkNp6sg+iUqR0TKp2XhueG4uU9pvrCymXZnv0QWVxPosYGZmtAaadSWvfJXygCk/bDipgRm8HF3g=="}} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:24:54.537349 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.quota [None req-152e717a-20e3-4a72-afe9-afd9f47420c5 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Getting quotas for project 0812b13a287c43259d7e09b0c658d4c8. Resources: {'key_pairs'} {{(pid=117699) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 15:24:54.541107 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.quota [None req-152e717a-20e3-4a72-afe9-afd9f47420c5 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Getting quotas for user 2befe74ad06542b785d326101fc06d0b and project 0812b13a287c43259d7e09b0c658d4c8. Resources: {'key_pairs'} {{(pid=117699) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 15:24:54.562959 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-152e717a-20e3-4a72-afe9-afd9f47420c5 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.043877 May 24 15:24:54.564418 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 321/655] 10.222.0.45 () {60 vars in 1158 bytes} [Tue May 24 15:24:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:24:54.942258 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-929a0808-4bf8-4db4-9848-ed976686b922 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:54.943210 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-929a0808-4bf8-4db4-9848-ed976686b922 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:54.956070 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-929a0808-4bf8-4db4-9848-ed976686b922 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:54.956564 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-929a0808-4bf8-4db4-9848-ed976686b922 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:54.957523 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-929a0808-4bf8-4db4-9848-ed976686b922 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:54.957951 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-929a0808-4bf8-4db4-9848-ed976686b922 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:54.991231 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-929a0808-4bf8-4db4-9848-ed976686b922 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053001 May 24 15:24:54.995915 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 335/656] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:24:54 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:24:55.004534 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-09a22d11-8f72-4751-8cfa-0a99c3a87cdb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:55.005557 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-09a22d11-8f72-4751-8cfa-0a99c3a87cdb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:55.010724 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-01c4f450-36c5-4886-9e55-c730fa8ad163 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:55.012478 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-01c4f450-36c5-4886-9e55-c730fa8ad163 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:55.013859 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-09a22d11-8f72-4751-8cfa-0a99c3a87cdb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:55.014311 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-09a22d11-8f72-4751-8cfa-0a99c3a87cdb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:55.015336 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-09a22d11-8f72-4751-8cfa-0a99c3a87cdb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:55.015926 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-09a22d11-8f72-4751-8cfa-0a99c3a87cdb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:55.019170 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-01c4f450-36c5-4886-9e55-c730fa8ad163 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:55.019717 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-01c4f450-36c5-4886-9e55-c730fa8ad163 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:55.020586 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-01c4f450-36c5-4886-9e55-c730fa8ad163 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:55.021264 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-01c4f450-36c5-4886-9e55-c730fa8ad163 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:55.048221 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-09a22d11-8f72-4751-8cfa-0a99c3a87cdb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048874 May 24 15:24:55.049197 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 322/657] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:24:54 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:24:55.053775 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-01c4f450-36c5-4886-9e55-c730fa8ad163 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046896 May 24 15:24:55.054427 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 336/658] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:24:55 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:24:55.836018 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-7652d9d9-1e32-4f08-8279-c2f8dd6c9ced tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1774603365", "imageRef": "f921f75e-bbd1-4d99-ab1e-5cce2d895148", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "24c1579b-6886-424b-a2f8-7bc69ac1e33f"}], "security_groups": [{"name": "tempest-securitygroup--234698087"}], "key_name": "tempest-keypair-1460515207", "user_data": "}} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:24:56.003210 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-28c6461c-f6e2-42c6-b467-692bf4c793a3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:56.004128 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-28c6461c-f6e2-42c6-b467-692bf4c793a3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:56.011289 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-28c6461c-f6e2-42c6-b467-692bf4c793a3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:56.012401 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-28c6461c-f6e2-42c6-b467-692bf4c793a3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:56.013189 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-28c6461c-f6e2-42c6-b467-692bf4c793a3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:56.013611 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-28c6461c-f6e2-42c6-b467-692bf4c793a3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:56.046528 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-28c6461c-f6e2-42c6-b467-692bf4c793a3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047182 May 24 15:24:56.046967 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 337/659] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:24:55 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 15:24:56.058828 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c492e739-4909-4982-a0be-a5070b143cd6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:56.060032 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-c492e739-4909-4982-a0be-a5070b143cd6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:56.066896 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c492e739-4909-4982-a0be-a5070b143cd6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:56.067578 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c492e739-4909-4982-a0be-a5070b143cd6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:56.068574 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c492e739-4909-4982-a0be-a5070b143cd6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:56.069167 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c492e739-4909-4982-a0be-a5070b143cd6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:56.102174 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-c492e739-4909-4982-a0be-a5070b143cd6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047156 May 24 15:24:56.102744 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 338/660] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:24:56 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:24:56.107098 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.network.neutron [None req-7652d9d9-1e32-4f08-8279-c2f8dd6c9ced tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] validate_networks() for [('24c1579b-6886-424b-a2f8-7bc69ac1e33f', None, None, None, None, None)] {{(pid=117699) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 15:24:56.108003 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-10ecedf3-1fd5-460a-9b85-a8b6e558ba43 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:56.108956 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-10ecedf3-1fd5-460a-9b85-a8b6e558ba43 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:56.115012 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-10ecedf3-1fd5-460a-9b85-a8b6e558ba43 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:56.115649 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-10ecedf3-1fd5-460a-9b85-a8b6e558ba43 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:56.116457 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-10ecedf3-1fd5-460a-9b85-a8b6e558ba43 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:56.116892 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-10ecedf3-1fd5-460a-9b85-a8b6e558ba43 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:56.147380 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-10ecedf3-1fd5-460a-9b85-a8b6e558ba43 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043386 May 24 15:24:56.147950 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 339/661] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:24:56 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:24:56.480782 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.virt.hardware [None req-7652d9d9-1e32-4f08-8279-c2f8dd6c9ced tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Flavor limits 0:0:0 {{(pid=117699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 15:24:56.481235 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.virt.hardware [None req-7652d9d9-1e32-4f08-8279-c2f8dd6c9ced tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Image limits 0:0:0 {{(pid=117699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 15:24:56.481702 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.virt.hardware [None req-7652d9d9-1e32-4f08-8279-c2f8dd6c9ced tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Flavor pref 0:0:0 {{(pid=117699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 15:24:56.482108 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.virt.hardware [None req-7652d9d9-1e32-4f08-8279-c2f8dd6c9ced tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Image pref 0:0:0 {{(pid=117699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 15:24:56.482759 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.virt.hardware [None req-7652d9d9-1e32-4f08-8279-c2f8dd6c9ced tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 15:24:56.491411 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7652d9d9-1e32-4f08-8279-c2f8dd6c9ced tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:56.491852 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7652d9d9-1e32-4f08-8279-c2f8dd6c9ced tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:56.492680 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7652d9d9-1e32-4f08-8279-c2f8dd6c9ced tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:56.493116 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7652d9d9-1e32-4f08-8279-c2f8dd6c9ced tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:56.509658 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.quota [None req-7652d9d9-1e32-4f08-8279-c2f8dd6c9ced tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Getting quotas for project 0812b13a287c43259d7e09b0c658d4c8. Resources: {'instances', 'ram', 'cores'} {{(pid=117699) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 15:24:56.514454 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.quota [None req-7652d9d9-1e32-4f08-8279-c2f8dd6c9ced tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Getting quotas for user 2befe74ad06542b785d326101fc06d0b and project 0812b13a287c43259d7e09b0c658d4c8. Resources: {'instances', 'ram', 'cores'} {{(pid=117699) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 15:24:56.525293 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-7652d9d9-1e32-4f08-8279-c2f8dd6c9ced tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Going to run 1 instances... {{(pid=117699) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 15:24:56.527521 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-7652d9d9-1e32-4f08-8279-c2f8dd6c9ced tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 2be15600-c3a4-43ed-bf7d-0960eaf59eb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f921f75e-bbd1-4d99-ab1e-5cce2d895148',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 15:24:56.546334 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:24:56.575252 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-7652d9d9-1e32-4f08-8279-c2f8dd6c9ced tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.743472 May 24 15:24:56.575895 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 323/662] 10.222.0.45 () {60 vars in 1146 bytes} [Tue May 24 15:24:55 2022] POST /compute/v2.1/servers => generated 401 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 15:24:56.586047 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-9ebf86ce-5eff-4afd-a5ab-1887680ba5d7 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:56.586660 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-9ebf86ce-5eff-4afd-a5ab-1887680ba5d7 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 2be15600-c3a4-43ed-bf7d-0960eaf59eb1] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:56.692541 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-9ebf86ce-5eff-4afd-a5ab-1887680ba5d7 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:24:56.700174 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-9ebf86ce-5eff-4afd-a5ab-1887680ba5d7 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/2be15600-c3a4-43ed-bf7d-0960eaf59eb1" status: 200 len: 1238 microversion: 2.1 time: 0.117294 May 24 15:24:56.701072 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 340/663] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:24:56 2022] GET /compute/v2.1/servers/2be15600-c3a4-43ed-bf7d-0960eaf59eb1 => generated 1238 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:24:57.058753 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-1942539b-cff5-4db8-8d81-9c7c87078d1d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:57.059874 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-1942539b-cff5-4db8-8d81-9c7c87078d1d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:57.066886 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1942539b-cff5-4db8-8d81-9c7c87078d1d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:57.067365 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1942539b-cff5-4db8-8d81-9c7c87078d1d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:57.068329 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1942539b-cff5-4db8-8d81-9c7c87078d1d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:57.068769 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1942539b-cff5-4db8-8d81-9c7c87078d1d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:57.098954 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-1942539b-cff5-4db8-8d81-9c7c87078d1d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044762 May 24 15:24:57.099504 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 324/664] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:24:57 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:24:57.113780 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-df00f613-46ab-43f0-ba38-ab982f4f2756 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:57.114705 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-df00f613-46ab-43f0-ba38-ab982f4f2756 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:57.122459 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-df00f613-46ab-43f0-ba38-ab982f4f2756 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:57.122905 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-df00f613-46ab-43f0-ba38-ab982f4f2756 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:57.123660 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-df00f613-46ab-43f0-ba38-ab982f4f2756 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:57.124092 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-df00f613-46ab-43f0-ba38-ab982f4f2756 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:57.149093 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:24:57.154184 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-df00f613-46ab-43f0-ba38-ab982f4f2756 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044311 May 24 15:24:57.156941 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 341/665] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:24:57 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:24:57.159275 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-223b7ae0-ea7c-4493-9b4f-52040083d5f6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:57.160850 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-223b7ae0-ea7c-4493-9b4f-52040083d5f6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:57.166756 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-223b7ae0-ea7c-4493-9b4f-52040083d5f6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:57.167198 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-223b7ae0-ea7c-4493-9b4f-52040083d5f6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:57.167955 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-223b7ae0-ea7c-4493-9b4f-52040083d5f6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:57.168408 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-223b7ae0-ea7c-4493-9b4f-52040083d5f6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:57.196970 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-223b7ae0-ea7c-4493-9b4f-52040083d5f6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041597 May 24 15:24:57.197529 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 325/666] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:24:57 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:24:57.717255 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-fe8d9095-2b8e-4aaf-88d2-e0481e9eb792 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:57.717863 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-fe8d9095-2b8e-4aaf-88d2-e0481e9eb792 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 2be15600-c3a4-43ed-bf7d-0960eaf59eb1] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:57.724858 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fe8d9095-2b8e-4aaf-88d2-e0481e9eb792 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:57.725300 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fe8d9095-2b8e-4aaf-88d2-e0481e9eb792 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:57.726056 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fe8d9095-2b8e-4aaf-88d2-e0481e9eb792 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:57.726662 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fe8d9095-2b8e-4aaf-88d2-e0481e9eb792 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:57.791933 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-fe8d9095-2b8e-4aaf-88d2-e0481e9eb792 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:24:57.801370 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-fe8d9095-2b8e-4aaf-88d2-e0481e9eb792 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/2be15600-c3a4-43ed-bf7d-0960eaf59eb1" status: 200 len: 1298 microversion: 2.1 time: 0.087874 May 24 15:24:57.811636 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 342/667] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:24:57 2022] GET /compute/v2.1/servers/2be15600-c3a4-43ed-bf7d-0960eaf59eb1 => generated 1298 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:24:58.110982 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-9b47b621-43fd-47fc-a7da-7810a78b089d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:58.111895 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-9b47b621-43fd-47fc-a7da-7810a78b089d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:58.118313 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9b47b621-43fd-47fc-a7da-7810a78b089d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:58.118759 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9b47b621-43fd-47fc-a7da-7810a78b089d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:58.119524 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9b47b621-43fd-47fc-a7da-7810a78b089d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:58.119959 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9b47b621-43fd-47fc-a7da-7810a78b089d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:58.123551 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:24:58.149556 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-9b47b621-43fd-47fc-a7da-7810a78b089d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042770 May 24 15:24:58.150121 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 326/668] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:24:58 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:24:58.169324 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-83af8553-7f8f-4eb4-b00d-cd669d1dc2f0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:58.171087 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-83af8553-7f8f-4eb4-b00d-cd669d1dc2f0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:58.177688 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-83af8553-7f8f-4eb4-b00d-cd669d1dc2f0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:58.178142 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-83af8553-7f8f-4eb4-b00d-cd669d1dc2f0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:58.178946 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-83af8553-7f8f-4eb4-b00d-cd669d1dc2f0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:58.179383 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-83af8553-7f8f-4eb4-b00d-cd669d1dc2f0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:58.208794 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-83af8553-7f8f-4eb4-b00d-cd669d1dc2f0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045079 May 24 15:24:58.209284 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-400fe6c4-42f6-4987-8cc2-ee4540a82db3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:58.210436 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-400fe6c4-42f6-4987-8cc2-ee4540a82db3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:58.212790 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 343/669] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:24:58 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:24:58.217346 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-400fe6c4-42f6-4987-8cc2-ee4540a82db3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:58.217798 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-400fe6c4-42f6-4987-8cc2-ee4540a82db3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:58.218567 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-400fe6c4-42f6-4987-8cc2-ee4540a82db3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:58.219033 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-400fe6c4-42f6-4987-8cc2-ee4540a82db3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:58.249395 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-400fe6c4-42f6-4987-8cc2-ee4540a82db3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044195 May 24 15:24:58.249901 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 327/670] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:24:58 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:24:58.818950 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-4187e0e3-f608-454b-bf7a-35489a686756 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:58.819565 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-4187e0e3-f608-454b-bf7a-35489a686756 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 2be15600-c3a4-43ed-bf7d-0960eaf59eb1] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:58.826172 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4187e0e3-f608-454b-bf7a-35489a686756 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:58.826613 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4187e0e3-f608-454b-bf7a-35489a686756 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:58.827364 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4187e0e3-f608-454b-bf7a-35489a686756 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:58.827791 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4187e0e3-f608-454b-bf7a-35489a686756 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:59.026879 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-4187e0e3-f608-454b-bf7a-35489a686756 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:24:59.034383 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-4187e0e3-f608-454b-bf7a-35489a686756 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/2be15600-c3a4-43ed-bf7d-0960eaf59eb1" status: 200 len: 1363 microversion: 2.1 time: 0.219252 May 24 15:24:59.034956 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 344/671] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:24:58 2022] GET /compute/v2.1/servers/2be15600-c3a4-43ed-bf7d-0960eaf59eb1 => generated 1363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:24:59.161735 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-02cbe7e5-5b3f-4ec2-9f64-b0010daa74d9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:59.162664 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-02cbe7e5-5b3f-4ec2-9f64-b0010daa74d9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:59.171690 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-02cbe7e5-5b3f-4ec2-9f64-b0010daa74d9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:59.172145 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-02cbe7e5-5b3f-4ec2-9f64-b0010daa74d9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:59.172958 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-02cbe7e5-5b3f-4ec2-9f64-b0010daa74d9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:59.173397 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-02cbe7e5-5b3f-4ec2-9f64-b0010daa74d9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:59.205401 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-02cbe7e5-5b3f-4ec2-9f64-b0010daa74d9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047604 May 24 15:24:59.205992 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 328/672] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:24:59 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:24:59.221134 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-750696f9-a059-4dd7-82db-99c5880ff861 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:59.222243 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-750696f9-a059-4dd7-82db-99c5880ff861 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:59.229593 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-750696f9-a059-4dd7-82db-99c5880ff861 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:59.230118 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-750696f9-a059-4dd7-82db-99c5880ff861 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:59.231598 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-750696f9-a059-4dd7-82db-99c5880ff861 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:59.232207 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-750696f9-a059-4dd7-82db-99c5880ff861 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:59.260143 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-b914c2d6-d11e-4095-b641-8b0915a489cb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:24:59.262100 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-b914c2d6-d11e-4095-b641-8b0915a489cb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:24:59.264382 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-750696f9-a059-4dd7-82db-99c5880ff861 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047906 May 24 15:24:59.264958 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 345/673] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:24:59 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:24:59.273087 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b914c2d6-d11e-4095-b641-8b0915a489cb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:59.273541 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b914c2d6-d11e-4095-b641-8b0915a489cb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:59.274374 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b914c2d6-d11e-4095-b641-8b0915a489cb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:59.274755 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b914c2d6-d11e-4095-b641-8b0915a489cb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:59.288456 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [req-e2b4548a-e34f-49a4-9a67-0b9e16d211b6 req-4e8b566a-e149-439c-8f6b-2b121fb22f7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2be15600-c3a4-43ed-bf7d-0960eaf59eb1", "tag": "6ce1abc6-1178-4d13-b080-66a43a618f4e"}]} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:24:59.299463 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-e2b4548a-e34f-49a4-9a67-0b9e16d211b6 req-4e8b566a-e149-439c-8f6b-2b121fb22f7f service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:24:59.300253 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-e2b4548a-e34f-49a4-9a67-0b9e16d211b6 req-4e8b566a-e149-439c-8f6b-2b121fb22f7f service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:24:59.322723 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.compute.server_external_events [req-e2b4548a-e34f-49a4-9a67-0b9e16d211b6 req-4e8b566a-e149-439c-8f6b-2b121fb22f7f service nova] Creating event network-changed:6ce1abc6-1178-4d13-b080-66a43a618f4e for instance 2be15600-c3a4-43ed-bf7d-0960eaf59eb1 on hv-cinder-84315 May 24 15:24:59.330772 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [req-e2b4548a-e34f-49a4-9a67-0b9e16d211b6 req-4e8b566a-e149-439c-8f6b-2b121fb22f7f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046281 May 24 15:24:59.331594 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 346/674] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:24:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:24:59.336929 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-b914c2d6-d11e-4095-b641-8b0915a489cb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080861 May 24 15:24:59.337510 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 329/675] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:24:59 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:25:00.052680 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-ac22fd0c-61ad-4a28-a68a-55ce42762d7c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:00.053373 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-ac22fd0c-61ad-4a28-a68a-55ce42762d7c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 2be15600-c3a4-43ed-bf7d-0960eaf59eb1] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:00.059482 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ac22fd0c-61ad-4a28-a68a-55ce42762d7c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:00.059934 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ac22fd0c-61ad-4a28-a68a-55ce42762d7c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:00.060698 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ac22fd0c-61ad-4a28-a68a-55ce42762d7c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:00.061122 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ac22fd0c-61ad-4a28-a68a-55ce42762d7c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:00.186334 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ac22fd0c-61ad-4a28-a68a-55ce42762d7c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:25:00.193649 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-ac22fd0c-61ad-4a28-a68a-55ce42762d7c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/2be15600-c3a4-43ed-bf7d-0960eaf59eb1" status: 200 len: 1363 microversion: 2.1 time: 0.145218 May 24 15:25:00.194203 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 347/676] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:25:00 2022] GET /compute/v2.1/servers/2be15600-c3a4-43ed-bf7d-0960eaf59eb1 => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:25:00.217006 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-87af3d4e-4895-4d09-a8b3-bb455e27bcf5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:00.217951 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-87af3d4e-4895-4d09-a8b3-bb455e27bcf5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:00.224404 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-87af3d4e-4895-4d09-a8b3-bb455e27bcf5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:00.224859 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-87af3d4e-4895-4d09-a8b3-bb455e27bcf5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:00.225653 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-87af3d4e-4895-4d09-a8b3-bb455e27bcf5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:00.226089 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-87af3d4e-4895-4d09-a8b3-bb455e27bcf5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:00.254709 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-87af3d4e-4895-4d09-a8b3-bb455e27bcf5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041681 May 24 15:25:00.255267 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 330/677] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:25:00 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:25:00.276578 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-7c3696e7-da06-47b7-b42c-13953b8a6121 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:00.277518 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-7c3696e7-da06-47b7-b42c-13953b8a6121 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:00.283843 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7c3696e7-da06-47b7-b42c-13953b8a6121 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:00.284280 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7c3696e7-da06-47b7-b42c-13953b8a6121 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:00.285053 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7c3696e7-da06-47b7-b42c-13953b8a6121 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:00.285478 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7c3696e7-da06-47b7-b42c-13953b8a6121 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:00.313952 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-7c3696e7-da06-47b7-b42c-13953b8a6121 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041246 May 24 15:25:00.314429 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 348/678] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:00 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:00.348185 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-b6389328-b961-4025-8a2a-e3ca6c48fd54 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:00.349174 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-b6389328-b961-4025-8a2a-e3ca6c48fd54 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:00.355161 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b6389328-b961-4025-8a2a-e3ca6c48fd54 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:00.355600 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b6389328-b961-4025-8a2a-e3ca6c48fd54 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:00.356439 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b6389328-b961-4025-8a2a-e3ca6c48fd54 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:00.356873 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b6389328-b961-4025-8a2a-e3ca6c48fd54 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:00.385143 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-b6389328-b961-4025-8a2a-e3ca6c48fd54 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040854 May 24 15:25:00.385671 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 331/679] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:00 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:01.210780 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-96231080-72e3-4e9d-b2be-9415b65426bb tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:01.211387 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-96231080-72e3-4e9d-b2be-9415b65426bb tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 2be15600-c3a4-43ed-bf7d-0960eaf59eb1] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:01.217910 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-96231080-72e3-4e9d-b2be-9415b65426bb tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:01.218584 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-96231080-72e3-4e9d-b2be-9415b65426bb tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:01.219523 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-96231080-72e3-4e9d-b2be-9415b65426bb tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:01.220157 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-96231080-72e3-4e9d-b2be-9415b65426bb tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:01.267380 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-228d62bc-c277-4915-8487-77224ef79198 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:01.268708 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-228d62bc-c277-4915-8487-77224ef79198 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:01.275107 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-228d62bc-c277-4915-8487-77224ef79198 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:01.275564 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-228d62bc-c277-4915-8487-77224ef79198 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:01.276365 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-228d62bc-c277-4915-8487-77224ef79198 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:01.276804 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-228d62bc-c277-4915-8487-77224ef79198 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:01.306972 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-228d62bc-c277-4915-8487-77224ef79198 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044184 May 24 15:25:01.307534 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 332/680] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:25:01 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:25:01.325378 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-c2ebaa20-88d4-46ff-950e-ae402a39c450 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:01.326307 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-c2ebaa20-88d4-46ff-950e-ae402a39c450 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:01.332328 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c2ebaa20-88d4-46ff-950e-ae402a39c450 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:01.332772 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c2ebaa20-88d4-46ff-950e-ae402a39c450 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:01.333545 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c2ebaa20-88d4-46ff-950e-ae402a39c450 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:01.333983 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c2ebaa20-88d4-46ff-950e-ae402a39c450 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:01.364363 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-c2ebaa20-88d4-46ff-950e-ae402a39c450 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043181 May 24 15:25:01.365101 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 333/681] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:01 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:25:01.396525 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-b27cd6f0-77e0-422b-9690-feae5e9b7270 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:01.397454 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-b27cd6f0-77e0-422b-9690-feae5e9b7270 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:01.404535 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b27cd6f0-77e0-422b-9690-feae5e9b7270 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:01.404979 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b27cd6f0-77e0-422b-9690-feae5e9b7270 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:01.405802 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b27cd6f0-77e0-422b-9690-feae5e9b7270 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:01.406368 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b27cd6f0-77e0-422b-9690-feae5e9b7270 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:01.437076 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-b27cd6f0-77e0-422b-9690-feae5e9b7270 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044338 May 24 15:25:01.437565 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 334/682] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:01 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:25:01.641984 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-96231080-72e3-4e9d-b2be-9415b65426bb tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:25:01.650876 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-96231080-72e3-4e9d-b2be-9415b65426bb tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/2be15600-c3a4-43ed-bf7d-0960eaf59eb1" status: 200 len: 1363 microversion: 2.1 time: 0.443795 May 24 15:25:01.651451 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 349/683] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:25:01 2022] GET /compute/v2.1/servers/2be15600-c3a4-43ed-bf7d-0960eaf59eb1 => generated 1363 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:25:02.319202 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-5da0224f-b0d3-4291-93a0-433195106d4b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:02.320143 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-5da0224f-b0d3-4291-93a0-433195106d4b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:02.326693 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5da0224f-b0d3-4291-93a0-433195106d4b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:02.327074 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5da0224f-b0d3-4291-93a0-433195106d4b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:02.327821 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5da0224f-b0d3-4291-93a0-433195106d4b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:02.328243 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5da0224f-b0d3-4291-93a0-433195106d4b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:02.356162 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-5da0224f-b0d3-4291-93a0-433195106d4b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040934 May 24 15:25:02.356718 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 335/684] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:25:02 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:25:02.375598 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-6c28a9c3-c3c4-4127-8688-64df6086f7bd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:02.376555 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-6c28a9c3-c3c4-4127-8688-64df6086f7bd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:02.383026 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6c28a9c3-c3c4-4127-8688-64df6086f7bd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:02.383474 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6c28a9c3-c3c4-4127-8688-64df6086f7bd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:02.384227 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6c28a9c3-c3c4-4127-8688-64df6086f7bd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:02.384683 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6c28a9c3-c3c4-4127-8688-64df6086f7bd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:02.413208 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-6c28a9c3-c3c4-4127-8688-64df6086f7bd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042213 May 24 15:25:02.413751 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 350/685] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:02 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:02.448973 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f05e3eca-e9ad-400a-b30e-24aa3b933407 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:02.449884 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f05e3eca-e9ad-400a-b30e-24aa3b933407 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:02.455827 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f05e3eca-e9ad-400a-b30e-24aa3b933407 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:02.456262 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f05e3eca-e9ad-400a-b30e-24aa3b933407 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:02.457033 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f05e3eca-e9ad-400a-b30e-24aa3b933407 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:02.457455 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f05e3eca-e9ad-400a-b30e-24aa3b933407 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:02.486622 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f05e3eca-e9ad-400a-b30e-24aa3b933407 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042051 May 24 15:25:02.487155 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 336/686] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:02 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:02.666675 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e096e3dc-ab31-4711-aa87-836431f4974e tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:02.667281 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e096e3dc-ab31-4711-aa87-836431f4974e tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 2be15600-c3a4-43ed-bf7d-0960eaf59eb1] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:02.673886 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e096e3dc-ab31-4711-aa87-836431f4974e tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:02.674326 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e096e3dc-ab31-4711-aa87-836431f4974e tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:02.675099 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e096e3dc-ab31-4711-aa87-836431f4974e tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:02.675527 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e096e3dc-ab31-4711-aa87-836431f4974e tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:02.798265 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e096e3dc-ab31-4711-aa87-836431f4974e tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:25:02.805600 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e096e3dc-ab31-4711-aa87-836431f4974e tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/2be15600-c3a4-43ed-bf7d-0960eaf59eb1" status: 200 len: 1363 microversion: 2.1 time: 0.142671 May 24 15:25:02.806155 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 351/687] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:25:02 2022] GET /compute/v2.1/servers/2be15600-c3a4-43ed-bf7d-0960eaf59eb1 => generated 1363 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:25:03.176174 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [req-e3da06b5-b6f3-4701-a044-26f8cf7c7d84 req-9f7a78a7-744a-41ab-aa54-a506d851065b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2be15600-c3a4-43ed-bf7d-0960eaf59eb1", "name": "network-vif-plugged", "status": "completed", "tag": "6ce1abc6-1178-4d13-b080-66a43a618f4e"}]} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:25:03.186142 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-e3da06b5-b6f3-4701-a044-26f8cf7c7d84 req-9f7a78a7-744a-41ab-aa54-a506d851065b service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:03.186709 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-e3da06b5-b6f3-4701-a044-26f8cf7c7d84 req-9f7a78a7-744a-41ab-aa54-a506d851065b service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:03.198000 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.compute.server_external_events [req-e3da06b5-b6f3-4701-a044-26f8cf7c7d84 req-9f7a78a7-744a-41ab-aa54-a506d851065b service nova] Creating event network-vif-plugged:6ce1abc6-1178-4d13-b080-66a43a618f4e for instance 2be15600-c3a4-43ed-bf7d-0960eaf59eb1 on hv-cinder-84315 May 24 15:25:03.203493 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [req-e3da06b5-b6f3-4701-a044-26f8cf7c7d84 req-9f7a78a7-744a-41ab-aa54-a506d851065b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031097 May 24 15:25:03.204088 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 337/688] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:03.367205 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-a9aebb27-639d-45e5-b5e0-dd4ec8b140fc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:03.368065 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-a9aebb27-639d-45e5-b5e0-dd4ec8b140fc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:03.374862 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a9aebb27-639d-45e5-b5e0-dd4ec8b140fc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:03.375311 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a9aebb27-639d-45e5-b5e0-dd4ec8b140fc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:03.376117 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a9aebb27-639d-45e5-b5e0-dd4ec8b140fc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:03.376579 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a9aebb27-639d-45e5-b5e0-dd4ec8b140fc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:03.408235 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-a9aebb27-639d-45e5-b5e0-dd4ec8b140fc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045018 May 24 15:25:03.408853 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 352/689] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:25:03 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:25:03.425550 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d3196bbf-4a3a-43f0-abcc-cbed7d6c6dca tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:03.426652 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d3196bbf-4a3a-43f0-abcc-cbed7d6c6dca tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:03.432929 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d3196bbf-4a3a-43f0-abcc-cbed7d6c6dca tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:03.433886 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d3196bbf-4a3a-43f0-abcc-cbed7d6c6dca tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:03.434653 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d3196bbf-4a3a-43f0-abcc-cbed7d6c6dca tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:03.435092 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d3196bbf-4a3a-43f0-abcc-cbed7d6c6dca tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:03.465894 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d3196bbf-4a3a-43f0-abcc-cbed7d6c6dca tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045113 May 24 15:25:03.466560 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 338/690] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:03 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:03.498731 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-f84a72de-7e25-4f89-9612-77514d68d204 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:03.499646 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-f84a72de-7e25-4f89-9612-77514d68d204 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:03.505679 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f84a72de-7e25-4f89-9612-77514d68d204 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:03.506127 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f84a72de-7e25-4f89-9612-77514d68d204 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:03.506881 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f84a72de-7e25-4f89-9612-77514d68d204 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:03.507316 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f84a72de-7e25-4f89-9612-77514d68d204 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:03.537358 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-f84a72de-7e25-4f89-9612-77514d68d204 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043105 May 24 15:25:03.537904 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 353/691] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:03 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:03.822169 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-9071a77d-b386-4060-92a4-b7bd0d77beaf tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:03.822777 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-9071a77d-b386-4060-92a4-b7bd0d77beaf tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 2be15600-c3a4-43ed-bf7d-0960eaf59eb1] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:03.828778 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9071a77d-b386-4060-92a4-b7bd0d77beaf tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:03.829220 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9071a77d-b386-4060-92a4-b7bd0d77beaf tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:03.830001 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9071a77d-b386-4060-92a4-b7bd0d77beaf tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:03.830428 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9071a77d-b386-4060-92a4-b7bd0d77beaf tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:03.961144 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-9071a77d-b386-4060-92a4-b7bd0d77beaf tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:25:03.969081 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-9071a77d-b386-4060-92a4-b7bd0d77beaf tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/2be15600-c3a4-43ed-bf7d-0960eaf59eb1" status: 200 len: 1363 microversion: 2.1 time: 0.150742 May 24 15:25:03.969648 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 339/692] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:25:03 2022] GET /compute/v2.1/servers/2be15600-c3a4-43ed-bf7d-0960eaf59eb1 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:25:04.419064 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d7d31bda-f861-43eb-9fa7-fc3a09ac6880 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:04.419979 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d7d31bda-f861-43eb-9fa7-fc3a09ac6880 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:04.426463 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d7d31bda-f861-43eb-9fa7-fc3a09ac6880 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:04.426910 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d7d31bda-f861-43eb-9fa7-fc3a09ac6880 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:04.427663 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d7d31bda-f861-43eb-9fa7-fc3a09ac6880 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:04.428094 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d7d31bda-f861-43eb-9fa7-fc3a09ac6880 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:04.456263 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d7d31bda-f861-43eb-9fa7-fc3a09ac6880 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041160 May 24 15:25:04.456838 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 354/693] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:25:04 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:25:04.531094 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-81a7931a-6dd4-4ea9-87ae-eb0f21dcaa50 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:04.532031 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-81a7931a-6dd4-4ea9-87ae-eb0f21dcaa50 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:04.538060 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-81a7931a-6dd4-4ea9-87ae-eb0f21dcaa50 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:04.538508 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-81a7931a-6dd4-4ea9-87ae-eb0f21dcaa50 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:04.539260 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-81a7931a-6dd4-4ea9-87ae-eb0f21dcaa50 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:04.539694 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-81a7931a-6dd4-4ea9-87ae-eb0f21dcaa50 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:04.548628 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-daf2224e-5aad-4755-b81f-ac1437409557 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:04.549549 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-daf2224e-5aad-4755-b81f-ac1437409557 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:04.555430 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-daf2224e-5aad-4755-b81f-ac1437409557 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:04.555873 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-daf2224e-5aad-4755-b81f-ac1437409557 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:04.556655 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-daf2224e-5aad-4755-b81f-ac1437409557 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:04.557088 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-daf2224e-5aad-4755-b81f-ac1437409557 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:04.568231 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-81a7931a-6dd4-4ea9-87ae-eb0f21dcaa50 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094766 May 24 15:25:04.568832 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 340/694] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:04 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:04.585403 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-daf2224e-5aad-4755-b81f-ac1437409557 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040560 May 24 15:25:04.585948 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 355/695] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:04 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:25:04.985839 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-ffac8992-692d-429c-8e06-a7d1e85e06fd tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:04.986479 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-ffac8992-692d-429c-8e06-a7d1e85e06fd tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 2be15600-c3a4-43ed-bf7d-0960eaf59eb1] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:04.992410 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ffac8992-692d-429c-8e06-a7d1e85e06fd tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:04.992873 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ffac8992-692d-429c-8e06-a7d1e85e06fd tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:04.993595 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ffac8992-692d-429c-8e06-a7d1e85e06fd tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:04.994021 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ffac8992-692d-429c-8e06-a7d1e85e06fd tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:05.120236 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-ffac8992-692d-429c-8e06-a7d1e85e06fd tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:25:05.128247 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-ffac8992-692d-429c-8e06-a7d1e85e06fd tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/2be15600-c3a4-43ed-bf7d-0960eaf59eb1" status: 200 len: 1363 microversion: 2.1 time: 0.146516 May 24 15:25:05.128832 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 341/696] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:25:04 2022] GET /compute/v2.1/servers/2be15600-c3a4-43ed-bf7d-0960eaf59eb1 => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:25:05.468269 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-69237c24-2bfd-4877-b4b3-327ecfda99f9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:05.469212 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-69237c24-2bfd-4877-b4b3-327ecfda99f9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:05.475515 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-69237c24-2bfd-4877-b4b3-327ecfda99f9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:05.475961 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-69237c24-2bfd-4877-b4b3-327ecfda99f9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:05.476739 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-69237c24-2bfd-4877-b4b3-327ecfda99f9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:05.477171 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-69237c24-2bfd-4877-b4b3-327ecfda99f9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:05.506313 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-69237c24-2bfd-4877-b4b3-327ecfda99f9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042417 May 24 15:25:05.506883 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 356/697] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:25:05 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:25:05.579796 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e215d32c-28e3-4963-af31-60d9ba8e7564 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:05.580735 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-e215d32c-28e3-4963-af31-60d9ba8e7564 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:05.587266 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e215d32c-28e3-4963-af31-60d9ba8e7564 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:05.587707 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e215d32c-28e3-4963-af31-60d9ba8e7564 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:05.588528 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e215d32c-28e3-4963-af31-60d9ba8e7564 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:05.588956 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e215d32c-28e3-4963-af31-60d9ba8e7564 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:05.596761 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-b2e23fac-5634-4452-b97e-88e2afb85532 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:05.597770 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-b2e23fac-5634-4452-b97e-88e2afb85532 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:05.599742 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:25:05.605861 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b2e23fac-5634-4452-b97e-88e2afb85532 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:05.606314 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b2e23fac-5634-4452-b97e-88e2afb85532 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:05.607083 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b2e23fac-5634-4452-b97e-88e2afb85532 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:05.607781 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b2e23fac-5634-4452-b97e-88e2afb85532 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:05.619004 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-e215d32c-28e3-4963-af31-60d9ba8e7564 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043130 May 24 15:25:05.619775 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 342/698] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:05 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:05.637447 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-b2e23fac-5634-4452-b97e-88e2afb85532 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044532 May 24 15:25:05.637995 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 357/699] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:05 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:25:06.144745 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-c409a160-b083-448c-be55-5bd02ee5a099 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:06.145421 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-c409a160-b083-448c-be55-5bd02ee5a099 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 2be15600-c3a4-43ed-bf7d-0960eaf59eb1] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:06.151376 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c409a160-b083-448c-be55-5bd02ee5a099 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:06.151817 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c409a160-b083-448c-be55-5bd02ee5a099 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:06.152649 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c409a160-b083-448c-be55-5bd02ee5a099 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:06.153082 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c409a160-b083-448c-be55-5bd02ee5a099 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:06.171773 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:25:06.285204 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-c409a160-b083-448c-be55-5bd02ee5a099 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:25:06.292543 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-c409a160-b083-448c-be55-5bd02ee5a099 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/2be15600-c3a4-43ed-bf7d-0960eaf59eb1" status: 200 len: 1548 microversion: 2.1 time: 0.151575 May 24 15:25:06.293113 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 343/700] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:25:06 2022] GET /compute/v2.1/servers/2be15600-c3a4-43ed-bf7d-0960eaf59eb1 => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:25:06.308948 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-45191070-bc5f-471f-93b5-8f05bf9eca1a tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:06.309437 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-45191070-bc5f-471f-93b5-8f05bf9eca1a tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 2be15600-c3a4-43ed-bf7d-0960eaf59eb1] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:06.315339 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-45191070-bc5f-471f-93b5-8f05bf9eca1a tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:06.315812 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-45191070-bc5f-471f-93b5-8f05bf9eca1a tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:06.316721 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-45191070-bc5f-471f-93b5-8f05bf9eca1a tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:06.317148 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-45191070-bc5f-471f-93b5-8f05bf9eca1a tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:06.423079 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-45191070-bc5f-471f-93b5-8f05bf9eca1a tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/2be15600-c3a4-43ed-bf7d-0960eaf59eb1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.118339 May 24 15:25:06.423640 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 358/701] 10.222.0.45 () {58 vars in 1274 bytes} [Tue May 24 15:25:06 2022] GET /compute/v2.1/servers/2be15600-c3a4-43ed-bf7d-0960eaf59eb1/os-interface => generated 284 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:06.518718 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d0f24507-85b4-483c-b034-357eb06b25c7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:06.519641 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d0f24507-85b4-483c-b034-357eb06b25c7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:06.521625 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell0:SELECT=2 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:25:06.522430 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell0:SELECT=10 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:25:06.528815 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d0f24507-85b4-483c-b034-357eb06b25c7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:06.529258 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d0f24507-85b4-483c-b034-357eb06b25c7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:06.530025 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d0f24507-85b4-483c-b034-357eb06b25c7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:06.530451 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d0f24507-85b4-483c-b034-357eb06b25c7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:06.562188 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d0f24507-85b4-483c-b034-357eb06b25c7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047455 May 24 15:25:06.563416 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 344/702] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:25:06 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:25:06.631045 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-b6b968d1-90fd-4636-8fb1-acbc6beb8d2c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:06.632615 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-b6b968d1-90fd-4636-8fb1-acbc6beb8d2c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:06.638974 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b6b968d1-90fd-4636-8fb1-acbc6beb8d2c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:06.639504 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b6b968d1-90fd-4636-8fb1-acbc6beb8d2c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:06.640412 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b6b968d1-90fd-4636-8fb1-acbc6beb8d2c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:06.640917 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b6b968d1-90fd-4636-8fb1-acbc6beb8d2c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:06.648793 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-3bd4fc35-3275-4404-937e-b5e74a63c9b9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:06.650984 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-3bd4fc35-3275-4404-937e-b5e74a63c9b9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:06.658389 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3bd4fc35-3275-4404-937e-b5e74a63c9b9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:06.659820 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3bd4fc35-3275-4404-937e-b5e74a63c9b9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:06.660811 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3bd4fc35-3275-4404-937e-b5e74a63c9b9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:06.661545 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3bd4fc35-3275-4404-937e-b5e74a63c9b9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:06.664938 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:25:06.677521 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-b6b968d1-90fd-4636-8fb1-acbc6beb8d2c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050805 May 24 15:25:06.681566 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 359/703] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:06 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:06.701075 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-3bd4fc35-3275-4404-937e-b5e74a63c9b9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055917 May 24 15:25:06.705607 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 345/704] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:06 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:25:07.347279 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [req-4ce600fc-001c-4e21-9e4d-d04478b3c814 req-202e4f39-1efb-4044-bbad-cad7211516e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2be15600-c3a4-43ed-bf7d-0960eaf59eb1", "tag": "6ce1abc6-1178-4d13-b080-66a43a618f4e"}]} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:25:07.351710 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell0:SELECT=2 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:25:07.356137 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-4ce600fc-001c-4e21-9e4d-d04478b3c814 req-202e4f39-1efb-4044-bbad-cad7211516e2 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:07.356609 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-4ce600fc-001c-4e21-9e4d-d04478b3c814 req-202e4f39-1efb-4044-bbad-cad7211516e2 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:07.367637 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.compute.server_external_events [req-4ce600fc-001c-4e21-9e4d-d04478b3c814 req-202e4f39-1efb-4044-bbad-cad7211516e2 service nova] Creating event network-changed:6ce1abc6-1178-4d13-b080-66a43a618f4e for instance 2be15600-c3a4-43ed-bf7d-0960eaf59eb1 on hv-cinder-84315 May 24 15:25:07.372696 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [req-4ce600fc-001c-4e21-9e4d-d04478b3c814 req-202e4f39-1efb-4044-bbad-cad7211516e2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029034 May 24 15:25:07.373288 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 360/705] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:25:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:07.574396 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-af542345-85ee-4c3e-a8e6-fe9e10c91fe1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:07.575320 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-af542345-85ee-4c3e-a8e6-fe9e10c91fe1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:07.581230 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-af542345-85ee-4c3e-a8e6-fe9e10c91fe1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:07.581680 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-af542345-85ee-4c3e-a8e6-fe9e10c91fe1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:07.582439 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-af542345-85ee-4c3e-a8e6-fe9e10c91fe1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:07.582871 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-af542345-85ee-4c3e-a8e6-fe9e10c91fe1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:07.611730 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-af542345-85ee-4c3e-a8e6-fe9e10c91fe1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041455 May 24 15:25:07.615493 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 346/706] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:25:07 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:25:07.690194 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-6393c32c-7e43-4861-bf14-469d6cc67cd2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:07.691379 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-6393c32c-7e43-4861-bf14-469d6cc67cd2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:07.697761 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6393c32c-7e43-4861-bf14-469d6cc67cd2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:07.698205 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6393c32c-7e43-4861-bf14-469d6cc67cd2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:07.698966 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6393c32c-7e43-4861-bf14-469d6cc67cd2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:07.699398 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6393c32c-7e43-4861-bf14-469d6cc67cd2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:07.712675 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f129343a-76a9-4d70-819a-3c58b85fe56e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:07.713604 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f129343a-76a9-4d70-819a-3c58b85fe56e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:07.720186 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f129343a-76a9-4d70-819a-3c58b85fe56e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:07.720659 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f129343a-76a9-4d70-819a-3c58b85fe56e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:07.721424 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f129343a-76a9-4d70-819a-3c58b85fe56e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:07.721845 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f129343a-76a9-4d70-819a-3c58b85fe56e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:07.732950 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-6393c32c-7e43-4861-bf14-469d6cc67cd2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047284 May 24 15:25:07.737572 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 361/707] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:07 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:07.754373 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f129343a-76a9-4d70-819a-3c58b85fe56e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043677 May 24 15:25:07.754373 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 347/708] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:07 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:25:08.623558 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-5a1d1c76-cc1b-4862-9ba0-8d2abfd24052 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:08.624501 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-5a1d1c76-cc1b-4862-9ba0-8d2abfd24052 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:08.630479 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5a1d1c76-cc1b-4862-9ba0-8d2abfd24052 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:08.630925 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5a1d1c76-cc1b-4862-9ba0-8d2abfd24052 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:08.631675 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5a1d1c76-cc1b-4862-9ba0-8d2abfd24052 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:08.632105 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5a1d1c76-cc1b-4862-9ba0-8d2abfd24052 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:08.660585 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-5a1d1c76-cc1b-4862-9ba0-8d2abfd24052 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041496 May 24 15:25:08.661126 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 362/709] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:25:08 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:25:08.744274 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a337ce74-a98d-4566-ab52-d602bc206a46 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:08.745204 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a337ce74-a98d-4566-ab52-d602bc206a46 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:08.752117 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a337ce74-a98d-4566-ab52-d602bc206a46 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:08.752595 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a337ce74-a98d-4566-ab52-d602bc206a46 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:08.753345 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a337ce74-a98d-4566-ab52-d602bc206a46 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:08.753772 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a337ce74-a98d-4566-ab52-d602bc206a46 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:08.763611 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-9be94088-30fd-4d19-8928-547e46c1524d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:08.764491 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-9be94088-30fd-4d19-8928-547e46c1524d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:08.770999 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9be94088-30fd-4d19-8928-547e46c1524d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:08.771452 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9be94088-30fd-4d19-8928-547e46c1524d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:08.772522 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9be94088-30fd-4d19-8928-547e46c1524d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:08.772963 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9be94088-30fd-4d19-8928-547e46c1524d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:08.783410 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a337ce74-a98d-4566-ab52-d602bc206a46 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043087 May 24 15:25:08.783975 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 348/710] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:08 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:08.802380 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-9be94088-30fd-4d19-8928-547e46c1524d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043361 May 24 15:25:08.802912 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 363/711] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:08 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:25:09.671297 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-705b09f9-2e3d-4521-8209-f8f8612cd289 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:09.672129 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-705b09f9-2e3d-4521-8209-f8f8612cd289 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:09.677958 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-705b09f9-2e3d-4521-8209-f8f8612cd289 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:09.678400 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-705b09f9-2e3d-4521-8209-f8f8612cd289 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:09.679149 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-705b09f9-2e3d-4521-8209-f8f8612cd289 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:09.679579 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-705b09f9-2e3d-4521-8209-f8f8612cd289 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:09.711828 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-705b09f9-2e3d-4521-8209-f8f8612cd289 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044519 May 24 15:25:09.712390 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 349/712] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:25:09 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:25:09.794662 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-db43e153-e706-43ef-811b-028f12b66cf5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:09.795575 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-db43e153-e706-43ef-811b-028f12b66cf5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:09.802549 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-db43e153-e706-43ef-811b-028f12b66cf5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:09.802983 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-db43e153-e706-43ef-811b-028f12b66cf5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:09.803764 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-db43e153-e706-43ef-811b-028f12b66cf5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:09.804193 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-db43e153-e706-43ef-811b-028f12b66cf5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:09.813408 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-9bc9acbc-4ff2-43f3-911a-9ff4c6c96466 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:09.814308 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-9bc9acbc-4ff2-43f3-911a-9ff4c6c96466 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:09.820771 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9bc9acbc-4ff2-43f3-911a-9ff4c6c96466 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:09.821222 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9bc9acbc-4ff2-43f3-911a-9ff4c6c96466 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:09.821985 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9bc9acbc-4ff2-43f3-911a-9ff4c6c96466 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:09.822416 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9bc9acbc-4ff2-43f3-911a-9ff4c6c96466 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:09.833842 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-db43e153-e706-43ef-811b-028f12b66cf5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043109 May 24 15:25:09.834400 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 364/713] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:09 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:09.851534 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-9bc9acbc-4ff2-43f3-911a-9ff4c6c96466 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042097 May 24 15:25:09.852082 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 350/714] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:09 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:25:10.076138 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 15:25:10.076372 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Tue May 24 15:25:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 15:25:10.724430 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-77649d39-da17-49b5-8c02-ed48d4123735 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:10.725346 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-77649d39-da17-49b5-8c02-ed48d4123735 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:10.731911 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-77649d39-da17-49b5-8c02-ed48d4123735 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:10.732377 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-77649d39-da17-49b5-8c02-ed48d4123735 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:10.733777 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-77649d39-da17-49b5-8c02-ed48d4123735 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:10.734534 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-77649d39-da17-49b5-8c02-ed48d4123735 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:10.764738 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-77649d39-da17-49b5-8c02-ed48d4123735 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044267 May 24 15:25:10.765282 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 365/715] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:25:10 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:25:10.845705 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-43e07d89-1e0a-4fff-bbf0-3ca0d8e7fc1e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:10.846661 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-43e07d89-1e0a-4fff-bbf0-3ca0d8e7fc1e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:10.853139 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-43e07d89-1e0a-4fff-bbf0-3ca0d8e7fc1e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:10.853590 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-43e07d89-1e0a-4fff-bbf0-3ca0d8e7fc1e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:10.854364 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-43e07d89-1e0a-4fff-bbf0-3ca0d8e7fc1e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:10.854798 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-43e07d89-1e0a-4fff-bbf0-3ca0d8e7fc1e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:10.864151 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-baf8355d-69ec-46be-b68c-6a78dda22a29 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:10.865237 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-baf8355d-69ec-46be-b68c-6a78dda22a29 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:10.871657 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-baf8355d-69ec-46be-b68c-6a78dda22a29 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:10.872104 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-baf8355d-69ec-46be-b68c-6a78dda22a29 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:10.872895 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-baf8355d-69ec-46be-b68c-6a78dda22a29 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:10.873325 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-baf8355d-69ec-46be-b68c-6a78dda22a29 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:10.884597 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-43e07d89-1e0a-4fff-bbf0-3ca0d8e7fc1e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042796 May 24 15:25:10.888557 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 351/716] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:10 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:10.902895 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-baf8355d-69ec-46be-b68c-6a78dda22a29 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043389 May 24 15:25:10.903426 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 366/717] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:10 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:11.776395 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-2ace46e5-a130-4454-95a0-0217712c7c7a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:11.777931 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-2ace46e5-a130-4454-95a0-0217712c7c7a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:11.783937 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2ace46e5-a130-4454-95a0-0217712c7c7a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:11.784415 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2ace46e5-a130-4454-95a0-0217712c7c7a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:11.785172 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2ace46e5-a130-4454-95a0-0217712c7c7a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:11.785598 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2ace46e5-a130-4454-95a0-0217712c7c7a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:11.813536 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-2ace46e5-a130-4454-95a0-0217712c7c7a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041177 May 24 15:25:11.814069 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 352/718] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:25:11 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:25:11.896020 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d8fb55d4-3a38-454a-8916-a57a0e7ee9d7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:11.897391 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d8fb55d4-3a38-454a-8916-a57a0e7ee9d7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:11.906368 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d8fb55d4-3a38-454a-8916-a57a0e7ee9d7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:11.906813 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d8fb55d4-3a38-454a-8916-a57a0e7ee9d7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:11.907580 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d8fb55d4-3a38-454a-8916-a57a0e7ee9d7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:11.908011 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d8fb55d4-3a38-454a-8916-a57a0e7ee9d7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:11.914352 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a5a3275b-75fe-43c3-8732-0b0772479276 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:11.915269 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a5a3275b-75fe-43c3-8732-0b0772479276 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:11.921705 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a5a3275b-75fe-43c3-8732-0b0772479276 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:11.922147 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a5a3275b-75fe-43c3-8732-0b0772479276 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:11.922899 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a5a3275b-75fe-43c3-8732-0b0772479276 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:11.923324 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a5a3275b-75fe-43c3-8732-0b0772479276 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:11.936833 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d8fb55d4-3a38-454a-8916-a57a0e7ee9d7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044648 May 24 15:25:11.937495 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 367/719] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:11 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:11.952108 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a5a3275b-75fe-43c3-8732-0b0772479276 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041576 May 24 15:25:11.952688 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 353/720] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:11 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:25:12.825334 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-59562f56-a809-4545-941c-1bf72ef42134 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:12.826193 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-59562f56-a809-4545-941c-1bf72ef42134 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:12.832165 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-59562f56-a809-4545-941c-1bf72ef42134 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:12.832638 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-59562f56-a809-4545-941c-1bf72ef42134 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:12.833387 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-59562f56-a809-4545-941c-1bf72ef42134 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:12.833812 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-59562f56-a809-4545-941c-1bf72ef42134 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:12.867730 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-59562f56-a809-4545-941c-1bf72ef42134 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046524 May 24 15:25:12.868293 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 368/721] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:25:12 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 15:25:12.948366 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f668b7bf-7054-4e69-9df0-81b7620ae3c6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:12.949285 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f668b7bf-7054-4e69-9df0-81b7620ae3c6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:12.955603 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f668b7bf-7054-4e69-9df0-81b7620ae3c6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:12.956042 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f668b7bf-7054-4e69-9df0-81b7620ae3c6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:12.956836 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f668b7bf-7054-4e69-9df0-81b7620ae3c6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:12.957266 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f668b7bf-7054-4e69-9df0-81b7620ae3c6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:12.962866 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-3049fe2c-38a5-4992-b6b3-162255c54a15 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:12.963810 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-3049fe2c-38a5-4992-b6b3-162255c54a15 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:12.970749 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3049fe2c-38a5-4992-b6b3-162255c54a15 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:12.971196 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3049fe2c-38a5-4992-b6b3-162255c54a15 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:12.971955 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3049fe2c-38a5-4992-b6b3-162255c54a15 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:12.972421 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3049fe2c-38a5-4992-b6b3-162255c54a15 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:12.987005 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f668b7bf-7054-4e69-9df0-81b7620ae3c6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042471 May 24 15:25:12.987563 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 354/722] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:12 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:13.001380 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-3049fe2c-38a5-4992-b6b3-162255c54a15 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042337 May 24 15:25:13.001944 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 369/723] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:12 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:25:13.883468 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-4c51c9ef-2b90-4a1e-af4b-ef38c19021f7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:13.884440 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-4c51c9ef-2b90-4a1e-af4b-ef38c19021f7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:13.891340 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4c51c9ef-2b90-4a1e-af4b-ef38c19021f7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:13.891790 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4c51c9ef-2b90-4a1e-af4b-ef38c19021f7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:13.893208 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4c51c9ef-2b90-4a1e-af4b-ef38c19021f7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:13.893644 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4c51c9ef-2b90-4a1e-af4b-ef38c19021f7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:13.922613 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-4c51c9ef-2b90-4a1e-af4b-ef38c19021f7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047380 May 24 15:25:13.923163 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 355/724] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:25:13 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:25:13.998983 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-ed2bb95c-1834-44fc-bb3e-39ba2430469b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:13.999910 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-ed2bb95c-1834-44fc-bb3e-39ba2430469b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:14.006441 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ed2bb95c-1834-44fc-bb3e-39ba2430469b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:14.006891 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ed2bb95c-1834-44fc-bb3e-39ba2430469b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:14.007656 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ed2bb95c-1834-44fc-bb3e-39ba2430469b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:14.008088 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ed2bb95c-1834-44fc-bb3e-39ba2430469b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:14.013142 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-27cf7c2b-5332-4bab-9620-2cb1a06e96ff tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:14.014208 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-27cf7c2b-5332-4bab-9620-2cb1a06e96ff tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:14.020633 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-27cf7c2b-5332-4bab-9620-2cb1a06e96ff tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:14.021072 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-27cf7c2b-5332-4bab-9620-2cb1a06e96ff tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:14.021830 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-27cf7c2b-5332-4bab-9620-2cb1a06e96ff tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:14.022261 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-27cf7c2b-5332-4bab-9620-2cb1a06e96ff tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:14.038528 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-ed2bb95c-1834-44fc-bb3e-39ba2430469b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043904 May 24 15:25:14.039113 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 370/725] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:13 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:14.051326 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-27cf7c2b-5332-4bab-9620-2cb1a06e96ff tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042587 May 24 15:25:14.051872 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 356/726] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:14 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:25:14.933568 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-8dd8f95a-13f8-4e14-a8a7-41750b323fb2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:14.934919 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-8dd8f95a-13f8-4e14-a8a7-41750b323fb2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:14.941555 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8dd8f95a-13f8-4e14-a8a7-41750b323fb2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:14.942001 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8dd8f95a-13f8-4e14-a8a7-41750b323fb2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:14.942761 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8dd8f95a-13f8-4e14-a8a7-41750b323fb2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:14.943192 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8dd8f95a-13f8-4e14-a8a7-41750b323fb2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:14.972618 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-8dd8f95a-13f8-4e14-a8a7-41750b323fb2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043472 May 24 15:25:14.973152 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 371/727] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:25:14 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:25:15.050241 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d5db09dd-928a-4889-b3ce-846223855a1d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:15.051173 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d5db09dd-928a-4889-b3ce-846223855a1d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:15.057873 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d5db09dd-928a-4889-b3ce-846223855a1d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:15.058326 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d5db09dd-928a-4889-b3ce-846223855a1d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:15.059117 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d5db09dd-928a-4889-b3ce-846223855a1d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:15.059547 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d5db09dd-928a-4889-b3ce-846223855a1d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:15.062866 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-62e9c2fc-3bf1-4c0c-b62c-8ba44b77537b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:15.063779 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-62e9c2fc-3bf1-4c0c-b62c-8ba44b77537b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:15.070330 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-62e9c2fc-3bf1-4c0c-b62c-8ba44b77537b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:15.070999 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-62e9c2fc-3bf1-4c0c-b62c-8ba44b77537b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:15.071531 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-62e9c2fc-3bf1-4c0c-b62c-8ba44b77537b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:15.071960 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-62e9c2fc-3bf1-4c0c-b62c-8ba44b77537b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:15.090943 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d5db09dd-928a-4889-b3ce-846223855a1d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044564 May 24 15:25:15.091510 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 357/728] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:15 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:15.101748 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-62e9c2fc-3bf1-4c0c-b62c-8ba44b77537b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042756 May 24 15:25:15.102292 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 372/729] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:15 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:25:15.983477 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-66526afe-fa3b-4c3c-8172-017f7ce44c78 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:15.984432 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-66526afe-fa3b-4c3c-8172-017f7ce44c78 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:15.991627 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-66526afe-fa3b-4c3c-8172-017f7ce44c78 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:15.991627 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-66526afe-fa3b-4c3c-8172-017f7ce44c78 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:15.991867 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-66526afe-fa3b-4c3c-8172-017f7ce44c78 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:15.992093 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-66526afe-fa3b-4c3c-8172-017f7ce44c78 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:16.021191 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-66526afe-fa3b-4c3c-8172-017f7ce44c78 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041887 May 24 15:25:16.021741 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 358/730] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:25:15 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:25:16.101579 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-f576ee95-5a8a-4d8f-b364-3b810122e6c4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:16.102491 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-f576ee95-5a8a-4d8f-b364-3b810122e6c4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:16.109236 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f576ee95-5a8a-4d8f-b364-3b810122e6c4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:16.109681 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f576ee95-5a8a-4d8f-b364-3b810122e6c4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:16.110432 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f576ee95-5a8a-4d8f-b364-3b810122e6c4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:16.110862 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f576ee95-5a8a-4d8f-b364-3b810122e6c4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:16.113486 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d9070833-e4bc-46c7-bdb8-f06fed64b551 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:16.114434 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d9070833-e4bc-46c7-bdb8-f06fed64b551 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:16.121471 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d9070833-e4bc-46c7-bdb8-f06fed64b551 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:16.121920 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d9070833-e4bc-46c7-bdb8-f06fed64b551 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:16.122677 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d9070833-e4bc-46c7-bdb8-f06fed64b551 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:16.123109 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d9070833-e4bc-46c7-bdb8-f06fed64b551 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:16.140354 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-f576ee95-5a8a-4d8f-b364-3b810122e6c4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042639 May 24 15:25:16.140909 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 373/731] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:16 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:16.151451 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d9070833-e4bc-46c7-bdb8-f06fed64b551 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041861 May 24 15:25:16.152004 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 359/732] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:16 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:25:17.133173 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-516f6214-3714-4776-b3fc-0ef06cfbf025 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:17.134079 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-516f6214-3714-4776-b3fc-0ef06cfbf025 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:17.139994 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-516f6214-3714-4776-b3fc-0ef06cfbf025 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:17.140481 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-516f6214-3714-4776-b3fc-0ef06cfbf025 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:17.141235 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-516f6214-3714-4776-b3fc-0ef06cfbf025 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:17.141667 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-516f6214-3714-4776-b3fc-0ef06cfbf025 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:17.150875 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-1b95820a-652e-4b1d-b156-9a81f3ae4c4c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:17.151796 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-1b95820a-652e-4b1d-b156-9a81f3ae4c4c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:17.158456 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1b95820a-652e-4b1d-b156-9a81f3ae4c4c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:17.158907 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1b95820a-652e-4b1d-b156-9a81f3ae4c4c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:17.159666 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1b95820a-652e-4b1d-b156-9a81f3ae4c4c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:17.160096 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1b95820a-652e-4b1d-b156-9a81f3ae4c4c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:17.163806 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:25:17.171521 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-516f6214-3714-4776-b3fc-0ef06cfbf025 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.143441 May 24 15:25:17.172159 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 374/733] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:25:17 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:25:17.177234 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-9ff2df1c-9ae9-4604-a1ab-7954675a40b8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:17.178147 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-9ff2df1c-9ae9-4604-a1ab-7954675a40b8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:17.184555 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9ff2df1c-9ae9-4604-a1ab-7954675a40b8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:17.185007 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9ff2df1c-9ae9-4604-a1ab-7954675a40b8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:17.185765 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9ff2df1c-9ae9-4604-a1ab-7954675a40b8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:17.186199 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9ff2df1c-9ae9-4604-a1ab-7954675a40b8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:17.191128 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-1b95820a-652e-4b1d-b156-9a81f3ae4c4c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044035 May 24 15:25:17.191693 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 360/734] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:17 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:25:17.214128 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-9ff2df1c-9ae9-4604-a1ab-7954675a40b8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040674 May 24 15:25:17.214673 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 375/735] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:17 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:18.184573 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-da7c3ee5-3f62-4652-b10d-c511898119bd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:18.185434 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-da7c3ee5-3f62-4652-b10d-c511898119bd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:18.192502 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-da7c3ee5-3f62-4652-b10d-c511898119bd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:18.192954 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-da7c3ee5-3f62-4652-b10d-c511898119bd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:18.193714 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-da7c3ee5-3f62-4652-b10d-c511898119bd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:18.194146 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-da7c3ee5-3f62-4652-b10d-c511898119bd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:18.202942 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-85781cb7-b0e0-41cb-80ce-fb2ffc5d4e98 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:18.203887 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-85781cb7-b0e0-41cb-80ce-fb2ffc5d4e98 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:18.210619 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-85781cb7-b0e0-41cb-80ce-fb2ffc5d4e98 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:18.211073 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-85781cb7-b0e0-41cb-80ce-fb2ffc5d4e98 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:18.211837 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-85781cb7-b0e0-41cb-80ce-fb2ffc5d4e98 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:18.212271 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-85781cb7-b0e0-41cb-80ce-fb2ffc5d4e98 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:18.223728 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-da7c3ee5-3f62-4652-b10d-c511898119bd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043686 May 24 15:25:18.224748 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 361/736] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:25:18 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:25:18.229292 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-3659fe80-8fb4-4cc0-9c38-0028ea9774c0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:18.230227 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-3659fe80-8fb4-4cc0-9c38-0028ea9774c0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:18.236192 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3659fe80-8fb4-4cc0-9c38-0028ea9774c0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:18.236933 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3659fe80-8fb4-4cc0-9c38-0028ea9774c0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:18.237054 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:25:18.237696 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3659fe80-8fb4-4cc0-9c38-0028ea9774c0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:18.238240 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3659fe80-8fb4-4cc0-9c38-0028ea9774c0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:18.241418 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-85781cb7-b0e0-41cb-80ce-fb2ffc5d4e98 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042963 May 24 15:25:18.243139 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 376/737] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:18 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:25:18.267569 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-3659fe80-8fb4-4cc0-9c38-0028ea9774c0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041778 May 24 15:25:18.268110 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 362/738] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:18 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:19.236040 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-5fc39393-3ddf-4740-8e71-b1e580eed1cf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:19.236976 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-5fc39393-3ddf-4740-8e71-b1e580eed1cf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:19.243713 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5fc39393-3ddf-4740-8e71-b1e580eed1cf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:19.244155 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5fc39393-3ddf-4740-8e71-b1e580eed1cf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:19.244926 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5fc39393-3ddf-4740-8e71-b1e580eed1cf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:19.245354 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5fc39393-3ddf-4740-8e71-b1e580eed1cf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:19.252865 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-82b7733a-0030-44d7-8997-499b97b9eaa3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:19.253791 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-82b7733a-0030-44d7-8997-499b97b9eaa3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:19.260202 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-82b7733a-0030-44d7-8997-499b97b9eaa3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:19.260684 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-82b7733a-0030-44d7-8997-499b97b9eaa3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:19.261933 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-82b7733a-0030-44d7-8997-499b97b9eaa3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:19.262360 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-82b7733a-0030-44d7-8997-499b97b9eaa3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:19.274677 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-5fc39393-3ddf-4740-8e71-b1e580eed1cf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042773 May 24 15:25:19.275244 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 377/739] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:25:19 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:25:19.280461 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-a3102f21-7f5d-4610-91d6-6d11aba07474 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:19.281369 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-a3102f21-7f5d-4610-91d6-6d11aba07474 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:19.287351 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a3102f21-7f5d-4610-91d6-6d11aba07474 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:19.287518 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a3102f21-7f5d-4610-91d6-6d11aba07474 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:19.288278 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a3102f21-7f5d-4610-91d6-6d11aba07474 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:19.288734 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a3102f21-7f5d-4610-91d6-6d11aba07474 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:19.291448 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-82b7733a-0030-44d7-8997-499b97b9eaa3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042435 May 24 15:25:19.293196 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 363/740] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:19 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:25:19.317042 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-a3102f21-7f5d-4610-91d6-6d11aba07474 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040806 May 24 15:25:19.317593 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 378/741] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:19 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:20.287062 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-02c9fe2b-bd45-45f3-aec8-fcc42587d74e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:20.288018 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-02c9fe2b-bd45-45f3-aec8-fcc42587d74e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:20.294997 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-02c9fe2b-bd45-45f3-aec8-fcc42587d74e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:20.295440 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-02c9fe2b-bd45-45f3-aec8-fcc42587d74e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:20.296232 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-02c9fe2b-bd45-45f3-aec8-fcc42587d74e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:20.296674 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-02c9fe2b-bd45-45f3-aec8-fcc42587d74e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:20.302787 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-02f96c5f-c070-40cb-a2e1-9eadcfc532fe tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:20.303725 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-02f96c5f-c070-40cb-a2e1-9eadcfc532fe tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:20.310587 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-02f96c5f-c070-40cb-a2e1-9eadcfc532fe tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:20.310966 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-02f96c5f-c070-40cb-a2e1-9eadcfc532fe tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:20.311720 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-02f96c5f-c070-40cb-a2e1-9eadcfc532fe tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:20.312144 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-02f96c5f-c070-40cb-a2e1-9eadcfc532fe tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:20.326061 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-02c9fe2b-bd45-45f3-aec8-fcc42587d74e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042961 May 24 15:25:20.326624 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 364/742] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:25:20 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:25:20.331099 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-9627224b-2a76-4b94-9a29-0191c0ba1975 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:20.331997 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-9627224b-2a76-4b94-9a29-0191c0ba1975 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:20.337778 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9627224b-2a76-4b94-9a29-0191c0ba1975 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:20.338223 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9627224b-2a76-4b94-9a29-0191c0ba1975 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:20.338980 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9627224b-2a76-4b94-9a29-0191c0ba1975 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:20.339407 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9627224b-2a76-4b94-9a29-0191c0ba1975 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:20.340636 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-02f96c5f-c070-40cb-a2e1-9eadcfc532fe tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041658 May 24 15:25:20.341201 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 379/743] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:20 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:25:20.371767 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-9627224b-2a76-4b94-9a29-0191c0ba1975 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044152 May 24 15:25:20.372329 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 365/744] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:20 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:21.337619 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-9dd9fbd1-40f2-4a1a-bcd2-6dd87992a233 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:21.338453 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-9dd9fbd1-40f2-4a1a-bcd2-6dd87992a233 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:21.345408 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9dd9fbd1-40f2-4a1a-bcd2-6dd87992a233 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:21.345873 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9dd9fbd1-40f2-4a1a-bcd2-6dd87992a233 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:21.346617 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9dd9fbd1-40f2-4a1a-bcd2-6dd87992a233 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:21.347137 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9dd9fbd1-40f2-4a1a-bcd2-6dd87992a233 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:21.352154 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-1f7550d4-4f0f-4a33-8947-8f5e0532c5fe tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:21.353179 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-1f7550d4-4f0f-4a33-8947-8f5e0532c5fe tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:21.360218 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1f7550d4-4f0f-4a33-8947-8f5e0532c5fe tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:21.360689 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1f7550d4-4f0f-4a33-8947-8f5e0532c5fe tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:21.361456 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1f7550d4-4f0f-4a33-8947-8f5e0532c5fe tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:21.361889 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1f7550d4-4f0f-4a33-8947-8f5e0532c5fe tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:21.377073 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-9dd9fbd1-40f2-4a1a-bcd2-6dd87992a233 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043395 May 24 15:25:21.377791 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 380/745] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:25:21 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:25:21.382712 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-372002eb-5f2a-420b-b5ed-df7907d2cb96 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:21.383612 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-372002eb-5f2a-420b-b5ed-df7907d2cb96 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:21.389483 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-372002eb-5f2a-420b-b5ed-df7907d2cb96 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:21.389947 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-372002eb-5f2a-420b-b5ed-df7907d2cb96 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:21.390685 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-372002eb-5f2a-420b-b5ed-df7907d2cb96 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:21.390800 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-1f7550d4-4f0f-4a33-8947-8f5e0532c5fe tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042459 May 24 15:25:21.391113 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-372002eb-5f2a-420b-b5ed-df7907d2cb96 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:21.391223 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 366/746] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:21 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:25:21.419942 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-372002eb-5f2a-420b-b5ed-df7907d2cb96 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040830 May 24 15:25:21.420530 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 381/747] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:21 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:25:22.388831 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-c265d771-c20f-47fc-9121-b13e289f5d1f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:22.389661 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-c265d771-c20f-47fc-9121-b13e289f5d1f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:22.396077 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c265d771-c20f-47fc-9121-b13e289f5d1f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:22.396551 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c265d771-c20f-47fc-9121-b13e289f5d1f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:22.397301 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c265d771-c20f-47fc-9121-b13e289f5d1f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:22.397730 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c265d771-c20f-47fc-9121-b13e289f5d1f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:22.402910 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e3c12ead-d4c7-4960-990a-217331e845cb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:22.403820 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e3c12ead-d4c7-4960-990a-217331e845cb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:22.410350 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e3c12ead-d4c7-4960-990a-217331e845cb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:22.410795 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e3c12ead-d4c7-4960-990a-217331e845cb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:22.411545 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e3c12ead-d4c7-4960-990a-217331e845cb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:22.411973 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e3c12ead-d4c7-4960-990a-217331e845cb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:22.427360 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-c265d771-c20f-47fc-9121-b13e289f5d1f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042684 May 24 15:25:22.427931 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 367/748] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:25:22 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:25:22.432404 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e7fbab36-42e7-482c-aa49-ed8d9fda08be tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:22.433897 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-e7fbab36-42e7-482c-aa49-ed8d9fda08be tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:22.440796 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e7fbab36-42e7-482c-aa49-ed8d9fda08be tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:22.441242 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e7fbab36-42e7-482c-aa49-ed8d9fda08be tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:22.442009 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e7fbab36-42e7-482c-aa49-ed8d9fda08be tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:22.442443 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e7fbab36-42e7-482c-aa49-ed8d9fda08be tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:22.443705 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e3c12ead-d4c7-4960-990a-217331e845cb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045011 May 24 15:25:22.444257 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 382/749] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:22 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:25:22.472310 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-e7fbab36-42e7-482c-aa49-ed8d9fda08be tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043370 May 24 15:25:22.472862 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 368/750] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:22 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:23.438224 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-06920f80-5cce-44cf-b04d-7c3eaecb9808 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:23.439055 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-06920f80-5cce-44cf-b04d-7c3eaecb9808 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:23.445491 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-06920f80-5cce-44cf-b04d-7c3eaecb9808 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:23.445930 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-06920f80-5cce-44cf-b04d-7c3eaecb9808 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:23.446675 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-06920f80-5cce-44cf-b04d-7c3eaecb9808 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:23.447104 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-06920f80-5cce-44cf-b04d-7c3eaecb9808 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:23.454773 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-3e6d89d8-4c3e-47b0-85a5-9d3f088e8b84 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:23.455696 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-3e6d89d8-4c3e-47b0-85a5-9d3f088e8b84 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:23.462139 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3e6d89d8-4c3e-47b0-85a5-9d3f088e8b84 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:23.462582 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3e6d89d8-4c3e-47b0-85a5-9d3f088e8b84 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:23.463345 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3e6d89d8-4c3e-47b0-85a5-9d3f088e8b84 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:23.463777 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3e6d89d8-4c3e-47b0-85a5-9d3f088e8b84 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:23.475928 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-06920f80-5cce-44cf-b04d-7c3eaecb9808 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041676 May 24 15:25:23.476715 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 383/751] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:25:23 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:25:23.483938 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-047c2291-a38a-4ec4-a379-dc6747a964ec tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:23.484908 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-047c2291-a38a-4ec4-a379-dc6747a964ec tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:23.490967 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-047c2291-a38a-4ec4-a379-dc6747a964ec tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:23.491408 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-047c2291-a38a-4ec4-a379-dc6747a964ec tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:23.492158 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-047c2291-a38a-4ec4-a379-dc6747a964ec tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:23.492610 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-047c2291-a38a-4ec4-a379-dc6747a964ec tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:23.494822 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-3e6d89d8-4c3e-47b0-85a5-9d3f088e8b84 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043860 May 24 15:25:23.495408 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 369/752] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:23 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:25:23.520037 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-047c2291-a38a-4ec4-a379-dc6747a964ec tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040775 May 24 15:25:23.520627 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 384/753] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:23 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:25:24.488495 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-eae4f4fa-bd74-471b-8b99-f40413239c19 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:24.489447 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-eae4f4fa-bd74-471b-8b99-f40413239c19 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:24.496497 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-eae4f4fa-bd74-471b-8b99-f40413239c19 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:24.496940 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-eae4f4fa-bd74-471b-8b99-f40413239c19 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:24.497692 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-eae4f4fa-bd74-471b-8b99-f40413239c19 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:24.498126 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-eae4f4fa-bd74-471b-8b99-f40413239c19 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:24.506129 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-66643cbb-3447-4106-8cc0-90092c54d181 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:24.507037 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-66643cbb-3447-4106-8cc0-90092c54d181 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:24.514082 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-66643cbb-3447-4106-8cc0-90092c54d181 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:24.514523 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-66643cbb-3447-4106-8cc0-90092c54d181 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:24.515274 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-66643cbb-3447-4106-8cc0-90092c54d181 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:24.515702 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-66643cbb-3447-4106-8cc0-90092c54d181 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:24.527416 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-eae4f4fa-bd74-471b-8b99-f40413239c19 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042887 May 24 15:25:24.531352 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 370/754] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:25:24 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:25:24.532493 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-1b26f65d-9209-4bd2-b96c-1150ad6b7c63 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:24.533399 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-1b26f65d-9209-4bd2-b96c-1150ad6b7c63 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:24.539062 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1b26f65d-9209-4bd2-b96c-1150ad6b7c63 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:24.539502 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1b26f65d-9209-4bd2-b96c-1150ad6b7c63 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:24.540254 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1b26f65d-9209-4bd2-b96c-1150ad6b7c63 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:24.540707 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1b26f65d-9209-4bd2-b96c-1150ad6b7c63 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:24.548183 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-66643cbb-3447-4106-8cc0-90092c54d181 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045883 May 24 15:25:24.548773 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 385/755] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:24 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:25:24.570022 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-1b26f65d-9209-4bd2-b96c-1150ad6b7c63 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041021 May 24 15:25:24.570568 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 371/756] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:24 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:25.538978 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-01abf51b-6913-40c0-9efd-fe59a29ef7df tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:25.539892 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-01abf51b-6913-40c0-9efd-fe59a29ef7df tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:25.546398 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-01abf51b-6913-40c0-9efd-fe59a29ef7df tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:25.546844 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-01abf51b-6913-40c0-9efd-fe59a29ef7df tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:25.547589 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-01abf51b-6913-40c0-9efd-fe59a29ef7df tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:25.548013 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-01abf51b-6913-40c0-9efd-fe59a29ef7df tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:25.558887 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a22c804f-21d9-4a4f-b679-7ca989135334 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:25.559854 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a22c804f-21d9-4a4f-b679-7ca989135334 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:25.566321 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a22c804f-21d9-4a4f-b679-7ca989135334 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:25.566776 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a22c804f-21d9-4a4f-b679-7ca989135334 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:25.567541 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a22c804f-21d9-4a4f-b679-7ca989135334 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:25.567982 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a22c804f-21d9-4a4f-b679-7ca989135334 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:25.576993 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-01abf51b-6913-40c0-9efd-fe59a29ef7df tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041956 May 24 15:25:25.577550 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 386/757] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:25:25 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:25:25.582084 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-1b9ceaea-d6b1-4433-8a26-5ecd7423304e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:25.582972 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-1b9ceaea-d6b1-4433-8a26-5ecd7423304e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:25.588595 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1b9ceaea-d6b1-4433-8a26-5ecd7423304e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:25.589618 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1b9ceaea-d6b1-4433-8a26-5ecd7423304e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:25.590371 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1b9ceaea-d6b1-4433-8a26-5ecd7423304e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:25.590797 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1b9ceaea-d6b1-4433-8a26-5ecd7423304e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:25.598092 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a22c804f-21d9-4a4f-b679-7ca989135334 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043069 May 24 15:25:25.598654 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 372/758] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:25 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:25:25.619315 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-1b9ceaea-d6b1-4433-8a26-5ecd7423304e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040787 May 24 15:25:25.619855 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 387/759] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:25 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:26.587933 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e13f6b25-7d18-43e1-82b6-bbc5f4729bc0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:26.589402 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-e13f6b25-7d18-43e1-82b6-bbc5f4729bc0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:26.591765 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=99 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:25:26.596888 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e13f6b25-7d18-43e1-82b6-bbc5f4729bc0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:26.597340 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e13f6b25-7d18-43e1-82b6-bbc5f4729bc0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:26.598103 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e13f6b25-7d18-43e1-82b6-bbc5f4729bc0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:26.598530 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e13f6b25-7d18-43e1-82b6-bbc5f4729bc0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:26.609789 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-6a39d824-08b4-49bf-abf5-76e4a3227711 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:26.610705 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-6a39d824-08b4-49bf-abf5-76e4a3227711 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:26.617385 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6a39d824-08b4-49bf-abf5-76e4a3227711 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:26.617836 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6a39d824-08b4-49bf-abf5-76e4a3227711 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:26.618604 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6a39d824-08b4-49bf-abf5-76e4a3227711 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:26.619045 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6a39d824-08b4-49bf-abf5-76e4a3227711 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:26.634486 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-e13f6b25-7d18-43e1-82b6-bbc5f4729bc0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050408 May 24 15:25:26.635077 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 373/760] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:25:26 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:25:26.639900 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-2b111888-1a69-4723-a24f-25b4665a08f4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:26.640851 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-2b111888-1a69-4723-a24f-25b4665a08f4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:26.646757 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2b111888-1a69-4723-a24f-25b4665a08f4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:26.647206 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2b111888-1a69-4723-a24f-25b4665a08f4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:26.647973 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2b111888-1a69-4723-a24f-25b4665a08f4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:26.648440 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2b111888-1a69-4723-a24f-25b4665a08f4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:26.649833 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-6a39d824-08b4-49bf-abf5-76e4a3227711 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044756 May 24 15:25:26.650559 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 388/761] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:26 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:25:26.677488 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-2b111888-1a69-4723-a24f-25b4665a08f4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041425 May 24 15:25:26.678036 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 374/762] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:26 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:27.646059 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-2f59557b-f8b4-46be-8391-b4d4ce0bbe10 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:27.646972 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-2f59557b-f8b4-46be-8391-b4d4ce0bbe10 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:27.653386 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2f59557b-f8b4-46be-8391-b4d4ce0bbe10 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:27.653826 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2f59557b-f8b4-46be-8391-b4d4ce0bbe10 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:27.654587 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2f59557b-f8b4-46be-8391-b4d4ce0bbe10 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:27.654993 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2f59557b-f8b4-46be-8391-b4d4ce0bbe10 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:27.661152 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-b99fc99c-d9b3-4b88-9742-fa123502cdd6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:27.662070 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-b99fc99c-d9b3-4b88-9742-fa123502cdd6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:27.669098 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b99fc99c-d9b3-4b88-9742-fa123502cdd6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:27.669569 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b99fc99c-d9b3-4b88-9742-fa123502cdd6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:27.670334 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b99fc99c-d9b3-4b88-9742-fa123502cdd6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:27.670766 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b99fc99c-d9b3-4b88-9742-fa123502cdd6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:27.685013 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-2f59557b-f8b4-46be-8391-b4d4ce0bbe10 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042833 May 24 15:25:27.685577 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 389/763] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:25:27 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:25:27.690049 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-b2d18756-4b5a-489b-8ca7-a1a8b81470a0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:27.690921 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-b2d18756-4b5a-489b-8ca7-a1a8b81470a0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:27.696600 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b2d18756-4b5a-489b-8ca7-a1a8b81470a0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:27.697038 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b2d18756-4b5a-489b-8ca7-a1a8b81470a0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:27.697789 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b2d18756-4b5a-489b-8ca7-a1a8b81470a0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:27.698256 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b2d18756-4b5a-489b-8ca7-a1a8b81470a0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:27.699976 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-b99fc99c-d9b3-4b88-9742-fa123502cdd6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042697 May 24 15:25:27.700586 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 375/764] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:27 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:25:27.725564 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-b2d18756-4b5a-489b-8ca7-a1a8b81470a0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039015 May 24 15:25:27.726102 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 390/765] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:27 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:28.696671 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-4d8aa8be-f284-416b-800c-085fc3c3a5c1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:28.697524 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-4d8aa8be-f284-416b-800c-085fc3c3a5c1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:28.704626 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4d8aa8be-f284-416b-800c-085fc3c3a5c1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:28.705073 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4d8aa8be-f284-416b-800c-085fc3c3a5c1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:28.705870 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4d8aa8be-f284-416b-800c-085fc3c3a5c1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:28.706305 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4d8aa8be-f284-416b-800c-085fc3c3a5c1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:28.710963 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-f6925a2f-de1a-4e5b-8ce9-ffcf8fd96d6c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:28.711879 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-f6925a2f-de1a-4e5b-8ce9-ffcf8fd96d6c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:28.718331 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f6925a2f-de1a-4e5b-8ce9-ffcf8fd96d6c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:28.718784 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f6925a2f-de1a-4e5b-8ce9-ffcf8fd96d6c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:28.719537 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f6925a2f-de1a-4e5b-8ce9-ffcf8fd96d6c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:28.719964 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f6925a2f-de1a-4e5b-8ce9-ffcf8fd96d6c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:28.733297 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:25:28.736361 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-4d8aa8be-f284-416b-800c-085fc3c3a5c1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043788 May 24 15:25:28.736941 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 376/766] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:25:28 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:25:28.741575 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-dc23064d-19ff-4c6a-9ad5-28c9c21ead80 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:28.742490 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-dc23064d-19ff-4c6a-9ad5-28c9c21ead80 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:28.749228 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dc23064d-19ff-4c6a-9ad5-28c9c21ead80 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:28.749676 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dc23064d-19ff-4c6a-9ad5-28c9c21ead80 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:28.749794 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-f6925a2f-de1a-4e5b-8ce9-ffcf8fd96d6c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042597 May 24 15:25:28.750295 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 391/767] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:28 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:25:28.750449 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dc23064d-19ff-4c6a-9ad5-28c9c21ead80 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:28.750865 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dc23064d-19ff-4c6a-9ad5-28c9c21ead80 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:28.779819 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-dc23064d-19ff-4c6a-9ad5-28c9c21ead80 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041874 May 24 15:25:28.780388 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 377/768] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:28 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:29.747659 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c8c1cc6b-bdba-495b-9173-9d0684c0fece tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:29.748627 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-c8c1cc6b-bdba-495b-9173-9d0684c0fece tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:29.755020 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c8c1cc6b-bdba-495b-9173-9d0684c0fece tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:29.755469 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c8c1cc6b-bdba-495b-9173-9d0684c0fece tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:29.756229 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c8c1cc6b-bdba-495b-9173-9d0684c0fece tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:29.756689 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c8c1cc6b-bdba-495b-9173-9d0684c0fece tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:29.761463 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-9abffd81-6ca6-4d8a-94a9-e3e6cf27c41b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:29.762376 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-9abffd81-6ca6-4d8a-94a9-e3e6cf27c41b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:29.768788 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9abffd81-6ca6-4d8a-94a9-e3e6cf27c41b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:29.769226 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9abffd81-6ca6-4d8a-94a9-e3e6cf27c41b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:29.769980 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9abffd81-6ca6-4d8a-94a9-e3e6cf27c41b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:29.770406 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9abffd81-6ca6-4d8a-94a9-e3e6cf27c41b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:29.786631 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-c8c1cc6b-bdba-495b-9173-9d0684c0fece tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042905 May 24 15:25:29.787198 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 392/769] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:25:29 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:25:29.791770 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-515ded6c-6823-477e-8985-b58be041198a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:29.792689 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-515ded6c-6823-477e-8985-b58be041198a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:29.798301 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-515ded6c-6823-477e-8985-b58be041198a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:29.798737 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-515ded6c-6823-477e-8985-b58be041198a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:29.799456 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-9abffd81-6ca6-4d8a-94a9-e3e6cf27c41b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042340 May 24 15:25:29.799572 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-515ded6c-6823-477e-8985-b58be041198a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:29.799889 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-515ded6c-6823-477e-8985-b58be041198a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:29.803251 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 378/770] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:29 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:25:29.813586 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:25:29.829101 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-515ded6c-6823-477e-8985-b58be041198a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040969 May 24 15:25:29.829650 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 393/771] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:29 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:30.798642 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-b2f7eefb-60f9-48cc-b18a-3cf73c59548f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:30.799558 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-b2f7eefb-60f9-48cc-b18a-3cf73c59548f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:30.806043 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b2f7eefb-60f9-48cc-b18a-3cf73c59548f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:30.806490 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b2f7eefb-60f9-48cc-b18a-3cf73c59548f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:30.807245 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b2f7eefb-60f9-48cc-b18a-3cf73c59548f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:30.808268 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b2f7eefb-60f9-48cc-b18a-3cf73c59548f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:30.811753 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-1a903215-5839-4692-981e-3bb50c94ce3b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:30.812513 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-1a903215-5839-4692-981e-3bb50c94ce3b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:30.819304 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1a903215-5839-4692-981e-3bb50c94ce3b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:30.819748 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1a903215-5839-4692-981e-3bb50c94ce3b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:30.820544 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1a903215-5839-4692-981e-3bb50c94ce3b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:30.820973 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1a903215-5839-4692-981e-3bb50c94ce3b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:30.837195 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-b2f7eefb-60f9-48cc-b18a-3cf73c59548f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042451 May 24 15:25:30.837762 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 379/772] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:25:30 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:25:30.842243 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-fa54305e-8d13-43a9-89bc-06e6f79c9db8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:30.843175 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-fa54305e-8d13-43a9-89bc-06e6f79c9db8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:30.848984 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fa54305e-8d13-43a9-89bc-06e6f79c9db8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:30.849432 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fa54305e-8d13-43a9-89bc-06e6f79c9db8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:30.850195 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fa54305e-8d13-43a9-89bc-06e6f79c9db8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:30.850624 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fa54305e-8d13-43a9-89bc-06e6f79c9db8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:30.854694 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-1a903215-5839-4692-981e-3bb50c94ce3b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047273 May 24 15:25:30.855277 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 394/773] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:30 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:25:30.880738 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-fa54305e-8d13-43a9-89bc-06e6f79c9db8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041931 May 24 15:25:30.881295 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 380/774] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:30 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:31.848762 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-4bbebac1-2c87-4e35-b12f-662105839caa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:31.849697 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-4bbebac1-2c87-4e35-b12f-662105839caa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:31.856173 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4bbebac1-2c87-4e35-b12f-662105839caa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:31.856649 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4bbebac1-2c87-4e35-b12f-662105839caa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:31.857395 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4bbebac1-2c87-4e35-b12f-662105839caa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:31.858069 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4bbebac1-2c87-4e35-b12f-662105839caa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:31.866388 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f54f05e5-c439-426e-83f6-2a2ecba73df4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:31.867339 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f54f05e5-c439-426e-83f6-2a2ecba73df4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:31.874312 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f54f05e5-c439-426e-83f6-2a2ecba73df4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:31.874783 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f54f05e5-c439-426e-83f6-2a2ecba73df4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:31.875523 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f54f05e5-c439-426e-83f6-2a2ecba73df4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:31.875959 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f54f05e5-c439-426e-83f6-2a2ecba73df4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:31.887591 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-4bbebac1-2c87-4e35-b12f-662105839caa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042792 May 24 15:25:31.888223 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 395/775] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:25:31 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:25:31.892743 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-4c371664-6447-471a-9f26-72d632e1d029 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:31.893650 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-4c371664-6447-471a-9f26-72d632e1d029 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:31.899357 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4c371664-6447-471a-9f26-72d632e1d029 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:31.899792 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4c371664-6447-471a-9f26-72d632e1d029 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:31.900567 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4c371664-6447-471a-9f26-72d632e1d029 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:31.900998 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4c371664-6447-471a-9f26-72d632e1d029 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:31.906539 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f54f05e5-c439-426e-83f6-2a2ecba73df4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043988 May 24 15:25:31.907110 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 381/776] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:31 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:25:31.928580 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-4c371664-6447-471a-9f26-72d632e1d029 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039410 May 24 15:25:31.929117 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 396/777] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:31 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:32.899299 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e778577b-880f-4981-8dcd-0046cc91a815 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:32.900215 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-e778577b-880f-4981-8dcd-0046cc91a815 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:32.907337 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e778577b-880f-4981-8dcd-0046cc91a815 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:32.907781 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e778577b-880f-4981-8dcd-0046cc91a815 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:32.908564 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e778577b-880f-4981-8dcd-0046cc91a815 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:32.908998 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e778577b-880f-4981-8dcd-0046cc91a815 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:32.920809 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-3724600e-97cd-4be9-ac30-8e7dc3aa8953 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:32.921726 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-3724600e-97cd-4be9-ac30-8e7dc3aa8953 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:32.927900 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3724600e-97cd-4be9-ac30-8e7dc3aa8953 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:32.928367 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3724600e-97cd-4be9-ac30-8e7dc3aa8953 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:32.929120 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3724600e-97cd-4be9-ac30-8e7dc3aa8953 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:32.929551 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3724600e-97cd-4be9-ac30-8e7dc3aa8953 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:32.937594 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-e778577b-880f-4981-8dcd-0046cc91a815 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042392 May 24 15:25:32.938162 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 382/778] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:25:32 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:25:32.942607 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-0371df2c-268b-4071-9219-45a614a95838 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:32.943545 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-0371df2c-268b-4071-9219-45a614a95838 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:32.949684 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0371df2c-268b-4071-9219-45a614a95838 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:32.950132 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0371df2c-268b-4071-9219-45a614a95838 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:32.950893 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0371df2c-268b-4071-9219-45a614a95838 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:32.951323 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0371df2c-268b-4071-9219-45a614a95838 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:32.958973 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-3724600e-97cd-4be9-ac30-8e7dc3aa8953 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042098 May 24 15:25:32.959527 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 397/779] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:32 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:25:32.979487 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-0371df2c-268b-4071-9219-45a614a95838 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040318 May 24 15:25:32.980032 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 383/780] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:32 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:33.949845 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d24a5bb1-b13c-44be-acfa-08d109e847de tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:33.950763 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d24a5bb1-b13c-44be-acfa-08d109e847de tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:33.957266 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d24a5bb1-b13c-44be-acfa-08d109e847de tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:33.957720 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d24a5bb1-b13c-44be-acfa-08d109e847de tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:33.958478 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d24a5bb1-b13c-44be-acfa-08d109e847de tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:33.958917 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d24a5bb1-b13c-44be-acfa-08d109e847de tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:33.970249 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-af842c7c-c438-49a8-a9a0-51df6bbd9a19 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:33.971198 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-af842c7c-c438-49a8-a9a0-51df6bbd9a19 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:33.977628 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-af842c7c-c438-49a8-a9a0-51df6bbd9a19 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:33.978076 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-af842c7c-c438-49a8-a9a0-51df6bbd9a19 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:33.978838 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-af842c7c-c438-49a8-a9a0-51df6bbd9a19 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:33.979272 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-af842c7c-c438-49a8-a9a0-51df6bbd9a19 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:33.987711 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d24a5bb1-b13c-44be-acfa-08d109e847de tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042386 May 24 15:25:33.988281 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 398/781] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:25:33 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:25:33.992794 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-a4b1b3e2-90b6-4903-812a-d404e26104ac tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:33.993700 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-a4b1b3e2-90b6-4903-812a-d404e26104ac tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:33.999904 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a4b1b3e2-90b6-4903-812a-d404e26104ac tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:34.000396 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a4b1b3e2-90b6-4903-812a-d404e26104ac tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:34.001165 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a4b1b3e2-90b6-4903-812a-d404e26104ac tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:34.001603 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a4b1b3e2-90b6-4903-812a-d404e26104ac tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:34.008470 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-af842c7c-c438-49a8-a9a0-51df6bbd9a19 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042076 May 24 15:25:34.009030 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 384/782] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:33 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:25:34.030032 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-a4b1b3e2-90b6-4903-812a-d404e26104ac tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040735 May 24 15:25:34.030585 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 399/783] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:33 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:34.999396 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-361168fa-118b-4ae2-8c9a-df038c71181b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:35.000335 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-361168fa-118b-4ae2-8c9a-df038c71181b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:35.006789 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-361168fa-118b-4ae2-8c9a-df038c71181b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:35.007229 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-361168fa-118b-4ae2-8c9a-df038c71181b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:35.007982 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-361168fa-118b-4ae2-8c9a-df038c71181b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:35.008444 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-361168fa-118b-4ae2-8c9a-df038c71181b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:35.020576 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-7e5f72f0-7b04-43b4-8c2d-d67558d871da tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:35.021499 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-7e5f72f0-7b04-43b4-8c2d-d67558d871da tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:35.028627 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7e5f72f0-7b04-43b4-8c2d-d67558d871da tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:35.029078 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7e5f72f0-7b04-43b4-8c2d-d67558d871da tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:35.029844 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7e5f72f0-7b04-43b4-8c2d-d67558d871da tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:35.030280 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7e5f72f0-7b04-43b4-8c2d-d67558d871da tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:35.038063 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-361168fa-118b-4ae2-8c9a-df038c71181b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042584 May 24 15:25:35.038631 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 385/784] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:25:34 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:25:35.043135 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-22a832bd-c8c2-430e-815d-de23828879d9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:35.044042 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-22a832bd-c8c2-430e-815d-de23828879d9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:35.049812 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-22a832bd-c8c2-430e-815d-de23828879d9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:35.050261 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-22a832bd-c8c2-430e-815d-de23828879d9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:35.051020 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-22a832bd-c8c2-430e-815d-de23828879d9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:35.051462 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-22a832bd-c8c2-430e-815d-de23828879d9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:35.059333 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-7e5f72f0-7b04-43b4-8c2d-d67558d871da tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042675 May 24 15:25:35.059900 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 400/785] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:35 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:25:35.080053 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-22a832bd-c8c2-430e-815d-de23828879d9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040409 May 24 15:25:35.080650 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 386/786] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:35 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:36.049745 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-a769f89d-f7b2-470a-9fc7-949dc71f2100 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:36.050755 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-a769f89d-f7b2-470a-9fc7-949dc71f2100 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:36.053243 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_api:SELECT=88 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:25:36.059126 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a769f89d-f7b2-470a-9fc7-949dc71f2100 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:36.059570 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a769f89d-f7b2-470a-9fc7-949dc71f2100 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:36.060359 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a769f89d-f7b2-470a-9fc7-949dc71f2100 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:36.060790 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a769f89d-f7b2-470a-9fc7-949dc71f2100 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:36.070658 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-fa4f4500-b5cd-4b10-8276-01f3c747b36e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:36.071832 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-fa4f4500-b5cd-4b10-8276-01f3c747b36e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:36.078602 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fa4f4500-b5cd-4b10-8276-01f3c747b36e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:36.079049 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fa4f4500-b5cd-4b10-8276-01f3c747b36e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:36.079826 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fa4f4500-b5cd-4b10-8276-01f3c747b36e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:36.080378 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fa4f4500-b5cd-4b10-8276-01f3c747b36e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:36.090553 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-a769f89d-f7b2-470a-9fc7-949dc71f2100 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044710 May 24 15:25:36.091127 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 401/787] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:25:36 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:25:36.095623 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-fff4c91e-084e-47b2-a3c9-6545c8feee98 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:36.096558 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-fff4c91e-084e-47b2-a3c9-6545c8feee98 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:36.102141 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fff4c91e-084e-47b2-a3c9-6545c8feee98 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:36.102583 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fff4c91e-084e-47b2-a3c9-6545c8feee98 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:36.103331 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fff4c91e-084e-47b2-a3c9-6545c8feee98 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:36.103757 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fff4c91e-084e-47b2-a3c9-6545c8feee98 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:36.110544 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-fa4f4500-b5cd-4b10-8276-01f3c747b36e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043745 May 24 15:25:36.111104 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 387/788] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:36 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:25:36.132565 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-fff4c91e-084e-47b2-a3c9-6545c8feee98 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040407 May 24 15:25:36.133104 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 402/789] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:36 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:37.102192 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-71c0407d-ead6-498f-8fc9-0bdef52207a1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:37.103139 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-71c0407d-ead6-498f-8fc9-0bdef52207a1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:37.109582 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-71c0407d-ead6-498f-8fc9-0bdef52207a1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:37.110049 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-71c0407d-ead6-498f-8fc9-0bdef52207a1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:37.110794 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-71c0407d-ead6-498f-8fc9-0bdef52207a1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:37.111221 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-71c0407d-ead6-498f-8fc9-0bdef52207a1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:37.122380 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-be864719-da75-446b-9411-7c709b2ea9c1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:37.123336 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-be864719-da75-446b-9411-7c709b2ea9c1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:37.129894 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-be864719-da75-446b-9411-7c709b2ea9c1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:37.130351 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-be864719-da75-446b-9411-7c709b2ea9c1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:37.131115 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-be864719-da75-446b-9411-7c709b2ea9c1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:37.131549 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-be864719-da75-446b-9411-7c709b2ea9c1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:37.141554 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-71c0407d-ead6-498f-8fc9-0bdef52207a1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043099 May 24 15:25:37.141948 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 388/790] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:25:37 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:25:37.146413 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-0e31f829-c83c-40ed-8380-438b17afc1ff tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:37.147313 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-0e31f829-c83c-40ed-8380-438b17afc1ff tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:37.152953 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0e31f829-c83c-40ed-8380-438b17afc1ff tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:37.153400 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0e31f829-c83c-40ed-8380-438b17afc1ff tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:37.154156 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0e31f829-c83c-40ed-8380-438b17afc1ff tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:37.154590 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0e31f829-c83c-40ed-8380-438b17afc1ff tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:37.161159 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-be864719-da75-446b-9411-7c709b2ea9c1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043117 May 24 15:25:37.161716 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 403/791] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:37 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:25:37.183352 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-0e31f829-c83c-40ed-8380-438b17afc1ff tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040435 May 24 15:25:37.183888 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 389/792] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:37 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:38.152962 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c30308e7-cc16-454b-9a1a-3fbd24d35eb9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:38.153875 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-c30308e7-cc16-454b-9a1a-3fbd24d35eb9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:38.160727 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c30308e7-cc16-454b-9a1a-3fbd24d35eb9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:38.161172 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c30308e7-cc16-454b-9a1a-3fbd24d35eb9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:38.161920 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c30308e7-cc16-454b-9a1a-3fbd24d35eb9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:38.162347 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c30308e7-cc16-454b-9a1a-3fbd24d35eb9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:38.172949 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-76cebd8b-9036-479f-b2fb-ee70ff186852 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:38.173869 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-76cebd8b-9036-479f-b2fb-ee70ff186852 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:38.180397 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-76cebd8b-9036-479f-b2fb-ee70ff186852 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:38.180847 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-76cebd8b-9036-479f-b2fb-ee70ff186852 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:38.181612 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-76cebd8b-9036-479f-b2fb-ee70ff186852 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:38.182043 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-76cebd8b-9036-479f-b2fb-ee70ff186852 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:38.193281 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-c30308e7-cc16-454b-9a1a-3fbd24d35eb9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044218 May 24 15:25:38.193842 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 404/793] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:25:38 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:25:38.198417 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-3f7479d8-42d4-4b25-8d8f-f699bdbd1f4f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:38.199315 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-3f7479d8-42d4-4b25-8d8f-f699bdbd1f4f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:38.204937 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3f7479d8-42d4-4b25-8d8f-f699bdbd1f4f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:38.205372 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3f7479d8-42d4-4b25-8d8f-f699bdbd1f4f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:38.206113 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3f7479d8-42d4-4b25-8d8f-f699bdbd1f4f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:38.206539 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3f7479d8-42d4-4b25-8d8f-f699bdbd1f4f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:38.211012 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-76cebd8b-9036-479f-b2fb-ee70ff186852 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041919 May 24 15:25:38.211564 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 390/794] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:38 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:25:38.234561 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-3f7479d8-42d4-4b25-8d8f-f699bdbd1f4f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039761 May 24 15:25:38.235102 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 405/795] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:38 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:39.205190 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-24817ef9-0f6c-4ccf-b414-ad1f296636b4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:39.206103 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-24817ef9-0f6c-4ccf-b414-ad1f296636b4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:39.212610 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-24817ef9-0f6c-4ccf-b414-ad1f296636b4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:39.213054 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-24817ef9-0f6c-4ccf-b414-ad1f296636b4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:39.213807 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-24817ef9-0f6c-4ccf-b414-ad1f296636b4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:39.214235 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-24817ef9-0f6c-4ccf-b414-ad1f296636b4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:39.222254 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-291d9a04-3ab5-498d-ae59-6a6bf4d6daee tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:39.223170 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-291d9a04-3ab5-498d-ae59-6a6bf4d6daee tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:39.229737 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-291d9a04-3ab5-498d-ae59-6a6bf4d6daee tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:39.230186 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-291d9a04-3ab5-498d-ae59-6a6bf4d6daee tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:39.230948 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-291d9a04-3ab5-498d-ae59-6a6bf4d6daee tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:39.231385 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-291d9a04-3ab5-498d-ae59-6a6bf4d6daee tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:39.242826 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-24817ef9-0f6c-4ccf-b414-ad1f296636b4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041559 May 24 15:25:39.243396 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 391/796] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:25:39 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:25:39.248389 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-c448dcea-20fa-48aa-b7f0-cf15d736d35d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:39.249297 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-c448dcea-20fa-48aa-b7f0-cf15d736d35d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:39.254951 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c448dcea-20fa-48aa-b7f0-cf15d736d35d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:39.255397 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c448dcea-20fa-48aa-b7f0-cf15d736d35d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:39.256153 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c448dcea-20fa-48aa-b7f0-cf15d736d35d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:39.256613 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c448dcea-20fa-48aa-b7f0-cf15d736d35d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:39.262435 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-291d9a04-3ab5-498d-ae59-6a6bf4d6daee tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044052 May 24 15:25:39.262990 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 406/797] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:39 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:25:39.284930 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-c448dcea-20fa-48aa-b7f0-cf15d736d35d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040560 May 24 15:25:39.285478 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 392/798] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:39 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:40.254460 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-f8ee28ea-b104-4ceb-90a8-8b3145730b46 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:40.255370 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-f8ee28ea-b104-4ceb-90a8-8b3145730b46 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:40.262519 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f8ee28ea-b104-4ceb-90a8-8b3145730b46 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:40.262961 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f8ee28ea-b104-4ceb-90a8-8b3145730b46 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:40.263707 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f8ee28ea-b104-4ceb-90a8-8b3145730b46 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:40.264133 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f8ee28ea-b104-4ceb-90a8-8b3145730b46 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:40.273929 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-093967d8-c5e7-43b4-bf3d-2f506586b3ac tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:40.274842 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-093967d8-c5e7-43b4-bf3d-2f506586b3ac tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:40.281220 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-093967d8-c5e7-43b4-bf3d-2f506586b3ac tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:40.281661 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-093967d8-c5e7-43b4-bf3d-2f506586b3ac tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:40.282420 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-093967d8-c5e7-43b4-bf3d-2f506586b3ac tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:40.282833 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-093967d8-c5e7-43b4-bf3d-2f506586b3ac tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:40.293025 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-f8ee28ea-b104-4ceb-90a8-8b3145730b46 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042499 May 24 15:25:40.293579 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 407/799] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:25:40 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:25:40.298026 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-9df7568c-4231-46a4-b341-defad9bb4415 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:40.298918 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-9df7568c-4231-46a4-b341-defad9bb4415 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:40.300381 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:25:40.304659 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9df7568c-4231-46a4-b341-defad9bb4415 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:40.305098 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9df7568c-4231-46a4-b341-defad9bb4415 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:40.305852 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9df7568c-4231-46a4-b341-defad9bb4415 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:40.306275 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9df7568c-4231-46a4-b341-defad9bb4415 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:40.313988 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-093967d8-c5e7-43b4-bf3d-2f506586b3ac tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043960 May 24 15:25:40.314545 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 393/800] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:40 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:25:40.334401 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-9df7568c-4231-46a4-b341-defad9bb4415 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039786 May 24 15:25:40.334878 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 408/801] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:40 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:41.304591 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a9e2cb5b-49e3-48be-9ba2-0372ae5271bd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:41.305504 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a9e2cb5b-49e3-48be-9ba2-0372ae5271bd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:41.312092 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a9e2cb5b-49e3-48be-9ba2-0372ae5271bd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:41.312562 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a9e2cb5b-49e3-48be-9ba2-0372ae5271bd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:41.313313 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a9e2cb5b-49e3-48be-9ba2-0372ae5271bd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:41.313737 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a9e2cb5b-49e3-48be-9ba2-0372ae5271bd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:41.325790 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-6944118f-6a7f-4f93-85ed-a61101247292 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:41.326700 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-6944118f-6a7f-4f93-85ed-a61101247292 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:41.333103 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6944118f-6a7f-4f93-85ed-a61101247292 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:41.333546 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6944118f-6a7f-4f93-85ed-a61101247292 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:41.334294 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6944118f-6a7f-4f93-85ed-a61101247292 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:41.334720 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6944118f-6a7f-4f93-85ed-a61101247292 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:41.343733 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a9e2cb5b-49e3-48be-9ba2-0372ae5271bd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043087 May 24 15:25:41.344476 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 394/802] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:25:41 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:25:41.348921 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-c4f39bc1-dc58-441a-b376-0c96e996e273 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:41.349819 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-c4f39bc1-dc58-441a-b376-0c96e996e273 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:41.355704 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c4f39bc1-dc58-441a-b376-0c96e996e273 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:41.356156 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c4f39bc1-dc58-441a-b376-0c96e996e273 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:41.356958 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c4f39bc1-dc58-441a-b376-0c96e996e273 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:41.357391 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c4f39bc1-dc58-441a-b376-0c96e996e273 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:41.364095 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-6944118f-6a7f-4f93-85ed-a61101247292 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042607 May 24 15:25:41.364863 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 409/803] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:41 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:41.386903 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-c4f39bc1-dc58-441a-b376-0c96e996e273 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041546 May 24 15:25:41.387446 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 395/804] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:41 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:42.356138 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d39760ee-d04c-45b1-8941-42f273a40ce7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:42.357073 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d39760ee-d04c-45b1-8941-42f273a40ce7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:42.363728 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d39760ee-d04c-45b1-8941-42f273a40ce7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:42.364170 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d39760ee-d04c-45b1-8941-42f273a40ce7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:42.364960 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d39760ee-d04c-45b1-8941-42f273a40ce7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:42.365390 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d39760ee-d04c-45b1-8941-42f273a40ce7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:42.367667 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:25:42.375000 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-caa3b68d-3157-4346-8177-f62a06087163 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:42.375927 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-caa3b68d-3157-4346-8177-f62a06087163 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:42.382503 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-caa3b68d-3157-4346-8177-f62a06087163 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:42.382954 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-caa3b68d-3157-4346-8177-f62a06087163 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:42.383721 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-caa3b68d-3157-4346-8177-f62a06087163 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:42.384289 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-caa3b68d-3157-4346-8177-f62a06087163 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:42.395119 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d39760ee-d04c-45b1-8941-42f273a40ce7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043563 May 24 15:25:42.395682 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 410/805] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:25:42 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:25:42.400121 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-780ed83b-238c-4470-888c-b40af65f5d4a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:42.401606 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-780ed83b-238c-4470-888c-b40af65f5d4a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:42.407201 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-780ed83b-238c-4470-888c-b40af65f5d4a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:42.407645 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-780ed83b-238c-4470-888c-b40af65f5d4a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:42.408554 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-780ed83b-238c-4470-888c-b40af65f5d4a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:42.408983 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-780ed83b-238c-4470-888c-b40af65f5d4a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:42.415375 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-caa3b68d-3157-4346-8177-f62a06087163 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044254 May 24 15:25:42.415936 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 396/806] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:42 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:42.437603 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-780ed83b-238c-4470-888c-b40af65f5d4a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040932 May 24 15:25:42.438156 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 411/807] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:42 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:43.406813 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-0ea50ae4-1255-41fd-8b08-b59801892f0b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:43.407669 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-0ea50ae4-1255-41fd-8b08-b59801892f0b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:43.414110 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0ea50ae4-1255-41fd-8b08-b59801892f0b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:43.414555 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0ea50ae4-1255-41fd-8b08-b59801892f0b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:43.415304 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0ea50ae4-1255-41fd-8b08-b59801892f0b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:43.415728 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0ea50ae4-1255-41fd-8b08-b59801892f0b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:43.426887 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-7299e71e-31a4-4400-ad67-038a480f1f9d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:43.427852 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-7299e71e-31a4-4400-ad67-038a480f1f9d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:43.434836 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7299e71e-31a4-4400-ad67-038a480f1f9d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:43.435284 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7299e71e-31a4-4400-ad67-038a480f1f9d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:43.436040 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7299e71e-31a4-4400-ad67-038a480f1f9d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:43.436501 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7299e71e-31a4-4400-ad67-038a480f1f9d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:43.448976 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-0ea50ae4-1255-41fd-8b08-b59801892f0b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046477 May 24 15:25:43.449712 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 397/808] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:25:43 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:25:43.454030 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-2200b797-6a22-4436-9c37-495521491b53 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:43.454932 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-2200b797-6a22-4436-9c37-495521491b53 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:43.460702 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2200b797-6a22-4436-9c37-495521491b53 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:43.461147 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2200b797-6a22-4436-9c37-495521491b53 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:43.461902 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2200b797-6a22-4436-9c37-495521491b53 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:43.462334 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2200b797-6a22-4436-9c37-495521491b53 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:43.468085 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-7299e71e-31a4-4400-ad67-038a480f1f9d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045064 May 24 15:25:43.468662 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 412/809] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:43 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:25:43.491033 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-2200b797-6a22-4436-9c37-495521491b53 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040514 May 24 15:25:43.491574 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 398/810] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:43 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:43.656505 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-dd750b94-653e-4e03-bd04-57c5fb1e6edc tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:43.657054 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-dd750b94-653e-4e03-bd04-57c5fb1e6edc tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 2be15600-c3a4-43ed-bf7d-0960eaf59eb1] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:43.663120 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dd750b94-653e-4e03-bd04-57c5fb1e6edc tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:43.663578 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dd750b94-653e-4e03-bd04-57c5fb1e6edc tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:43.664369 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dd750b94-653e-4e03-bd04-57c5fb1e6edc tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:43.664814 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dd750b94-653e-4e03-bd04-57c5fb1e6edc tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:43.688656 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-dd750b94-653e-4e03-bd04-57c5fb1e6edc tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/2be15600-c3a4-43ed-bf7d-0960eaf59eb1/ips" status: 200 len: 145 microversion: 2.1 time: 0.085296 May 24 15:25:43.689200 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 413/811] 10.222.0.45 () {58 vars in 1247 bytes} [Tue May 24 15:25:43 2022] GET /compute/v2.1/servers/2be15600-c3a4-43ed-bf7d-0960eaf59eb1/ips => generated 145 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:44.459746 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-eb6bf798-d35c-4f7e-a166-f6e48f3f7c61 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:44.460771 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-eb6bf798-d35c-4f7e-a166-f6e48f3f7c61 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:44.467149 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-eb6bf798-d35c-4f7e-a166-f6e48f3f7c61 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:44.467588 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-eb6bf798-d35c-4f7e-a166-f6e48f3f7c61 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:44.468358 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-eb6bf798-d35c-4f7e-a166-f6e48f3f7c61 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:44.468786 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-eb6bf798-d35c-4f7e-a166-f6e48f3f7c61 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:44.478934 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-415152e4-11e7-45fc-93d9-c3eb593107a9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:44.479863 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-415152e4-11e7-45fc-93d9-c3eb593107a9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:44.486547 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-415152e4-11e7-45fc-93d9-c3eb593107a9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:44.487002 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-415152e4-11e7-45fc-93d9-c3eb593107a9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:44.487762 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-415152e4-11e7-45fc-93d9-c3eb593107a9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:44.488200 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-415152e4-11e7-45fc-93d9-c3eb593107a9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:44.497985 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-eb6bf798-d35c-4f7e-a166-f6e48f3f7c61 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042237 May 24 15:25:44.498717 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 399/812] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:25:44 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:25:44.503020 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d11f33b2-f741-4230-b890-e9aaca98333f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:44.503922 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d11f33b2-f741-4230-b890-e9aaca98333f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:44.509830 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d11f33b2-f741-4230-b890-e9aaca98333f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:44.510866 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d11f33b2-f741-4230-b890-e9aaca98333f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:44.511637 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d11f33b2-f741-4230-b890-e9aaca98333f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:44.512068 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d11f33b2-f741-4230-b890-e9aaca98333f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:44.519249 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-415152e4-11e7-45fc-93d9-c3eb593107a9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044206 May 24 15:25:44.519838 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 414/813] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:44 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:25:44.540226 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d11f33b2-f741-4230-b890-e9aaca98333f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040688 May 24 15:25:44.540824 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 400/814] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:44 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:45.509610 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-ceab65bc-0e78-4f35-9fa3-6f17711e1e6b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:45.511317 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-ceab65bc-0e78-4f35-9fa3-6f17711e1e6b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:45.517739 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ceab65bc-0e78-4f35-9fa3-6f17711e1e6b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:45.518184 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ceab65bc-0e78-4f35-9fa3-6f17711e1e6b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:45.518936 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ceab65bc-0e78-4f35-9fa3-6f17711e1e6b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:45.519369 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ceab65bc-0e78-4f35-9fa3-6f17711e1e6b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:45.530454 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-ebed011d-3ce9-4b28-b160-20bba18529a0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:45.531460 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-ebed011d-3ce9-4b28-b160-20bba18529a0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:45.537776 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ebed011d-3ce9-4b28-b160-20bba18529a0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:45.538223 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ebed011d-3ce9-4b28-b160-20bba18529a0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:45.538980 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ebed011d-3ce9-4b28-b160-20bba18529a0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:45.539410 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ebed011d-3ce9-4b28-b160-20bba18529a0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:45.549599 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-ceab65bc-0e78-4f35-9fa3-6f17711e1e6b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044047 May 24 15:25:45.550314 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 415/815] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:25:45 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 15:25:45.554959 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-346f53d0-48bf-4a62-92a8-65da926a2e85 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:45.555886 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-346f53d0-48bf-4a62-92a8-65da926a2e85 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:45.561912 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-346f53d0-48bf-4a62-92a8-65da926a2e85 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:45.562350 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-346f53d0-48bf-4a62-92a8-65da926a2e85 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:45.563133 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-346f53d0-48bf-4a62-92a8-65da926a2e85 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:45.563891 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-346f53d0-48bf-4a62-92a8-65da926a2e85 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:45.569100 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-ebed011d-3ce9-4b28-b160-20bba18529a0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043146 May 24 15:25:45.569661 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 401/816] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:45 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:25:45.592156 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-346f53d0-48bf-4a62-92a8-65da926a2e85 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040867 May 24 15:25:45.592717 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 416/817] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:45 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:46.561743 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-fe9577fa-2113-43d5-88e9-1125864267fb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:46.562689 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-fe9577fa-2113-43d5-88e9-1125864267fb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:46.569155 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fe9577fa-2113-43d5-88e9-1125864267fb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:46.569597 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fe9577fa-2113-43d5-88e9-1125864267fb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:46.570349 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fe9577fa-2113-43d5-88e9-1125864267fb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:46.570780 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fe9577fa-2113-43d5-88e9-1125864267fb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:46.580989 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-97f069cc-93f0-444b-95cd-c3aaebd22d85 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:46.581933 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-97f069cc-93f0-444b-95cd-c3aaebd22d85 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:46.588933 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-97f069cc-93f0-444b-95cd-c3aaebd22d85 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:46.589383 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-97f069cc-93f0-444b-95cd-c3aaebd22d85 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:46.590162 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-97f069cc-93f0-444b-95cd-c3aaebd22d85 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:46.590604 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-97f069cc-93f0-444b-95cd-c3aaebd22d85 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:46.624972 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-97f069cc-93f0-444b-95cd-c3aaebd22d85 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047773 May 24 15:25:46.625569 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 417/818] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:46 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:25:46.632617 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-ecdf4511-2bb9-466a-87d0-32aee3bdadc9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:46.634252 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-ecdf4511-2bb9-466a-87d0-32aee3bdadc9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:46.639946 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ecdf4511-2bb9-466a-87d0-32aee3bdadc9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:46.640426 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ecdf4511-2bb9-466a-87d0-32aee3bdadc9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:46.641206 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ecdf4511-2bb9-466a-87d0-32aee3bdadc9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:46.641632 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ecdf4511-2bb9-466a-87d0-32aee3bdadc9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:46.674722 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-ecdf4511-2bb9-466a-87d0-32aee3bdadc9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048072 May 24 15:25:46.675526 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 418/819] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:46 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:46.758155 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-fe9577fa-2113-43d5-88e9-1125864267fb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.200988 May 24 15:25:46.758709 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 402/820] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:25:46 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:25:47.636461 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d8ff62f3-48aa-4f23-9030-be2850c283fb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:47.637410 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d8ff62f3-48aa-4f23-9030-be2850c283fb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:47.643811 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d8ff62f3-48aa-4f23-9030-be2850c283fb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:47.644256 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d8ff62f3-48aa-4f23-9030-be2850c283fb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:47.645037 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d8ff62f3-48aa-4f23-9030-be2850c283fb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:47.645496 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d8ff62f3-48aa-4f23-9030-be2850c283fb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:47.674484 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d8ff62f3-48aa-4f23-9030-be2850c283fb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042008 May 24 15:25:47.675025 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 419/821] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:47 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:47.686258 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-3e005b08-352f-4d42-a1bb-8a3c6dbeecf3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:47.687183 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-3e005b08-352f-4d42-a1bb-8a3c6dbeecf3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:47.693615 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3e005b08-352f-4d42-a1bb-8a3c6dbeecf3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:47.694056 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3e005b08-352f-4d42-a1bb-8a3c6dbeecf3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:47.694809 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3e005b08-352f-4d42-a1bb-8a3c6dbeecf3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:47.695238 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3e005b08-352f-4d42-a1bb-8a3c6dbeecf3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:47.723238 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-3e005b08-352f-4d42-a1bb-8a3c6dbeecf3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040891 May 24 15:25:47.723774 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 403/822] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:47 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:47.769461 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e02982d0-b043-4ee7-9ffa-b76f49f3e08b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:47.770323 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e02982d0-b043-4ee7-9ffa-b76f49f3e08b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:47.776874 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e02982d0-b043-4ee7-9ffa-b76f49f3e08b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:47.777318 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e02982d0-b043-4ee7-9ffa-b76f49f3e08b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:47.778075 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e02982d0-b043-4ee7-9ffa-b76f49f3e08b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:47.778503 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e02982d0-b043-4ee7-9ffa-b76f49f3e08b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:47.806629 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e02982d0-b043-4ee7-9ffa-b76f49f3e08b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041085 May 24 15:25:47.807211 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 420/823] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:25:47 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:25:48.686567 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-65bb1408-3157-4a66-8c6a-9e89708033d7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:48.687418 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-65bb1408-3157-4a66-8c6a-9e89708033d7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:48.693685 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-65bb1408-3157-4a66-8c6a-9e89708033d7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:48.694133 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-65bb1408-3157-4a66-8c6a-9e89708033d7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:48.694892 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-65bb1408-3157-4a66-8c6a-9e89708033d7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:48.695326 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-65bb1408-3157-4a66-8c6a-9e89708033d7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:48.723052 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-65bb1408-3157-4a66-8c6a-9e89708033d7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041116 May 24 15:25:48.723580 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 404/824] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:48 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:48.735235 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-4736d110-1bbd-405b-bfeb-9aabe140bb91 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:48.736164 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-4736d110-1bbd-405b-bfeb-9aabe140bb91 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:48.742714 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4736d110-1bbd-405b-bfeb-9aabe140bb91 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:48.743164 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4736d110-1bbd-405b-bfeb-9aabe140bb91 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:48.743922 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4736d110-1bbd-405b-bfeb-9aabe140bb91 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:48.745049 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4736d110-1bbd-405b-bfeb-9aabe140bb91 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:48.772651 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-4736d110-1bbd-405b-bfeb-9aabe140bb91 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041485 May 24 15:25:48.773204 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 421/825] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:48 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:48.817964 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-80a67139-e729-49f3-aa1a-27c317cef4c2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:48.818889 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-80a67139-e729-49f3-aa1a-27c317cef4c2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:48.824881 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-80a67139-e729-49f3-aa1a-27c317cef4c2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:48.825329 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-80a67139-e729-49f3-aa1a-27c317cef4c2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:48.826088 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-80a67139-e729-49f3-aa1a-27c317cef4c2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:48.826521 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-80a67139-e729-49f3-aa1a-27c317cef4c2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:48.854975 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-80a67139-e729-49f3-aa1a-27c317cef4c2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040899 May 24 15:25:48.855513 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 405/826] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:25:48 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:25:49.734645 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-0f43832d-5f7c-4bab-987a-dd5635351b75 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:49.735559 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-0f43832d-5f7c-4bab-987a-dd5635351b75 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:49.741742 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0f43832d-5f7c-4bab-987a-dd5635351b75 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:49.742187 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0f43832d-5f7c-4bab-987a-dd5635351b75 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:49.743112 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0f43832d-5f7c-4bab-987a-dd5635351b75 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:49.743377 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0f43832d-5f7c-4bab-987a-dd5635351b75 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:49.772566 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-0f43832d-5f7c-4bab-987a-dd5635351b75 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042064 May 24 15:25:49.773106 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 422/827] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:49 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:49.783541 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-46f18930-92be-4718-9089-278e093f1768 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:49.784517 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-46f18930-92be-4718-9089-278e093f1768 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:49.791012 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-46f18930-92be-4718-9089-278e093f1768 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:49.791452 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-46f18930-92be-4718-9089-278e093f1768 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:49.792227 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-46f18930-92be-4718-9089-278e093f1768 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:49.792692 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-46f18930-92be-4718-9089-278e093f1768 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:49.820876 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-46f18930-92be-4718-9089-278e093f1768 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041280 May 24 15:25:49.821548 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 406/828] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:49 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:49.866476 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c80e62c1-eebe-4fd2-ad01-ad6b7071fa5d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:49.867411 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-c80e62c1-eebe-4fd2-ad01-ad6b7071fa5d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:49.873891 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c80e62c1-eebe-4fd2-ad01-ad6b7071fa5d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:49.874331 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c80e62c1-eebe-4fd2-ad01-ad6b7071fa5d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:49.875079 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c80e62c1-eebe-4fd2-ad01-ad6b7071fa5d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:49.875506 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c80e62c1-eebe-4fd2-ad01-ad6b7071fa5d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:49.904116 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-c80e62c1-eebe-4fd2-ad01-ad6b7071fa5d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041565 May 24 15:25:49.904698 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 423/829] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:25:49 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:25:50.783891 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-367aeb9b-c79d-4d34-8d94-3969110d48e8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:50.784845 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-367aeb9b-c79d-4d34-8d94-3969110d48e8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:50.791161 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-367aeb9b-c79d-4d34-8d94-3969110d48e8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:50.791550 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-367aeb9b-c79d-4d34-8d94-3969110d48e8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:50.792329 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-367aeb9b-c79d-4d34-8d94-3969110d48e8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:50.792762 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-367aeb9b-c79d-4d34-8d94-3969110d48e8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:50.820552 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-367aeb9b-c79d-4d34-8d94-3969110d48e8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040570 May 24 15:25:50.821092 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 407/830] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:50 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:50.832867 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-188f30a3-6cf9-4a8b-9986-61e2a0fb63a1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:50.833821 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-188f30a3-6cf9-4a8b-9986-61e2a0fb63a1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:50.841044 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-188f30a3-6cf9-4a8b-9986-61e2a0fb63a1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:50.841523 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-188f30a3-6cf9-4a8b-9986-61e2a0fb63a1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:50.842281 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-188f30a3-6cf9-4a8b-9986-61e2a0fb63a1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:50.842721 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-188f30a3-6cf9-4a8b-9986-61e2a0fb63a1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:50.876464 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-188f30a3-6cf9-4a8b-9986-61e2a0fb63a1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047313 May 24 15:25:50.877026 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 424/831] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:50 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:50.915194 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d15f69c4-b6ec-4130-8908-60a13215e5e9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:50.916148 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d15f69c4-b6ec-4130-8908-60a13215e5e9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:50.922190 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d15f69c4-b6ec-4130-8908-60a13215e5e9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:50.922635 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d15f69c4-b6ec-4130-8908-60a13215e5e9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:50.923389 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d15f69c4-b6ec-4130-8908-60a13215e5e9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:50.923823 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d15f69c4-b6ec-4130-8908-60a13215e5e9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:50.953879 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d15f69c4-b6ec-4130-8908-60a13215e5e9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042635 May 24 15:25:50.954419 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 408/832] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:25:50 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:25:51.832436 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-dcbc4b53-e139-4de5-8b96-bc89bab41dff tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:51.833354 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-dcbc4b53-e139-4de5-8b96-bc89bab41dff tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:51.839603 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dcbc4b53-e139-4de5-8b96-bc89bab41dff tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:51.840051 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dcbc4b53-e139-4de5-8b96-bc89bab41dff tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:51.840834 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dcbc4b53-e139-4de5-8b96-bc89bab41dff tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:51.841267 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dcbc4b53-e139-4de5-8b96-bc89bab41dff tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:51.870401 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-dcbc4b53-e139-4de5-8b96-bc89bab41dff tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041919 May 24 15:25:51.871107 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 425/833] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:51 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:51.887943 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-bc2281cd-5606-4a41-9794-92fb9715c232 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:51.889018 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-bc2281cd-5606-4a41-9794-92fb9715c232 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:51.895856 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bc2281cd-5606-4a41-9794-92fb9715c232 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:51.896293 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bc2281cd-5606-4a41-9794-92fb9715c232 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:51.897077 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bc2281cd-5606-4a41-9794-92fb9715c232 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:51.897506 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bc2281cd-5606-4a41-9794-92fb9715c232 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:51.926247 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-bc2281cd-5606-4a41-9794-92fb9715c232 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042385 May 24 15:25:51.926778 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 409/834] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:51 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:51.965868 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-24b32950-62c9-48f2-b4df-0a0f365cc8ac tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:51.966791 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-24b32950-62c9-48f2-b4df-0a0f365cc8ac tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:51.972728 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-24b32950-62c9-48f2-b4df-0a0f365cc8ac tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:51.973178 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-24b32950-62c9-48f2-b4df-0a0f365cc8ac tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:51.973934 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-24b32950-62c9-48f2-b4df-0a0f365cc8ac tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:51.974368 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-24b32950-62c9-48f2-b4df-0a0f365cc8ac tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:52.003194 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-24b32950-62c9-48f2-b4df-0a0f365cc8ac tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041818 May 24 15:25:52.003741 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 426/835] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:25:51 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:25:52.881541 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-c7cc7c47-8312-4198-8098-73524c2d7bcc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:52.882393 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-c7cc7c47-8312-4198-8098-73524c2d7bcc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:52.889589 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c7cc7c47-8312-4198-8098-73524c2d7bcc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:52.890203 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c7cc7c47-8312-4198-8098-73524c2d7bcc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:52.890875 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c7cc7c47-8312-4198-8098-73524c2d7bcc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:52.891306 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c7cc7c47-8312-4198-8098-73524c2d7bcc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:52.895333 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:25:52.920736 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-c7cc7c47-8312-4198-8098-73524c2d7bcc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043077 May 24 15:25:52.921285 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 410/836] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:52 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:52.938099 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c4be2af6-4bd3-4059-b848-bdad54fd6634 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:52.939029 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-c4be2af6-4bd3-4059-b848-bdad54fd6634 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:52.945471 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c4be2af6-4bd3-4059-b848-bdad54fd6634 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:52.945920 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c4be2af6-4bd3-4059-b848-bdad54fd6634 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:52.946673 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c4be2af6-4bd3-4059-b848-bdad54fd6634 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:52.947108 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c4be2af6-4bd3-4059-b848-bdad54fd6634 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:52.951349 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:25:52.975834 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-c4be2af6-4bd3-4059-b848-bdad54fd6634 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041623 May 24 15:25:52.976408 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 427/837] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:52 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:53.015322 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-706b9ad4-13c8-4bd0-b341-805f4f97b004 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:53.016247 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-706b9ad4-13c8-4bd0-b341-805f4f97b004 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:53.022260 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-706b9ad4-13c8-4bd0-b341-805f4f97b004 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:53.022711 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-706b9ad4-13c8-4bd0-b341-805f4f97b004 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:53.023499 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-706b9ad4-13c8-4bd0-b341-805f4f97b004 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:53.023934 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-706b9ad4-13c8-4bd0-b341-805f4f97b004 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:53.054459 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-706b9ad4-13c8-4bd0-b341-805f4f97b004 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043064 May 24 15:25:53.055014 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 411/838] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:25:53 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:25:53.931437 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-5b2ec28b-c90b-4cb6-a08e-939db8f61e86 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:53.932383 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-5b2ec28b-c90b-4cb6-a08e-939db8f61e86 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:53.938440 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5b2ec28b-c90b-4cb6-a08e-939db8f61e86 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:53.938948 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5b2ec28b-c90b-4cb6-a08e-939db8f61e86 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:53.939450 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5b2ec28b-c90b-4cb6-a08e-939db8f61e86 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:53.939887 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5b2ec28b-c90b-4cb6-a08e-939db8f61e86 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:53.969774 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-5b2ec28b-c90b-4cb6-a08e-939db8f61e86 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042192 May 24 15:25:53.970321 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 428/839] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:53 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:53.987245 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-7ffb3625-074d-4030-85be-1baa7aeae047 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:53.988162 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-7ffb3625-074d-4030-85be-1baa7aeae047 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:53.994570 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7ffb3625-074d-4030-85be-1baa7aeae047 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:53.995011 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7ffb3625-074d-4030-85be-1baa7aeae047 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:53.995792 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7ffb3625-074d-4030-85be-1baa7aeae047 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:53.996219 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7ffb3625-074d-4030-85be-1baa7aeae047 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:54.023973 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-7ffb3625-074d-4030-85be-1baa7aeae047 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040734 May 24 15:25:54.024544 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 412/840] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:53 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:54.066613 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d3ccfd63-c108-4bb8-a1a3-9dc313f5f33c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:54.067526 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d3ccfd63-c108-4bb8-a1a3-9dc313f5f33c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:54.074047 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d3ccfd63-c108-4bb8-a1a3-9dc313f5f33c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:54.074493 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d3ccfd63-c108-4bb8-a1a3-9dc313f5f33c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:54.075254 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d3ccfd63-c108-4bb8-a1a3-9dc313f5f33c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:54.075689 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d3ccfd63-c108-4bb8-a1a3-9dc313f5f33c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:54.104368 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d3ccfd63-c108-4bb8-a1a3-9dc313f5f33c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041656 May 24 15:25:54.104917 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 429/841] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:25:54 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 15:25:54.981775 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d30b05fb-f888-463e-9470-699cd2fb7c40 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:54.982961 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d30b05fb-f888-463e-9470-699cd2fb7c40 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:54.988940 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d30b05fb-f888-463e-9470-699cd2fb7c40 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:54.989484 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d30b05fb-f888-463e-9470-699cd2fb7c40 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:54.990150 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d30b05fb-f888-463e-9470-699cd2fb7c40 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:54.990585 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d30b05fb-f888-463e-9470-699cd2fb7c40 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:55.018610 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d30b05fb-f888-463e-9470-699cd2fb7c40 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041409 May 24 15:25:55.019139 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 413/842] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:54 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:55.034844 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-98cfb7a3-4e1a-4c59-8ab5-23f07939daa4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:55.035757 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-98cfb7a3-4e1a-4c59-8ab5-23f07939daa4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:55.042825 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-98cfb7a3-4e1a-4c59-8ab5-23f07939daa4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:55.043261 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-98cfb7a3-4e1a-4c59-8ab5-23f07939daa4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:55.044005 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-98cfb7a3-4e1a-4c59-8ab5-23f07939daa4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:55.044466 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-98cfb7a3-4e1a-4c59-8ab5-23f07939daa4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:55.072414 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-98cfb7a3-4e1a-4c59-8ab5-23f07939daa4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041388 May 24 15:25:55.072966 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 430/843] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:55 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:55.116096 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-9a730213-db70-41cd-9495-e28d3a5b6098 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:55.117074 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-9a730213-db70-41cd-9495-e28d3a5b6098 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:55.123093 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9a730213-db70-41cd-9495-e28d3a5b6098 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:55.123531 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9a730213-db70-41cd-9495-e28d3a5b6098 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:55.124279 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9a730213-db70-41cd-9495-e28d3a5b6098 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:55.124730 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9a730213-db70-41cd-9495-e28d3a5b6098 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:55.152808 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-9a730213-db70-41cd-9495-e28d3a5b6098 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040743 May 24 15:25:55.153336 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 414/844] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:25:55 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:25:56.029830 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c7abaca1-8a3e-4ed7-b198-a2ab73e4fc7b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:56.030739 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-c7abaca1-8a3e-4ed7-b198-a2ab73e4fc7b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:56.036810 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c7abaca1-8a3e-4ed7-b198-a2ab73e4fc7b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:56.037395 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c7abaca1-8a3e-4ed7-b198-a2ab73e4fc7b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:56.037982 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c7abaca1-8a3e-4ed7-b198-a2ab73e4fc7b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:56.038404 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c7abaca1-8a3e-4ed7-b198-a2ab73e4fc7b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:56.067815 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-c7abaca1-8a3e-4ed7-b198-a2ab73e4fc7b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041865 May 24 15:25:56.068380 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 431/845] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:56 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:56.083008 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-4e80cab9-aec3-47af-9a1e-954c76f38b70 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:56.083932 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-4e80cab9-aec3-47af-9a1e-954c76f38b70 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:56.090357 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4e80cab9-aec3-47af-9a1e-954c76f38b70 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:56.090795 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4e80cab9-aec3-47af-9a1e-954c76f38b70 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:56.091549 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4e80cab9-aec3-47af-9a1e-954c76f38b70 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:56.091977 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4e80cab9-aec3-47af-9a1e-954c76f38b70 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:56.120595 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-4e80cab9-aec3-47af-9a1e-954c76f38b70 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041586 May 24 15:25:56.121129 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 415/846] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:56 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:56.164324 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-43092c67-ace8-435f-8afe-9683bd3157d8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:56.165251 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-43092c67-ace8-435f-8afe-9683bd3157d8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:56.171726 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-43092c67-ace8-435f-8afe-9683bd3157d8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:56.172172 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-43092c67-ace8-435f-8afe-9683bd3157d8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:56.172966 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-43092c67-ace8-435f-8afe-9683bd3157d8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:56.173398 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-43092c67-ace8-435f-8afe-9683bd3157d8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:56.201738 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-43092c67-ace8-435f-8afe-9683bd3157d8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041501 May 24 15:25:56.202274 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 432/847] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:25:56 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 15:25:57.079373 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e7908af3-d8f8-4320-a594-f9181085725e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:57.080411 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-e7908af3-d8f8-4320-a594-f9181085725e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:57.082330 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_api:SELECT=86 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:25:57.088707 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e7908af3-d8f8-4320-a594-f9181085725e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:57.089287 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e7908af3-d8f8-4320-a594-f9181085725e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:57.089906 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e7908af3-d8f8-4320-a594-f9181085725e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:57.090338 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e7908af3-d8f8-4320-a594-f9181085725e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:57.118687 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-e7908af3-d8f8-4320-a594-f9181085725e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043290 May 24 15:25:57.119724 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 416/848] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:57 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:57.130928 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-1aa1332a-35b5-4a5c-b40e-df160781e739 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:57.131840 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-1aa1332a-35b5-4a5c-b40e-df160781e739 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:57.138928 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1aa1332a-35b5-4a5c-b40e-df160781e739 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:57.139371 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1aa1332a-35b5-4a5c-b40e-df160781e739 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:57.140115 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1aa1332a-35b5-4a5c-b40e-df160781e739 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:57.140564 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1aa1332a-35b5-4a5c-b40e-df160781e739 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:57.167901 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-1aa1332a-35b5-4a5c-b40e-df160781e739 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040902 May 24 15:25:57.168470 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 433/849] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:57 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:57.213232 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-31c22486-c454-499b-a1a2-b5be4a62e725 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:57.214175 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-31c22486-c454-499b-a1a2-b5be4a62e725 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:57.220138 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-31c22486-c454-499b-a1a2-b5be4a62e725 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:57.220685 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-31c22486-c454-499b-a1a2-b5be4a62e725 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:57.221445 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-31c22486-c454-499b-a1a2-b5be4a62e725 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:57.221878 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-31c22486-c454-499b-a1a2-b5be4a62e725 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:57.250373 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-31c22486-c454-499b-a1a2-b5be4a62e725 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041113 May 24 15:25:57.250914 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 417/850] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:25:57 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:25:58.130573 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-f41f6234-c086-4f80-8c29-9f1eeb5452ce tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:58.131485 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-f41f6234-c086-4f80-8c29-9f1eeb5452ce tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:58.137780 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f41f6234-c086-4f80-8c29-9f1eeb5452ce tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:58.138229 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f41f6234-c086-4f80-8c29-9f1eeb5452ce tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:58.139244 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f41f6234-c086-4f80-8c29-9f1eeb5452ce tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:58.139675 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f41f6234-c086-4f80-8c29-9f1eeb5452ce tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:58.168414 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-f41f6234-c086-4f80-8c29-9f1eeb5452ce tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041785 May 24 15:25:58.168951 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 434/851] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:58 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:58.178940 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-fe8be8c7-a7e0-415e-944a-c08ceeaf4bc6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:58.179887 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-fe8be8c7-a7e0-415e-944a-c08ceeaf4bc6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:58.186611 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fe8be8c7-a7e0-415e-944a-c08ceeaf4bc6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:58.187058 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fe8be8c7-a7e0-415e-944a-c08ceeaf4bc6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:58.187826 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fe8be8c7-a7e0-415e-944a-c08ceeaf4bc6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:58.188262 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fe8be8c7-a7e0-415e-944a-c08ceeaf4bc6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:58.216842 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-fe8be8c7-a7e0-415e-944a-c08ceeaf4bc6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041710 May 24 15:25:58.217392 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 418/852] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:58 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:58.262337 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-0f866c22-0098-4d97-9ea8-782e1e7a9fd6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:58.263276 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-0f866c22-0098-4d97-9ea8-782e1e7a9fd6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:58.269581 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0f866c22-0098-4d97-9ea8-782e1e7a9fd6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:58.270025 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0f866c22-0098-4d97-9ea8-782e1e7a9fd6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:58.270779 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0f866c22-0098-4d97-9ea8-782e1e7a9fd6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:58.271207 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0f866c22-0098-4d97-9ea8-782e1e7a9fd6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:58.299934 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-0f866c22-0098-4d97-9ea8-782e1e7a9fd6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041969 May 24 15:25:58.300431 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 435/853] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:25:58 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 15:25:59.179654 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-c8a04256-a7eb-4fae-9665-18bb65756db1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:59.180591 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-c8a04256-a7eb-4fae-9665-18bb65756db1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:59.187789 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c8a04256-a7eb-4fae-9665-18bb65756db1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:59.188228 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c8a04256-a7eb-4fae-9665-18bb65756db1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:59.189009 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c8a04256-a7eb-4fae-9665-18bb65756db1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:59.189437 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c8a04256-a7eb-4fae-9665-18bb65756db1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:59.217121 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-c8a04256-a7eb-4fae-9665-18bb65756db1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041365 May 24 15:25:59.217646 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 419/854] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:59 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:59.229488 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-8f5f132d-e496-430d-a3ec-a6a829d0164d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:59.230461 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-8f5f132d-e496-430d-a3ec-a6a829d0164d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:59.237280 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8f5f132d-e496-430d-a3ec-a6a829d0164d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:59.237728 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8f5f132d-e496-430d-a3ec-a6a829d0164d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:59.238487 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8f5f132d-e496-430d-a3ec-a6a829d0164d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:59.238919 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8f5f132d-e496-430d-a3ec-a6a829d0164d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:59.267036 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-8f5f132d-e496-430d-a3ec-a6a829d0164d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042157 May 24 15:25:59.267612 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 436/855] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:25:59 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:25:59.312204 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-0cdd8b78-c882-47da-872a-c7a9de528c82 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:25:59.313090 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-0cdd8b78-c882-47da-872a-c7a9de528c82 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:25:59.319044 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0cdd8b78-c882-47da-872a-c7a9de528c82 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:59.319492 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0cdd8b78-c882-47da-872a-c7a9de528c82 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:59.320248 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0cdd8b78-c882-47da-872a-c7a9de528c82 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:25:59.320711 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0cdd8b78-c882-47da-872a-c7a9de528c82 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:25:59.349166 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-0cdd8b78-c882-47da-872a-c7a9de528c82 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041067 May 24 15:25:59.349704 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 420/856] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:25:59 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:26:00.228021 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-3bb48e81-9a1c-42ff-9e32-4b1206ab6be6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:00.228896 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-3bb48e81-9a1c-42ff-9e32-4b1206ab6be6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:00.235731 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3bb48e81-9a1c-42ff-9e32-4b1206ab6be6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:00.236345 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3bb48e81-9a1c-42ff-9e32-4b1206ab6be6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:00.236969 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3bb48e81-9a1c-42ff-9e32-4b1206ab6be6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:00.237424 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3bb48e81-9a1c-42ff-9e32-4b1206ab6be6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:00.267247 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-3bb48e81-9a1c-42ff-9e32-4b1206ab6be6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043337 May 24 15:26:00.267807 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 437/857] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:00 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:00.278051 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-7a838f53-b4d2-49e1-9653-f42d5496a6a8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:00.278968 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-7a838f53-b4d2-49e1-9653-f42d5496a6a8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:00.285409 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7a838f53-b4d2-49e1-9653-f42d5496a6a8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:00.285845 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7a838f53-b4d2-49e1-9653-f42d5496a6a8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:00.286593 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7a838f53-b4d2-49e1-9653-f42d5496a6a8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:00.287020 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7a838f53-b4d2-49e1-9653-f42d5496a6a8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:00.314650 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-7a838f53-b4d2-49e1-9653-f42d5496a6a8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040548 May 24 15:26:00.315189 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 421/858] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:00 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:00.361106 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-b88a687a-e64f-4a6d-a558-d42361cec725 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:00.362069 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-b88a687a-e64f-4a6d-a558-d42361cec725 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:00.368013 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b88a687a-e64f-4a6d-a558-d42361cec725 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:00.368498 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b88a687a-e64f-4a6d-a558-d42361cec725 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:00.369779 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b88a687a-e64f-4a6d-a558-d42361cec725 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:00.370207 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b88a687a-e64f-4a6d-a558-d42361cec725 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:00.399200 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-b88a687a-e64f-4a6d-a558-d42361cec725 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042506 May 24 15:26:00.399737 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 438/859] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:26:00 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:26:01.279605 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-367ce2f5-4765-4a11-b7aa-399d65a62d6c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:01.280486 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-367ce2f5-4765-4a11-b7aa-399d65a62d6c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:01.287092 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-367ce2f5-4765-4a11-b7aa-399d65a62d6c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:01.287539 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-367ce2f5-4765-4a11-b7aa-399d65a62d6c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:01.288319 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-367ce2f5-4765-4a11-b7aa-399d65a62d6c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:01.288753 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-367ce2f5-4765-4a11-b7aa-399d65a62d6c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:01.316444 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-367ce2f5-4765-4a11-b7aa-399d65a62d6c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041455 May 24 15:26:01.316989 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 422/860] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:01 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:01.326398 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-9a8b9ac1-7199-48a2-be98-5eff9ba2d81b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:01.327420 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-9a8b9ac1-7199-48a2-be98-5eff9ba2d81b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:01.333969 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9a8b9ac1-7199-48a2-be98-5eff9ba2d81b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:01.334425 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9a8b9ac1-7199-48a2-be98-5eff9ba2d81b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:01.335199 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9a8b9ac1-7199-48a2-be98-5eff9ba2d81b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:01.335634 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9a8b9ac1-7199-48a2-be98-5eff9ba2d81b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:01.364167 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-9a8b9ac1-7199-48a2-be98-5eff9ba2d81b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042202 May 24 15:26:01.364740 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 439/861] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:01 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:01.410748 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-923c856c-4f63-4688-a936-d5e33b990e0a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:01.411667 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-923c856c-4f63-4688-a936-d5e33b990e0a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:01.417769 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-923c856c-4f63-4688-a936-d5e33b990e0a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:01.418212 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-923c856c-4f63-4688-a936-d5e33b990e0a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:01.418967 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-923c856c-4f63-4688-a936-d5e33b990e0a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:01.419398 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-923c856c-4f63-4688-a936-d5e33b990e0a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:01.447154 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-923c856c-4f63-4688-a936-d5e33b990e0a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040378 May 24 15:26:01.447688 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 423/862] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:26:01 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:26:02.327217 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-5991c0e7-c12c-481c-9de8-82413b9f38df tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:02.328062 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-5991c0e7-c12c-481c-9de8-82413b9f38df tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:02.334566 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5991c0e7-c12c-481c-9de8-82413b9f38df tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:02.335013 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5991c0e7-c12c-481c-9de8-82413b9f38df tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:02.335767 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5991c0e7-c12c-481c-9de8-82413b9f38df tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:02.336199 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5991c0e7-c12c-481c-9de8-82413b9f38df tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:02.365494 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-5991c0e7-c12c-481c-9de8-82413b9f38df tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042257 May 24 15:26:02.366030 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 440/863] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:02 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:02.375008 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d8fe270e-2f5e-4192-9ff5-1e2812b016ff tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:02.375969 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d8fe270e-2f5e-4192-9ff5-1e2812b016ff tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:02.382431 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d8fe270e-2f5e-4192-9ff5-1e2812b016ff tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:02.382878 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d8fe270e-2f5e-4192-9ff5-1e2812b016ff tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:02.383648 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d8fe270e-2f5e-4192-9ff5-1e2812b016ff tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:02.384082 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d8fe270e-2f5e-4192-9ff5-1e2812b016ff tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:02.419067 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d8fe270e-2f5e-4192-9ff5-1e2812b016ff tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047933 May 24 15:26:02.419625 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 424/864] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:02 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:02.459042 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-f7a94aaf-adca-4dc7-86a0-324f43033010 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:02.459980 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-f7a94aaf-adca-4dc7-86a0-324f43033010 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:02.466529 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f7a94aaf-adca-4dc7-86a0-324f43033010 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:02.466972 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f7a94aaf-adca-4dc7-86a0-324f43033010 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:02.467724 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f7a94aaf-adca-4dc7-86a0-324f43033010 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:02.468148 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f7a94aaf-adca-4dc7-86a0-324f43033010 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:02.496633 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-f7a94aaf-adca-4dc7-86a0-324f43033010 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041563 May 24 15:26:02.497175 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 441/865] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:26:02 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:26:03.377473 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-7ad038bd-1fb6-4214-885c-72121e5e00e0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:03.378342 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-7ad038bd-1fb6-4214-885c-72121e5e00e0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:03.384815 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7ad038bd-1fb6-4214-885c-72121e5e00e0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:03.385257 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7ad038bd-1fb6-4214-885c-72121e5e00e0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:03.386039 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7ad038bd-1fb6-4214-885c-72121e5e00e0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:03.387093 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7ad038bd-1fb6-4214-885c-72121e5e00e0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:03.415529 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-7ad038bd-1fb6-4214-885c-72121e5e00e0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042121 May 24 15:26:03.416064 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 425/866] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:03 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:03.429404 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-7bbda159-943c-4d0e-a0e0-6f1d65a7f730 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:03.430370 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-7bbda159-943c-4d0e-a0e0-6f1d65a7f730 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:03.436811 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7bbda159-943c-4d0e-a0e0-6f1d65a7f730 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:03.437261 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7bbda159-943c-4d0e-a0e0-6f1d65a7f730 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:03.438024 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7bbda159-943c-4d0e-a0e0-6f1d65a7f730 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:03.438460 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7bbda159-943c-4d0e-a0e0-6f1d65a7f730 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:03.467541 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-7bbda159-943c-4d0e-a0e0-6f1d65a7f730 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042006 May 24 15:26:03.468089 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 442/867] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:03 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:03.508124 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-9486e9c2-b463-41b5-8652-e641ba53045c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:03.509594 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-9486e9c2-b463-41b5-8652-e641ba53045c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:03.516063 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9486e9c2-b463-41b5-8652-e641ba53045c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:03.516545 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9486e9c2-b463-41b5-8652-e641ba53045c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:03.517294 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9486e9c2-b463-41b5-8652-e641ba53045c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:03.517719 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9486e9c2-b463-41b5-8652-e641ba53045c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:03.542622 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:26:03.547718 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-9486e9c2-b463-41b5-8652-e641ba53045c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043584 May 24 15:26:03.548268 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 426/868] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:26:03 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 15:26:04.427229 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-3006f72d-ff52-4365-87b7-a59f0df11b00 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:04.428058 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-3006f72d-ff52-4365-87b7-a59f0df11b00 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:04.435658 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3006f72d-ff52-4365-87b7-a59f0df11b00 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:04.436235 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3006f72d-ff52-4365-87b7-a59f0df11b00 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:04.436864 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3006f72d-ff52-4365-87b7-a59f0df11b00 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:04.437293 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3006f72d-ff52-4365-87b7-a59f0df11b00 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:04.460285 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:26:04.466778 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-3006f72d-ff52-4365-87b7-a59f0df11b00 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043654 May 24 15:26:04.467325 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 443/869] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:04 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:04.479103 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-1f51b1d6-ed5a-4704-97d9-ce3a8afe8326 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:04.480055 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-1f51b1d6-ed5a-4704-97d9-ce3a8afe8326 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:04.487278 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1f51b1d6-ed5a-4704-97d9-ce3a8afe8326 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:04.487729 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1f51b1d6-ed5a-4704-97d9-ce3a8afe8326 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:04.488525 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1f51b1d6-ed5a-4704-97d9-ce3a8afe8326 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:04.488959 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1f51b1d6-ed5a-4704-97d9-ce3a8afe8326 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:04.517837 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-1f51b1d6-ed5a-4704-97d9-ce3a8afe8326 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042893 May 24 15:26:04.518396 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 427/870] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:04 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:04.559643 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-30e8c2ca-4642-4dcf-a993-52608337293e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:04.560631 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-30e8c2ca-4642-4dcf-a993-52608337293e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:04.566834 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-30e8c2ca-4642-4dcf-a993-52608337293e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:04.567285 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-30e8c2ca-4642-4dcf-a993-52608337293e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:04.568046 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-30e8c2ca-4642-4dcf-a993-52608337293e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:04.568516 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-30e8c2ca-4642-4dcf-a993-52608337293e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:04.596959 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-30e8c2ca-4642-4dcf-a993-52608337293e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041913 May 24 15:26:04.597497 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 444/871] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:26:04 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 15:26:05.478498 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f8382baa-9dea-4717-8401-91897c015abd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:05.479429 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f8382baa-9dea-4717-8401-91897c015abd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:05.486560 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f8382baa-9dea-4717-8401-91897c015abd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:05.487006 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f8382baa-9dea-4717-8401-91897c015abd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:05.487766 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f8382baa-9dea-4717-8401-91897c015abd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:05.488198 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f8382baa-9dea-4717-8401-91897c015abd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:05.517368 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f8382baa-9dea-4717-8401-91897c015abd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042762 May 24 15:26:05.517934 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 428/872] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:05 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:05.529671 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-94ea9e90-e75a-4c6d-ac2d-6991100c0b89 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:05.530599 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-94ea9e90-e75a-4c6d-ac2d-6991100c0b89 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:05.537093 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-94ea9e90-e75a-4c6d-ac2d-6991100c0b89 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:05.537546 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-94ea9e90-e75a-4c6d-ac2d-6991100c0b89 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:05.538303 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-94ea9e90-e75a-4c6d-ac2d-6991100c0b89 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:05.538737 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-94ea9e90-e75a-4c6d-ac2d-6991100c0b89 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:05.566801 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-94ea9e90-e75a-4c6d-ac2d-6991100c0b89 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041508 May 24 15:26:05.567343 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 445/873] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:05 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:05.609492 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-fd51c742-bc29-462c-a634-ca9b85666825 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:05.610428 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-fd51c742-bc29-462c-a634-ca9b85666825 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:05.616480 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fd51c742-bc29-462c-a634-ca9b85666825 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:05.616932 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fd51c742-bc29-462c-a634-ca9b85666825 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:05.617695 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fd51c742-bc29-462c-a634-ca9b85666825 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:05.618133 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fd51c742-bc29-462c-a634-ca9b85666825 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:05.646364 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-fd51c742-bc29-462c-a634-ca9b85666825 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041818 May 24 15:26:05.646919 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 429/874] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:26:05 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:26:06.529389 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-2d7fc742-beca-4b2b-a2b9-8f61ea8b5004 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:06.530255 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-2d7fc742-beca-4b2b-a2b9-8f61ea8b5004 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:06.532126 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_api:SELECT=90 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:26:06.537688 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2d7fc742-beca-4b2b-a2b9-8f61ea8b5004 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:06.538142 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2d7fc742-beca-4b2b-a2b9-8f61ea8b5004 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:06.538904 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2d7fc742-beca-4b2b-a2b9-8f61ea8b5004 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:06.539342 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2d7fc742-beca-4b2b-a2b9-8f61ea8b5004 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:06.568896 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-2d7fc742-beca-4b2b-a2b9-8f61ea8b5004 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043532 May 24 15:26:06.569447 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 446/875] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:06 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:06.578378 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-9328ec8e-3d07-4112-b28f-061aab0fb3b4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:06.579307 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-9328ec8e-3d07-4112-b28f-061aab0fb3b4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:06.585756 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9328ec8e-3d07-4112-b28f-061aab0fb3b4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:06.586202 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9328ec8e-3d07-4112-b28f-061aab0fb3b4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:06.586960 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9328ec8e-3d07-4112-b28f-061aab0fb3b4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:06.587393 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9328ec8e-3d07-4112-b28f-061aab0fb3b4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:06.615670 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-9328ec8e-3d07-4112-b28f-061aab0fb3b4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041405 May 24 15:26:06.616216 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 430/876] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:06 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:06.657875 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-ef50395a-df39-4e48-b927-330fb4fde009 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:06.658878 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-ef50395a-df39-4e48-b927-330fb4fde009 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:06.664809 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ef50395a-df39-4e48-b927-330fb4fde009 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:06.665250 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ef50395a-df39-4e48-b927-330fb4fde009 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:06.665993 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ef50395a-df39-4e48-b927-330fb4fde009 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:06.666421 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ef50395a-df39-4e48-b927-330fb4fde009 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:06.695974 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-ef50395a-df39-4e48-b927-330fb4fde009 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041996 May 24 15:26:06.696728 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 447/877] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:26:06 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:26:07.580923 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-c074b003-6068-4436-863f-0b511615762b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:07.581856 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-c074b003-6068-4436-863f-0b511615762b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:07.588056 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c074b003-6068-4436-863f-0b511615762b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:07.588543 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c074b003-6068-4436-863f-0b511615762b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:07.589318 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c074b003-6068-4436-863f-0b511615762b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:07.590383 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c074b003-6068-4436-863f-0b511615762b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:07.618541 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-c074b003-6068-4436-863f-0b511615762b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041617 May 24 15:26:07.619087 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 431/878] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:07 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:07.627436 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-df5b3914-4aa4-4cd4-910a-d55033bd05f5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:07.628374 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-df5b3914-4aa4-4cd4-910a-d55033bd05f5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:07.634923 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-df5b3914-4aa4-4cd4-910a-d55033bd05f5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:07.635379 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-df5b3914-4aa4-4cd4-910a-d55033bd05f5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:07.636177 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-df5b3914-4aa4-4cd4-910a-d55033bd05f5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:07.637255 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-df5b3914-4aa4-4cd4-910a-d55033bd05f5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:07.664757 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-df5b3914-4aa4-4cd4-910a-d55033bd05f5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041248 May 24 15:26:07.665299 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 448/879] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:07 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:07.707348 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-1cd8cf8c-3948-425d-a51f-fa6a1833c511 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:07.708286 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-1cd8cf8c-3948-425d-a51f-fa6a1833c511 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:07.714200 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1cd8cf8c-3948-425d-a51f-fa6a1833c511 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:07.714691 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1cd8cf8c-3948-425d-a51f-fa6a1833c511 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:07.715437 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1cd8cf8c-3948-425d-a51f-fa6a1833c511 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:07.715867 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1cd8cf8c-3948-425d-a51f-fa6a1833c511 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:07.744077 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-1cd8cf8c-3948-425d-a51f-fa6a1833c511 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040685 May 24 15:26:07.744638 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 432/880] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:26:07 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:26:08.630433 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-923ab66f-d3b6-408e-865c-1742dfccaa69 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:08.631351 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-923ab66f-d3b6-408e-865c-1742dfccaa69 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:08.637815 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-923ab66f-d3b6-408e-865c-1742dfccaa69 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:08.638263 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-923ab66f-d3b6-408e-865c-1742dfccaa69 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:08.639013 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-923ab66f-d3b6-408e-865c-1742dfccaa69 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:08.639445 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-923ab66f-d3b6-408e-865c-1742dfccaa69 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:08.668232 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-923ab66f-d3b6-408e-865c-1742dfccaa69 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041201 May 24 15:26:08.668796 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 449/881] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:08 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:08.676065 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-8e4d1ce2-c30e-4d06-94e7-2e2392d7d7ec tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:08.677030 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-8e4d1ce2-c30e-4d06-94e7-2e2392d7d7ec tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:08.683573 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8e4d1ce2-c30e-4d06-94e7-2e2392d7d7ec tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:08.684016 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8e4d1ce2-c30e-4d06-94e7-2e2392d7d7ec tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:08.684795 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8e4d1ce2-c30e-4d06-94e7-2e2392d7d7ec tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:08.685222 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8e4d1ce2-c30e-4d06-94e7-2e2392d7d7ec tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:08.713058 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-8e4d1ce2-c30e-4d06-94e7-2e2392d7d7ec tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040983 May 24 15:26:08.713590 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 433/882] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:08 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:08.755832 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-75adde77-b2a0-46c9-9a3b-2602d110beab tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:08.756776 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-75adde77-b2a0-46c9-9a3b-2602d110beab tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:08.763256 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-75adde77-b2a0-46c9-9a3b-2602d110beab tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:08.763700 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-75adde77-b2a0-46c9-9a3b-2602d110beab tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:08.764491 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-75adde77-b2a0-46c9-9a3b-2602d110beab tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:08.764923 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-75adde77-b2a0-46c9-9a3b-2602d110beab tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:08.793173 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-75adde77-b2a0-46c9-9a3b-2602d110beab tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041255 May 24 15:26:08.793713 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 450/883] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:26:08 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:26:09.679770 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-68699d99-ea38-4aaf-944b-9dc81d327269 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:09.680666 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-68699d99-ea38-4aaf-944b-9dc81d327269 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:09.687830 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-68699d99-ea38-4aaf-944b-9dc81d327269 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:09.688276 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-68699d99-ea38-4aaf-944b-9dc81d327269 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:09.689060 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-68699d99-ea38-4aaf-944b-9dc81d327269 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:09.689492 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-68699d99-ea38-4aaf-944b-9dc81d327269 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:09.717604 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-68699d99-ea38-4aaf-944b-9dc81d327269 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041830 May 24 15:26:09.718136 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 434/884] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:09 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:09.724895 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-859bc2b3-d597-4aad-a82f-7b670af8426c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:09.725809 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-859bc2b3-d597-4aad-a82f-7b670af8426c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:09.732998 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-859bc2b3-d597-4aad-a82f-7b670af8426c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:09.733437 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-859bc2b3-d597-4aad-a82f-7b670af8426c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:09.734187 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-859bc2b3-d597-4aad-a82f-7b670af8426c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:09.734612 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-859bc2b3-d597-4aad-a82f-7b670af8426c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:09.762959 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-859bc2b3-d597-4aad-a82f-7b670af8426c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041898 May 24 15:26:09.763494 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 451/885] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:09 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:09.804356 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-811cfe0a-ba79-4875-a627-5a46bd47dcc2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:09.805336 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-811cfe0a-ba79-4875-a627-5a46bd47dcc2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:09.812034 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-811cfe0a-ba79-4875-a627-5a46bd47dcc2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:09.812516 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-811cfe0a-ba79-4875-a627-5a46bd47dcc2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:09.813341 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-811cfe0a-ba79-4875-a627-5a46bd47dcc2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:09.813782 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-811cfe0a-ba79-4875-a627-5a46bd47dcc2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:09.842385 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-811cfe0a-ba79-4875-a627-5a46bd47dcc2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042008 May 24 15:26:09.842932 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 435/886] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:26:09 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:26:10.729183 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-b379a124-36b3-4b2c-b611-4be3e4f03cf3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:10.730103 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-b379a124-36b3-4b2c-b611-4be3e4f03cf3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:10.736882 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b379a124-36b3-4b2c-b611-4be3e4f03cf3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:10.737334 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b379a124-36b3-4b2c-b611-4be3e4f03cf3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:10.738089 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b379a124-36b3-4b2c-b611-4be3e4f03cf3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:10.738524 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b379a124-36b3-4b2c-b611-4be3e4f03cf3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:10.767249 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-b379a124-36b3-4b2c-b611-4be3e4f03cf3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042010 May 24 15:26:10.767798 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 452/887] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:10 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:10.773930 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-c7d129c5-cd59-4c85-86b2-b0f1bf18441c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:10.774879 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-c7d129c5-cd59-4c85-86b2-b0f1bf18441c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:10.781556 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c7d129c5-cd59-4c85-86b2-b0f1bf18441c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:10.782007 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c7d129c5-cd59-4c85-86b2-b0f1bf18441c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:10.782772 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c7d129c5-cd59-4c85-86b2-b0f1bf18441c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:10.783207 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c7d129c5-cd59-4c85-86b2-b0f1bf18441c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:10.811136 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-c7d129c5-cd59-4c85-86b2-b0f1bf18441c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041143 May 24 15:26:10.811674 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 436/888] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:10 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:10.853737 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-91c41fe5-7817-4748-a387-778a4dd64d4d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:10.854647 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-91c41fe5-7817-4748-a387-778a4dd64d4d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:10.860948 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-91c41fe5-7817-4748-a387-778a4dd64d4d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:10.861394 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-91c41fe5-7817-4748-a387-778a4dd64d4d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:10.862148 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-91c41fe5-7817-4748-a387-778a4dd64d4d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:10.862580 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-91c41fe5-7817-4748-a387-778a4dd64d4d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:10.892593 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-91c41fe5-7817-4748-a387-778a4dd64d4d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042716 May 24 15:26:10.893146 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 453/889] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:26:10 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:26:11.779389 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-c3854eb9-daa5-4528-b022-ffdcd43663f5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:11.780319 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-c3854eb9-daa5-4528-b022-ffdcd43663f5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:11.786761 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c3854eb9-daa5-4528-b022-ffdcd43663f5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:11.787198 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c3854eb9-daa5-4528-b022-ffdcd43663f5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:11.787949 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c3854eb9-daa5-4528-b022-ffdcd43663f5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:11.788404 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c3854eb9-daa5-4528-b022-ffdcd43663f5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:11.815731 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-c3854eb9-daa5-4528-b022-ffdcd43663f5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040868 May 24 15:26:11.816274 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 437/890] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:11 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:11.822338 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-3645fc54-acb3-4d46-85ad-257f7d4a0da6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:11.823258 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-3645fc54-acb3-4d46-85ad-257f7d4a0da6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:11.830199 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3645fc54-acb3-4d46-85ad-257f7d4a0da6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:11.830649 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3645fc54-acb3-4d46-85ad-257f7d4a0da6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:11.831400 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3645fc54-acb3-4d46-85ad-257f7d4a0da6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:11.831829 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3645fc54-acb3-4d46-85ad-257f7d4a0da6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:11.860635 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-3645fc54-acb3-4d46-85ad-257f7d4a0da6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042152 May 24 15:26:11.861177 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 454/891] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:11 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:11.904781 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a0558586-b41f-4bd5-8f92-83a85bbe4bfd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:11.905737 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a0558586-b41f-4bd5-8f92-83a85bbe4bfd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:11.911749 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a0558586-b41f-4bd5-8f92-83a85bbe4bfd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:11.912194 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a0558586-b41f-4bd5-8f92-83a85bbe4bfd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:11.912984 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a0558586-b41f-4bd5-8f92-83a85bbe4bfd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:11.913420 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a0558586-b41f-4bd5-8f92-83a85bbe4bfd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:11.941115 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a0558586-b41f-4bd5-8f92-83a85bbe4bfd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041025 May 24 15:26:11.941646 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 438/892] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:26:11 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:26:12.827159 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-555944d1-0341-4fa7-91f6-d066719ed142 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:12.828089 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-555944d1-0341-4fa7-91f6-d066719ed142 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:12.834688 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-555944d1-0341-4fa7-91f6-d066719ed142 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:12.835154 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-555944d1-0341-4fa7-91f6-d066719ed142 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:12.835900 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-555944d1-0341-4fa7-91f6-d066719ed142 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:12.836428 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-555944d1-0341-4fa7-91f6-d066719ed142 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:12.865695 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-555944d1-0341-4fa7-91f6-d066719ed142 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042573 May 24 15:26:12.866250 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 455/893] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:12 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:12.871093 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f6e833b8-0122-49c0-8c8b-59791053cd31 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:12.872017 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f6e833b8-0122-49c0-8c8b-59791053cd31 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:12.878535 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f6e833b8-0122-49c0-8c8b-59791053cd31 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:12.878984 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f6e833b8-0122-49c0-8c8b-59791053cd31 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:12.879741 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f6e833b8-0122-49c0-8c8b-59791053cd31 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:12.880173 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f6e833b8-0122-49c0-8c8b-59791053cd31 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:12.909074 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f6e833b8-0122-49c0-8c8b-59791053cd31 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041912 May 24 15:26:12.909620 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 439/894] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:12 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:26:12.952590 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-87b1adde-263c-41e0-953c-bd81edf8da0f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:12.953512 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-87b1adde-263c-41e0-953c-bd81edf8da0f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:12.959645 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-87b1adde-263c-41e0-953c-bd81edf8da0f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:12.960097 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-87b1adde-263c-41e0-953c-bd81edf8da0f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:12.960898 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-87b1adde-263c-41e0-953c-bd81edf8da0f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:12.961331 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-87b1adde-263c-41e0-953c-bd81edf8da0f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:12.991903 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-87b1adde-263c-41e0-953c-bd81edf8da0f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043292 May 24 15:26:12.992491 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 456/895] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:26:12 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:26:13.876813 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-beb425a5-fdf5-4237-8b88-3453be228cd5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:13.877743 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-beb425a5-fdf5-4237-8b88-3453be228cd5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:13.884535 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-beb425a5-fdf5-4237-8b88-3453be228cd5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:13.884996 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-beb425a5-fdf5-4237-8b88-3453be228cd5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:13.885777 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-beb425a5-fdf5-4237-8b88-3453be228cd5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:13.886847 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-beb425a5-fdf5-4237-8b88-3453be228cd5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:13.915230 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-beb425a5-fdf5-4237-8b88-3453be228cd5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042384 May 24 15:26:13.915998 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 440/896] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:13 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:13.920354 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-765ffc00-aec7-4890-9c2d-8451acfdc96e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:13.921217 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-765ffc00-aec7-4890-9c2d-8451acfdc96e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:13.927724 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-765ffc00-aec7-4890-9c2d-8451acfdc96e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:13.928164 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-765ffc00-aec7-4890-9c2d-8451acfdc96e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:13.928949 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-765ffc00-aec7-4890-9c2d-8451acfdc96e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:13.929373 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-765ffc00-aec7-4890-9c2d-8451acfdc96e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:13.965565 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-765ffc00-aec7-4890-9c2d-8451acfdc96e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049196 May 24 15:26:13.966115 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 457/897] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:13 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:26:14.002904 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-eacd0bfd-295c-4378-8f73-d032cacf3f91 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:14.003850 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-eacd0bfd-295c-4378-8f73-d032cacf3f91 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:14.009977 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-eacd0bfd-295c-4378-8f73-d032cacf3f91 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:14.010426 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-eacd0bfd-295c-4378-8f73-d032cacf3f91 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:14.011180 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-eacd0bfd-295c-4378-8f73-d032cacf3f91 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:14.011611 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-eacd0bfd-295c-4378-8f73-d032cacf3f91 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:14.039480 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-eacd0bfd-295c-4378-8f73-d032cacf3f91 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040559 May 24 15:26:14.040024 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 441/898] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:26:13 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:26:14.927422 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-1e28bf4a-a9a9-4e7e-a7d0-6c68a588f938 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:14.928274 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-1e28bf4a-a9a9-4e7e-a7d0-6c68a588f938 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:14.934765 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1e28bf4a-a9a9-4e7e-a7d0-6c68a588f938 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:14.935209 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1e28bf4a-a9a9-4e7e-a7d0-6c68a588f938 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:14.935961 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1e28bf4a-a9a9-4e7e-a7d0-6c68a588f938 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:14.936428 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1e28bf4a-a9a9-4e7e-a7d0-6c68a588f938 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:14.965257 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-1e28bf4a-a9a9-4e7e-a7d0-6c68a588f938 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041196 May 24 15:26:14.965805 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 458/899] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:14 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:14.976971 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f0a51248-b9ac-41e2-9b0a-8fbe97e96fe2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:14.977912 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f0a51248-b9ac-41e2-9b0a-8fbe97e96fe2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:14.984737 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f0a51248-b9ac-41e2-9b0a-8fbe97e96fe2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:14.985192 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f0a51248-b9ac-41e2-9b0a-8fbe97e96fe2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:14.985955 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f0a51248-b9ac-41e2-9b0a-8fbe97e96fe2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:14.986392 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f0a51248-b9ac-41e2-9b0a-8fbe97e96fe2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:15.014445 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f0a51248-b9ac-41e2-9b0a-8fbe97e96fe2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041371 May 24 15:26:15.014996 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 442/900] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:14 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:15.051383 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e1981e8e-fb50-41ac-9ff6-51be3a77c022 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:15.052293 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e1981e8e-fb50-41ac-9ff6-51be3a77c022 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:15.058406 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e1981e8e-fb50-41ac-9ff6-51be3a77c022 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:15.058879 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e1981e8e-fb50-41ac-9ff6-51be3a77c022 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:15.059633 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e1981e8e-fb50-41ac-9ff6-51be3a77c022 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:15.060060 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e1981e8e-fb50-41ac-9ff6-51be3a77c022 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:15.088780 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e1981e8e-fb50-41ac-9ff6-51be3a77c022 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041265 May 24 15:26:15.089991 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 459/901] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:26:15 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:26:15.977093 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-3f9cab04-1855-46ec-803d-eaa20853c808 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:15.978013 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-3f9cab04-1855-46ec-803d-eaa20853c808 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:15.985096 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3f9cab04-1855-46ec-803d-eaa20853c808 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:15.985539 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3f9cab04-1855-46ec-803d-eaa20853c808 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:15.986297 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3f9cab04-1855-46ec-803d-eaa20853c808 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:15.986732 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3f9cab04-1855-46ec-803d-eaa20853c808 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:16.002745 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:26:16.015728 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-3f9cab04-1855-46ec-803d-eaa20853c808 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043058 May 24 15:26:16.016272 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 443/902] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:15 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:16.025755 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-5df2cf8e-8ec2-49f8-84f2-afc7e9a1b1d3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:16.027166 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-5df2cf8e-8ec2-49f8-84f2-afc7e9a1b1d3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:16.033669 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5df2cf8e-8ec2-49f8-84f2-afc7e9a1b1d3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:16.034118 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5df2cf8e-8ec2-49f8-84f2-afc7e9a1b1d3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:16.034879 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5df2cf8e-8ec2-49f8-84f2-afc7e9a1b1d3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:16.035315 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5df2cf8e-8ec2-49f8-84f2-afc7e9a1b1d3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:16.049342 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:26:16.064678 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-5df2cf8e-8ec2-49f8-84f2-afc7e9a1b1d3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042805 May 24 15:26:16.065232 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 460/903] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:16 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:16.101043 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-429c7eaa-a678-4aa0-989d-ded5518d8e12 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:16.101970 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-429c7eaa-a678-4aa0-989d-ded5518d8e12 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:16.108967 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-429c7eaa-a678-4aa0-989d-ded5518d8e12 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:16.109415 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-429c7eaa-a678-4aa0-989d-ded5518d8e12 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:16.110169 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-429c7eaa-a678-4aa0-989d-ded5518d8e12 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:16.110603 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-429c7eaa-a678-4aa0-989d-ded5518d8e12 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:16.139269 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-429c7eaa-a678-4aa0-989d-ded5518d8e12 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042297 May 24 15:26:16.139805 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 444/904] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:26:16 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:26:17.027052 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-a97cb70a-15b4-4c27-b70e-3228b0679c31 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:17.028010 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-a97cb70a-15b4-4c27-b70e-3228b0679c31 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:17.034540 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a97cb70a-15b4-4c27-b70e-3228b0679c31 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:17.034988 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a97cb70a-15b4-4c27-b70e-3228b0679c31 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:17.035776 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a97cb70a-15b4-4c27-b70e-3228b0679c31 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:17.036209 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a97cb70a-15b4-4c27-b70e-3228b0679c31 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:17.065657 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-a97cb70a-15b4-4c27-b70e-3228b0679c31 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042523 May 24 15:26:17.066217 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 461/905] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:17 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:17.075897 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-dae3eab1-3c1b-4543-ac7a-0cbcbc9d2498 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:17.076875 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-dae3eab1-3c1b-4543-ac7a-0cbcbc9d2498 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:17.083306 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dae3eab1-3c1b-4543-ac7a-0cbcbc9d2498 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:17.083749 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dae3eab1-3c1b-4543-ac7a-0cbcbc9d2498 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:17.084529 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dae3eab1-3c1b-4543-ac7a-0cbcbc9d2498 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:17.084959 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dae3eab1-3c1b-4543-ac7a-0cbcbc9d2498 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:17.113564 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-dae3eab1-3c1b-4543-ac7a-0cbcbc9d2498 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041622 May 24 15:26:17.114147 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 445/906] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:17 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:17.150780 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-244b110a-b887-4723-8501-dd1d8a0b9629 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:17.151695 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-244b110a-b887-4723-8501-dd1d8a0b9629 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:17.157611 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-244b110a-b887-4723-8501-dd1d8a0b9629 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:17.158067 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-244b110a-b887-4723-8501-dd1d8a0b9629 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:17.158799 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-244b110a-b887-4723-8501-dd1d8a0b9629 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:17.159221 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-244b110a-b887-4723-8501-dd1d8a0b9629 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:17.187807 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-244b110a-b887-4723-8501-dd1d8a0b9629 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040976 May 24 15:26:17.188363 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 462/907] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:26:17 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:26:18.077796 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f362fabc-1c41-42c6-b715-e8276657e7c3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:18.078723 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f362fabc-1c41-42c6-b715-e8276657e7c3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:18.085246 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f362fabc-1c41-42c6-b715-e8276657e7c3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:18.085692 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f362fabc-1c41-42c6-b715-e8276657e7c3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:18.086457 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f362fabc-1c41-42c6-b715-e8276657e7c3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:18.086889 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f362fabc-1c41-42c6-b715-e8276657e7c3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:18.115874 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f362fabc-1c41-42c6-b715-e8276657e7c3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042536 May 24 15:26:18.116378 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 446/908] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:18 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:18.125383 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-bb2d824a-fd35-4fc8-9da0-7a1c21aa8704 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:18.126304 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-bb2d824a-fd35-4fc8-9da0-7a1c21aa8704 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:18.132805 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bb2d824a-fd35-4fc8-9da0-7a1c21aa8704 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:18.133254 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bb2d824a-fd35-4fc8-9da0-7a1c21aa8704 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:18.134010 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bb2d824a-fd35-4fc8-9da0-7a1c21aa8704 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:18.134442 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bb2d824a-fd35-4fc8-9da0-7a1c21aa8704 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:18.162936 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-bb2d824a-fd35-4fc8-9da0-7a1c21aa8704 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041459 May 24 15:26:18.163505 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 463/909] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:18 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:18.199800 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d1a7e0ee-0dd5-4bfa-b9b6-844f5f36395a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:18.200747 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d1a7e0ee-0dd5-4bfa-b9b6-844f5f36395a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:18.206715 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d1a7e0ee-0dd5-4bfa-b9b6-844f5f36395a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:18.207162 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d1a7e0ee-0dd5-4bfa-b9b6-844f5f36395a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:18.207917 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d1a7e0ee-0dd5-4bfa-b9b6-844f5f36395a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:18.208372 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d1a7e0ee-0dd5-4bfa-b9b6-844f5f36395a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:18.236222 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d1a7e0ee-0dd5-4bfa-b9b6-844f5f36395a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040925 May 24 15:26:18.236785 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 447/910] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:26:18 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:26:19.127196 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-2d702bab-f8af-4b71-81a0-e68eaf98bd00 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:19.128060 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-2d702bab-f8af-4b71-81a0-e68eaf98bd00 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:19.134520 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2d702bab-f8af-4b71-81a0-e68eaf98bd00 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:19.134967 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2d702bab-f8af-4b71-81a0-e68eaf98bd00 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:19.135721 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2d702bab-f8af-4b71-81a0-e68eaf98bd00 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:19.136155 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2d702bab-f8af-4b71-81a0-e68eaf98bd00 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:19.164730 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-2d702bab-f8af-4b71-81a0-e68eaf98bd00 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041469 May 24 15:26:19.165276 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 464/911] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:19 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:19.174624 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-8afd1964-4e59-4501-8a50-7ba3ff036921 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:19.175538 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-8afd1964-4e59-4501-8a50-7ba3ff036921 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:19.181989 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8afd1964-4e59-4501-8a50-7ba3ff036921 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:19.182429 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8afd1964-4e59-4501-8a50-7ba3ff036921 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:19.183206 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8afd1964-4e59-4501-8a50-7ba3ff036921 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:19.183633 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8afd1964-4e59-4501-8a50-7ba3ff036921 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:19.211536 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-8afd1964-4e59-4501-8a50-7ba3ff036921 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040828 May 24 15:26:19.212075 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 448/912] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:19 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:19.247224 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-09c2f8d7-8b8a-48e1-b982-848ccda004cc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:19.248134 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-09c2f8d7-8b8a-48e1-b982-848ccda004cc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:19.254515 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-09c2f8d7-8b8a-48e1-b982-848ccda004cc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:19.254958 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-09c2f8d7-8b8a-48e1-b982-848ccda004cc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:19.255710 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-09c2f8d7-8b8a-48e1-b982-848ccda004cc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:19.256135 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-09c2f8d7-8b8a-48e1-b982-848ccda004cc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:19.284911 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-09c2f8d7-8b8a-48e1-b982-848ccda004cc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041726 May 24 15:26:19.285808 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 465/913] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:26:19 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:26:20.176708 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-924cb566-ab89-4c66-b780-c3286805c59d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:20.177636 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-924cb566-ab89-4c66-b780-c3286805c59d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:20.184202 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-924cb566-ab89-4c66-b780-c3286805c59d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:20.185307 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-924cb566-ab89-4c66-b780-c3286805c59d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:20.186064 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-924cb566-ab89-4c66-b780-c3286805c59d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:20.186498 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-924cb566-ab89-4c66-b780-c3286805c59d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:20.214389 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-924cb566-ab89-4c66-b780-c3286805c59d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041673 May 24 15:26:20.214921 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 449/914] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:20 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:20.223125 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-a523fa70-a68c-44ac-94e6-1457efaa425a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:20.224056 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-a523fa70-a68c-44ac-94e6-1457efaa425a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:20.230110 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a523fa70-a68c-44ac-94e6-1457efaa425a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:20.230557 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a523fa70-a68c-44ac-94e6-1457efaa425a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:20.231803 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a523fa70-a68c-44ac-94e6-1457efaa425a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:20.232246 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a523fa70-a68c-44ac-94e6-1457efaa425a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:20.262748 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-a523fa70-a68c-44ac-94e6-1457efaa425a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043720 May 24 15:26:20.263317 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 466/915] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:20 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:20.298003 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f183ec6b-253d-43d5-abbb-0486bd2dae47 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:20.299043 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f183ec6b-253d-43d5-abbb-0486bd2dae47 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:20.305702 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f183ec6b-253d-43d5-abbb-0486bd2dae47 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:20.306158 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f183ec6b-253d-43d5-abbb-0486bd2dae47 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:20.306948 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f183ec6b-253d-43d5-abbb-0486bd2dae47 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:20.307386 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f183ec6b-253d-43d5-abbb-0486bd2dae47 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:20.337425 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f183ec6b-253d-43d5-abbb-0486bd2dae47 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044058 May 24 15:26:20.337899 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 450/916] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:26:20 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:26:21.224986 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-45204a89-13e9-4d9d-a002-63dc40ea0e9a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:21.225912 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-45204a89-13e9-4d9d-a002-63dc40ea0e9a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:21.232771 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-45204a89-13e9-4d9d-a002-63dc40ea0e9a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:21.233217 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-45204a89-13e9-4d9d-a002-63dc40ea0e9a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:21.233970 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-45204a89-13e9-4d9d-a002-63dc40ea0e9a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:21.234398 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-45204a89-13e9-4d9d-a002-63dc40ea0e9a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:21.262542 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-45204a89-13e9-4d9d-a002-63dc40ea0e9a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041489 May 24 15:26:21.263666 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 467/917] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:21 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:21.330265 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-bbdf9223-fa96-4a72-8ec4-26d8f0e693b3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:21.331188 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-bbdf9223-fa96-4a72-8ec4-26d8f0e693b3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:21.337667 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bbdf9223-fa96-4a72-8ec4-26d8f0e693b3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:21.338108 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bbdf9223-fa96-4a72-8ec4-26d8f0e693b3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:21.338864 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bbdf9223-fa96-4a72-8ec4-26d8f0e693b3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:21.339300 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bbdf9223-fa96-4a72-8ec4-26d8f0e693b3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:21.349466 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-dd80691e-c2dc-4a88-9c54-c32fe06237d1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:21.350382 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-dd80691e-c2dc-4a88-9c54-c32fe06237d1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:21.356338 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dd80691e-c2dc-4a88-9c54-c32fe06237d1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:21.356787 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dd80691e-c2dc-4a88-9c54-c32fe06237d1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:21.357830 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dd80691e-c2dc-4a88-9c54-c32fe06237d1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:21.358264 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dd80691e-c2dc-4a88-9c54-c32fe06237d1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:21.368035 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-bbdf9223-fa96-4a72-8ec4-26d8f0e693b3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041714 May 24 15:26:21.368631 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 451/918] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:21 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:21.386984 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-dd80691e-c2dc-4a88-9c54-c32fe06237d1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041369 May 24 15:26:21.387536 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 468/919] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:26:21 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 15:26:22.274762 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-2bf41727-49b5-4a2a-8383-68f2b4112620 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:22.275700 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-2bf41727-49b5-4a2a-8383-68f2b4112620 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:22.282373 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2bf41727-49b5-4a2a-8383-68f2b4112620 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:22.282809 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2bf41727-49b5-4a2a-8383-68f2b4112620 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:22.283578 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2bf41727-49b5-4a2a-8383-68f2b4112620 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:22.283985 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2bf41727-49b5-4a2a-8383-68f2b4112620 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:22.311687 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-2bf41727-49b5-4a2a-8383-68f2b4112620 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041026 May 24 15:26:22.312225 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 452/920] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:22 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:22.379555 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-244a4a3f-8d91-4814-af4d-e5fbfd64e1f2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:22.380431 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-244a4a3f-8d91-4814-af4d-e5fbfd64e1f2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:22.386871 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-244a4a3f-8d91-4814-af4d-e5fbfd64e1f2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:22.387321 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-244a4a3f-8d91-4814-af4d-e5fbfd64e1f2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:22.388654 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-244a4a3f-8d91-4814-af4d-e5fbfd64e1f2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:22.389084 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-244a4a3f-8d91-4814-af4d-e5fbfd64e1f2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:22.399254 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-8e16d8a5-58bb-490e-b13d-581c3d437805 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:22.400174 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-8e16d8a5-58bb-490e-b13d-581c3d437805 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:22.407498 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8e16d8a5-58bb-490e-b13d-581c3d437805 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:22.407952 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8e16d8a5-58bb-490e-b13d-581c3d437805 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:22.408759 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8e16d8a5-58bb-490e-b13d-581c3d437805 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:22.409192 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8e16d8a5-58bb-490e-b13d-581c3d437805 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:22.418138 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-244a4a3f-8d91-4814-af4d-e5fbfd64e1f2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042599 May 24 15:26:22.418709 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 469/921] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:22 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:22.437567 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-8e16d8a5-58bb-490e-b13d-581c3d437805 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042449 May 24 15:26:22.438117 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 453/922] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:26:22 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 15:26:23.323341 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-2ab91593-02bf-4a42-bb7f-1ad7e7c45f38 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:23.324185 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-2ab91593-02bf-4a42-bb7f-1ad7e7c45f38 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:23.330347 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2ab91593-02bf-4a42-bb7f-1ad7e7c45f38 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:23.330795 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2ab91593-02bf-4a42-bb7f-1ad7e7c45f38 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:23.331549 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2ab91593-02bf-4a42-bb7f-1ad7e7c45f38 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:23.331981 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2ab91593-02bf-4a42-bb7f-1ad7e7c45f38 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:23.361112 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-2ab91593-02bf-4a42-bb7f-1ad7e7c45f38 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041865 May 24 15:26:23.361655 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 470/923] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:23 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:23.429340 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-fe287c22-dae7-4683-afe4-0434e92f7815 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:23.430271 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-fe287c22-dae7-4683-afe4-0434e92f7815 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:23.436820 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fe287c22-dae7-4683-afe4-0434e92f7815 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:23.437267 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fe287c22-dae7-4683-afe4-0434e92f7815 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:23.438022 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fe287c22-dae7-4683-afe4-0434e92f7815 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:23.438453 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fe287c22-dae7-4683-afe4-0434e92f7815 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:23.448857 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-81f2e78f-951e-4546-97b1-2fa2b5867cc3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:23.449768 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-81f2e78f-951e-4546-97b1-2fa2b5867cc3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:23.456133 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-81f2e78f-951e-4546-97b1-2fa2b5867cc3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:23.456611 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-81f2e78f-951e-4546-97b1-2fa2b5867cc3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:23.457369 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-81f2e78f-951e-4546-97b1-2fa2b5867cc3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:23.457798 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-81f2e78f-951e-4546-97b1-2fa2b5867cc3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:23.467132 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-fe287c22-dae7-4683-afe4-0434e92f7815 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041703 May 24 15:26:23.467686 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 454/924] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:23 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:23.487560 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-81f2e78f-951e-4546-97b1-2fa2b5867cc3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042564 May 24 15:26:23.488115 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 471/925] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:26:23 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 15:26:24.372765 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-fca27154-7165-4cb8-9668-185ea811c624 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:24.373608 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-fca27154-7165-4cb8-9668-185ea811c624 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:24.379605 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fca27154-7165-4cb8-9668-185ea811c624 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:24.380046 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fca27154-7165-4cb8-9668-185ea811c624 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:24.380830 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fca27154-7165-4cb8-9668-185ea811c624 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:24.381261 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fca27154-7165-4cb8-9668-185ea811c624 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:24.409590 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-fca27154-7165-4cb8-9668-185ea811c624 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041397 May 24 15:26:24.410131 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 455/926] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:24 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:24.478531 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-0ad85498-4c33-4268-b1fe-fe703b90bee6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:24.479506 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-0ad85498-4c33-4268-b1fe-fe703b90bee6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:24.486650 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0ad85498-4c33-4268-b1fe-fe703b90bee6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:24.487090 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0ad85498-4c33-4268-b1fe-fe703b90bee6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:24.487835 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0ad85498-4c33-4268-b1fe-fe703b90bee6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:24.488262 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0ad85498-4c33-4268-b1fe-fe703b90bee6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:24.499390 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-db20becf-7848-4922-a63f-6ac9e4d543d7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:24.500366 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-db20becf-7848-4922-a63f-6ac9e4d543d7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:24.506700 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-db20becf-7848-4922-a63f-6ac9e4d543d7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:24.507149 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-db20becf-7848-4922-a63f-6ac9e4d543d7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:24.507918 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-db20becf-7848-4922-a63f-6ac9e4d543d7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:24.508378 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-db20becf-7848-4922-a63f-6ac9e4d543d7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:24.517092 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-0ad85498-4c33-4268-b1fe-fe703b90bee6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042397 May 24 15:26:24.517634 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 472/927] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:24 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:24.536953 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-db20becf-7848-4922-a63f-6ac9e4d543d7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041990 May 24 15:26:24.537500 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 456/928] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:26:24 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 15:26:25.421046 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-750707f6-f280-4085-bd3a-e678ef9afa5f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:25.421881 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-750707f6-f280-4085-bd3a-e678ef9afa5f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:25.427851 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-750707f6-f280-4085-bd3a-e678ef9afa5f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:25.428290 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-750707f6-f280-4085-bd3a-e678ef9afa5f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:25.429065 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-750707f6-f280-4085-bd3a-e678ef9afa5f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:25.429491 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-750707f6-f280-4085-bd3a-e678ef9afa5f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:25.458305 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-750707f6-f280-4085-bd3a-e678ef9afa5f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041301 May 24 15:26:25.458846 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 473/929] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:25 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:25.529098 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-8740d1e1-c744-42d2-bbd4-78e6644e5605 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:25.530020 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-8740d1e1-c744-42d2-bbd4-78e6644e5605 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:25.536442 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8740d1e1-c744-42d2-bbd4-78e6644e5605 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:25.536888 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8740d1e1-c744-42d2-bbd4-78e6644e5605 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:25.537639 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8740d1e1-c744-42d2-bbd4-78e6644e5605 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:25.538069 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8740d1e1-c744-42d2-bbd4-78e6644e5605 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:25.548230 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-a48bf58b-826b-4031-b688-07f9a0193ff9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:25.549159 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-a48bf58b-826b-4031-b688-07f9a0193ff9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:25.555440 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a48bf58b-826b-4031-b688-07f9a0193ff9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:25.555883 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a48bf58b-826b-4031-b688-07f9a0193ff9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:25.556657 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a48bf58b-826b-4031-b688-07f9a0193ff9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:25.557083 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a48bf58b-826b-4031-b688-07f9a0193ff9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:25.566289 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-8740d1e1-c744-42d2-bbd4-78e6644e5605 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041715 May 24 15:26:25.566842 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 457/930] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:25 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:25.586363 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-a48bf58b-826b-4031-b688-07f9a0193ff9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041984 May 24 15:26:25.586904 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 474/931] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:26:25 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 15:26:26.470182 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d306b59a-ecc2-44ce-9685-f216640c7130 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:26.471103 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d306b59a-ecc2-44ce-9685-f216640c7130 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:26.477118 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d306b59a-ecc2-44ce-9685-f216640c7130 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:26.477561 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d306b59a-ecc2-44ce-9685-f216640c7130 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:26.478315 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d306b59a-ecc2-44ce-9685-f216640c7130 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:26.478747 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d306b59a-ecc2-44ce-9685-f216640c7130 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:26.507278 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d306b59a-ecc2-44ce-9685-f216640c7130 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041549 May 24 15:26:26.507808 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 458/932] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:26 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:26.577286 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e1a5914c-391e-4180-9bb2-25bfa4e7228a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:26.578197 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e1a5914c-391e-4180-9bb2-25bfa4e7228a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:26.590210 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e1a5914c-391e-4180-9bb2-25bfa4e7228a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:26.591219 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e1a5914c-391e-4180-9bb2-25bfa4e7228a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:26.591969 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e1a5914c-391e-4180-9bb2-25bfa4e7228a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:26.592504 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e1a5914c-391e-4180-9bb2-25bfa4e7228a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:26.597800 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-95d70153-236e-4241-b522-a763c0d6d617 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:26.599400 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-95d70153-236e-4241-b522-a763c0d6d617 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:26.606855 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-95d70153-236e-4241-b522-a763c0d6d617 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:26.607561 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-95d70153-236e-4241-b522-a763c0d6d617 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:26.608357 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-95d70153-236e-4241-b522-a763c0d6d617 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:26.608821 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-95d70153-236e-4241-b522-a763c0d6d617 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:26.622870 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e1a5914c-391e-4180-9bb2-25bfa4e7228a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049311 May 24 15:26:26.623426 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 475/933] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:26 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:26.638294 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-95d70153-236e-4241-b522-a763c0d6d617 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044395 May 24 15:26:26.638835 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 459/934] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:26:26 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 15:26:27.518763 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-3ac7241c-07f6-4994-9a43-447542a9d78e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:27.519687 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-3ac7241c-07f6-4994-9a43-447542a9d78e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:27.525756 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3ac7241c-07f6-4994-9a43-447542a9d78e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:27.526199 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3ac7241c-07f6-4994-9a43-447542a9d78e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:27.526952 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3ac7241c-07f6-4994-9a43-447542a9d78e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:27.527382 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3ac7241c-07f6-4994-9a43-447542a9d78e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:27.555432 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-3ac7241c-07f6-4994-9a43-447542a9d78e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040650 May 24 15:26:27.555965 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 476/935] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:27 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:27.634499 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-b6a1f756-8480-436b-8113-9fa61de9c55e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:27.635412 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-b6a1f756-8480-436b-8113-9fa61de9c55e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:27.637763 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_api:SELECT=88 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:26:27.643241 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b6a1f756-8480-436b-8113-9fa61de9c55e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:27.643684 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b6a1f756-8480-436b-8113-9fa61de9c55e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:27.644771 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b6a1f756-8480-436b-8113-9fa61de9c55e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:27.644988 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b6a1f756-8480-436b-8113-9fa61de9c55e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:27.649044 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:26:27.652706 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-3d02dc82-b227-4c35-a7b4-1ba0c60773b3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:27.654328 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-3d02dc82-b227-4c35-a7b4-1ba0c60773b3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:27.662284 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3d02dc82-b227-4c35-a7b4-1ba0c60773b3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:27.662729 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3d02dc82-b227-4c35-a7b4-1ba0c60773b3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:27.663499 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3d02dc82-b227-4c35-a7b4-1ba0c60773b3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:27.663926 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3d02dc82-b227-4c35-a7b4-1ba0c60773b3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:27.667617 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:26:27.676643 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-b6a1f756-8480-436b-8113-9fa61de9c55e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046228 May 24 15:26:27.677412 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 460/936] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:27 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:27.700740 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-3d02dc82-b227-4c35-a7b4-1ba0c60773b3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054811 May 24 15:26:27.701296 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 477/937] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:26:27 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 15:26:28.567967 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-4ca1c768-f2e3-456a-95d8-f3c6938501d5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:28.569007 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-4ca1c768-f2e3-456a-95d8-f3c6938501d5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:28.575768 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4ca1c768-f2e3-456a-95d8-f3c6938501d5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:28.576155 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4ca1c768-f2e3-456a-95d8-f3c6938501d5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:28.576930 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4ca1c768-f2e3-456a-95d8-f3c6938501d5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:28.577359 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4ca1c768-f2e3-456a-95d8-f3c6938501d5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:28.605961 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-4ca1c768-f2e3-456a-95d8-f3c6938501d5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041856 May 24 15:26:28.606530 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 461/938] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:28 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:28.688249 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-8dcd6e81-cb74-4c6e-bd01-81c80b774381 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:28.689192 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-8dcd6e81-cb74-4c6e-bd01-81c80b774381 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:28.695600 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8dcd6e81-cb74-4c6e-bd01-81c80b774381 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:28.696038 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8dcd6e81-cb74-4c6e-bd01-81c80b774381 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:28.696811 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8dcd6e81-cb74-4c6e-bd01-81c80b774381 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:28.697240 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8dcd6e81-cb74-4c6e-bd01-81c80b774381 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:28.711546 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a86698a2-a453-4508-b402-efcebea9f6b2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:28.712482 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a86698a2-a453-4508-b402-efcebea9f6b2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:28.719301 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a86698a2-a453-4508-b402-efcebea9f6b2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:28.719741 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a86698a2-a453-4508-b402-efcebea9f6b2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:28.720530 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a86698a2-a453-4508-b402-efcebea9f6b2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:28.720959 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a86698a2-a453-4508-b402-efcebea9f6b2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:28.732859 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-8dcd6e81-cb74-4c6e-bd01-81c80b774381 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048157 May 24 15:26:28.733466 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 478/939] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:28 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:28.750669 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a86698a2-a453-4508-b402-efcebea9f6b2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042991 May 24 15:26:28.751216 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 462/940] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:26:28 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 15:26:29.617619 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e980333d-90bc-4a0b-983d-def503f63ee0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:29.618520 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e980333d-90bc-4a0b-983d-def503f63ee0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:29.624987 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e980333d-90bc-4a0b-983d-def503f63ee0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:29.625426 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e980333d-90bc-4a0b-983d-def503f63ee0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:29.626172 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e980333d-90bc-4a0b-983d-def503f63ee0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:29.626601 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e980333d-90bc-4a0b-983d-def503f63ee0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:29.654707 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e980333d-90bc-4a0b-983d-def503f63ee0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041056 May 24 15:26:29.655239 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 479/941] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:29 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:29.744401 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e8d6fae1-1ebe-4b06-bbee-1bb91c1cd5c3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:29.745334 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-e8d6fae1-1ebe-4b06-bbee-1bb91c1cd5c3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:29.752444 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e8d6fae1-1ebe-4b06-bbee-1bb91c1cd5c3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:29.752889 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e8d6fae1-1ebe-4b06-bbee-1bb91c1cd5c3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:29.753649 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e8d6fae1-1ebe-4b06-bbee-1bb91c1cd5c3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:29.754083 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e8d6fae1-1ebe-4b06-bbee-1bb91c1cd5c3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:29.761946 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-b4980292-3374-4d93-92fb-48223dca9382 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:29.762921 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-b4980292-3374-4d93-92fb-48223dca9382 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:29.769415 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b4980292-3374-4d93-92fb-48223dca9382 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:29.769864 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b4980292-3374-4d93-92fb-48223dca9382 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:29.770714 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b4980292-3374-4d93-92fb-48223dca9382 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:29.771062 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b4980292-3374-4d93-92fb-48223dca9382 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:29.783465 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-e8d6fae1-1ebe-4b06-bbee-1bb91c1cd5c3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043034 May 24 15:26:29.784023 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 463/942] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:29 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:29.800026 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-b4980292-3374-4d93-92fb-48223dca9382 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041890 May 24 15:26:29.800600 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 480/943] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:26:29 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 15:26:30.666086 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-4ec9c2bb-3431-420b-89c9-84ba98f748ab tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:30.667007 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-4ec9c2bb-3431-420b-89c9-84ba98f748ab tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:30.673235 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4ec9c2bb-3431-420b-89c9-84ba98f748ab tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:30.673676 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4ec9c2bb-3431-420b-89c9-84ba98f748ab tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:30.674427 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4ec9c2bb-3431-420b-89c9-84ba98f748ab tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:30.674856 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4ec9c2bb-3431-420b-89c9-84ba98f748ab tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:30.702965 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-4ec9c2bb-3431-420b-89c9-84ba98f748ab tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040819 May 24 15:26:30.703515 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 464/944] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:30 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:30.795098 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-5cad3263-7335-4d8a-8a99-02f06e8537fe tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:30.796019 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-5cad3263-7335-4d8a-8a99-02f06e8537fe tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:30.802506 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5cad3263-7335-4d8a-8a99-02f06e8537fe tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:30.802954 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5cad3263-7335-4d8a-8a99-02f06e8537fe tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:30.803707 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5cad3263-7335-4d8a-8a99-02f06e8537fe tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:30.804143 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5cad3263-7335-4d8a-8a99-02f06e8537fe tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:30.811315 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-30aa283f-de9b-4768-8a14-d21dc2f2e2aa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:30.812277 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-30aa283f-de9b-4768-8a14-d21dc2f2e2aa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:30.818869 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-30aa283f-de9b-4768-8a14-d21dc2f2e2aa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:30.819311 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-30aa283f-de9b-4768-8a14-d21dc2f2e2aa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:30.820062 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-30aa283f-de9b-4768-8a14-d21dc2f2e2aa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:30.820537 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-30aa283f-de9b-4768-8a14-d21dc2f2e2aa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:30.833571 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-5cad3263-7335-4d8a-8a99-02f06e8537fe tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042322 May 24 15:26:30.834321 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 481/945] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:30 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:30.849461 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-30aa283f-de9b-4768-8a14-d21dc2f2e2aa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042496 May 24 15:26:30.850002 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 465/946] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:26:30 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 15:26:31.714388 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-dacac261-c94a-46f8-8508-d77f74b9cb82 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:31.715300 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-dacac261-c94a-46f8-8508-d77f74b9cb82 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:31.721820 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dacac261-c94a-46f8-8508-d77f74b9cb82 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:31.722267 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dacac261-c94a-46f8-8508-d77f74b9cb82 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:31.723022 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dacac261-c94a-46f8-8508-d77f74b9cb82 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:31.723454 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dacac261-c94a-46f8-8508-d77f74b9cb82 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:31.751988 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-dacac261-c94a-46f8-8508-d77f74b9cb82 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041563 May 24 15:26:31.752562 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 482/947] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:31 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:31.845421 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-0f43abf7-b927-4345-88ec-fa49f81b3d11 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:31.846340 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-0f43abf7-b927-4345-88ec-fa49f81b3d11 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:31.852846 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0f43abf7-b927-4345-88ec-fa49f81b3d11 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:31.853310 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0f43abf7-b927-4345-88ec-fa49f81b3d11 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:31.854063 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0f43abf7-b927-4345-88ec-fa49f81b3d11 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:31.854514 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0f43abf7-b927-4345-88ec-fa49f81b3d11 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:31.861513 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-482c85f5-a7dc-47f7-87bf-c260d23309e4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:31.862422 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-482c85f5-a7dc-47f7-87bf-c260d23309e4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:31.868768 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-482c85f5-a7dc-47f7-87bf-c260d23309e4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:31.869219 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-482c85f5-a7dc-47f7-87bf-c260d23309e4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:31.869980 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-482c85f5-a7dc-47f7-87bf-c260d23309e4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:31.870417 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-482c85f5-a7dc-47f7-87bf-c260d23309e4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:31.883370 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-0f43abf7-b927-4345-88ec-fa49f81b3d11 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041800 May 24 15:26:31.883927 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 466/948] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:31 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:31.899583 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-482c85f5-a7dc-47f7-87bf-c260d23309e4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042101 May 24 15:26:31.900159 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 483/949] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:26:31 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 15:26:32.763353 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-5185b0d5-3554-490b-8569-77dac3484b67 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:32.764367 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-5185b0d5-3554-490b-8569-77dac3484b67 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:32.770333 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5185b0d5-3554-490b-8569-77dac3484b67 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:32.770780 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5185b0d5-3554-490b-8569-77dac3484b67 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:32.771535 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5185b0d5-3554-490b-8569-77dac3484b67 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:32.771966 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5185b0d5-3554-490b-8569-77dac3484b67 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:32.800270 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-5185b0d5-3554-490b-8569-77dac3484b67 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040969 May 24 15:26:32.800827 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 467/950] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:32 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:32.894468 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-2f5ab86a-05fb-4e92-b36f-c01df289d841 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:32.895437 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-2f5ab86a-05fb-4e92-b36f-c01df289d841 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:32.901937 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2f5ab86a-05fb-4e92-b36f-c01df289d841 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:32.902390 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2f5ab86a-05fb-4e92-b36f-c01df289d841 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:32.903154 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2f5ab86a-05fb-4e92-b36f-c01df289d841 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:32.903590 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2f5ab86a-05fb-4e92-b36f-c01df289d841 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:32.910932 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-ad690bce-cf54-41fc-af27-b3c2e184d601 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:32.911874 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-ad690bce-cf54-41fc-af27-b3c2e184d601 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:32.918235 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ad690bce-cf54-41fc-af27-b3c2e184d601 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:32.919167 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ad690bce-cf54-41fc-af27-b3c2e184d601 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:32.919915 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ad690bce-cf54-41fc-af27-b3c2e184d601 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:32.920368 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ad690bce-cf54-41fc-af27-b3c2e184d601 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:32.932350 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-2f5ab86a-05fb-4e92-b36f-c01df289d841 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041939 May 24 15:26:32.932916 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 484/951] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:32 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:32.949628 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-ad690bce-cf54-41fc-af27-b3c2e184d601 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042608 May 24 15:26:32.950185 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 468/952] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:26:32 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 15:26:33.811207 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-241762cb-6f94-4353-8d45-5b064f78ff08 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:33.812164 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-241762cb-6f94-4353-8d45-5b064f78ff08 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:33.818242 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-241762cb-6f94-4353-8d45-5b064f78ff08 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:33.818697 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-241762cb-6f94-4353-8d45-5b064f78ff08 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:33.819454 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-241762cb-6f94-4353-8d45-5b064f78ff08 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:33.819887 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-241762cb-6f94-4353-8d45-5b064f78ff08 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:33.850300 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-241762cb-6f94-4353-8d45-5b064f78ff08 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043543 May 24 15:26:33.850840 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 485/953] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:33 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:33.944756 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f26aacb1-04fa-40e2-98ab-caed805d06eb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:33.945682 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f26aacb1-04fa-40e2-98ab-caed805d06eb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:33.952688 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f26aacb1-04fa-40e2-98ab-caed805d06eb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:33.953128 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f26aacb1-04fa-40e2-98ab-caed805d06eb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:33.953879 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f26aacb1-04fa-40e2-98ab-caed805d06eb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:33.954304 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f26aacb1-04fa-40e2-98ab-caed805d06eb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:33.961094 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-1af0d1bd-0854-45f4-aef1-81d6f8f63cad tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:33.962051 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-1af0d1bd-0854-45f4-aef1-81d6f8f63cad tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:33.968421 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1af0d1bd-0854-45f4-aef1-81d6f8f63cad tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:33.968868 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1af0d1bd-0854-45f4-aef1-81d6f8f63cad tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:33.969630 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1af0d1bd-0854-45f4-aef1-81d6f8f63cad tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:33.970070 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1af0d1bd-0854-45f4-aef1-81d6f8f63cad tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:33.982543 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f26aacb1-04fa-40e2-98ab-caed805d06eb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041508 May 24 15:26:33.983205 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 469/954] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:33 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:33.999077 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-1af0d1bd-0854-45f4-aef1-81d6f8f63cad tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041855 May 24 15:26:33.999630 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 486/955] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:26:33 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 15:26:34.863142 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e36d73b8-f873-4f97-afa6-2d58d56e0644 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:34.863987 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-e36d73b8-f873-4f97-afa6-2d58d56e0644 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:34.870182 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e36d73b8-f873-4f97-afa6-2d58d56e0644 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:34.870625 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e36d73b8-f873-4f97-afa6-2d58d56e0644 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:34.871381 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e36d73b8-f873-4f97-afa6-2d58d56e0644 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:34.871841 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e36d73b8-f873-4f97-afa6-2d58d56e0644 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:34.901412 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-e36d73b8-f873-4f97-afa6-2d58d56e0644 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042487 May 24 15:26:34.902216 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 470/956] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:34 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:34.994108 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-eb6a9d0c-d3ed-4903-ac2f-01aceb01a570 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:34.995065 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-eb6a9d0c-d3ed-4903-ac2f-01aceb01a570 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:35.001721 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-eb6a9d0c-d3ed-4903-ac2f-01aceb01a570 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:35.002174 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-eb6a9d0c-d3ed-4903-ac2f-01aceb01a570 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:35.002931 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-eb6a9d0c-d3ed-4903-ac2f-01aceb01a570 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:35.003367 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-eb6a9d0c-d3ed-4903-ac2f-01aceb01a570 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:35.010664 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d6700c1b-58ee-41b7-8857-3abb45750af7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:35.011589 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d6700c1b-58ee-41b7-8857-3abb45750af7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:35.020561 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d6700c1b-58ee-41b7-8857-3abb45750af7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:35.021017 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d6700c1b-58ee-41b7-8857-3abb45750af7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:35.021792 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d6700c1b-58ee-41b7-8857-3abb45750af7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:35.022229 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d6700c1b-58ee-41b7-8857-3abb45750af7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:35.034113 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-eb6a9d0c-d3ed-4903-ac2f-01aceb01a570 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043821 May 24 15:26:35.034674 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 487/957] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:34 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:35.052112 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d6700c1b-58ee-41b7-8857-3abb45750af7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045399 May 24 15:26:35.052693 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 471/958] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:26:35 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 15:26:35.913441 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-9a00132a-f5eb-4084-b245-fc5491834a7f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:35.914364 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-9a00132a-f5eb-4084-b245-fc5491834a7f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:35.920440 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9a00132a-f5eb-4084-b245-fc5491834a7f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:35.920890 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9a00132a-f5eb-4084-b245-fc5491834a7f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:35.921646 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9a00132a-f5eb-4084-b245-fc5491834a7f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:35.922083 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9a00132a-f5eb-4084-b245-fc5491834a7f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:35.950295 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-9a00132a-f5eb-4084-b245-fc5491834a7f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040333 May 24 15:26:35.950843 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 488/959] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:35 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:36.045674 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-60068b87-a7cb-47b1-b19b-b7c63743eff6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:36.046643 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-60068b87-a7cb-47b1-b19b-b7c63743eff6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:36.053172 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-60068b87-a7cb-47b1-b19b-b7c63743eff6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:36.053626 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-60068b87-a7cb-47b1-b19b-b7c63743eff6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:36.054388 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-60068b87-a7cb-47b1-b19b-b7c63743eff6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:36.054824 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-60068b87-a7cb-47b1-b19b-b7c63743eff6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:36.063322 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-b6c2efac-34f2-4124-821b-72921ae8e466 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:36.064349 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-b6c2efac-34f2-4124-821b-72921ae8e466 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:36.070762 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b6c2efac-34f2-4124-821b-72921ae8e466 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:36.071466 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b6c2efac-34f2-4124-821b-72921ae8e466 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:36.071956 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b6c2efac-34f2-4124-821b-72921ae8e466 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:36.072412 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b6c2efac-34f2-4124-821b-72921ae8e466 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:36.085019 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-60068b87-a7cb-47b1-b19b-b7c63743eff6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043281 May 24 15:26:36.085595 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 472/960] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:36 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:36.101499 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-b6c2efac-34f2-4124-821b-72921ae8e466 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042490 May 24 15:26:36.102042 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 489/961] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:26:36 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 15:26:36.961950 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-dceb5315-70ed-4867-881b-d7e24639c9f1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:36.962946 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-dceb5315-70ed-4867-881b-d7e24639c9f1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:36.969503 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dceb5315-70ed-4867-881b-d7e24639c9f1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:36.969953 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dceb5315-70ed-4867-881b-d7e24639c9f1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:36.970714 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dceb5315-70ed-4867-881b-d7e24639c9f1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:36.971148 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dceb5315-70ed-4867-881b-d7e24639c9f1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:36.999877 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-dceb5315-70ed-4867-881b-d7e24639c9f1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042078 May 24 15:26:37.000450 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 473/962] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:36 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:37.096718 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-4500b44e-9673-46e6-9cde-122978b3a411 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:37.097645 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-4500b44e-9673-46e6-9cde-122978b3a411 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:37.099958 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_api:SELECT=88 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:26:37.105340 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4500b44e-9673-46e6-9cde-122978b3a411 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:37.105891 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4500b44e-9673-46e6-9cde-122978b3a411 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:37.107589 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4500b44e-9673-46e6-9cde-122978b3a411 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:37.108105 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4500b44e-9673-46e6-9cde-122978b3a411 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:37.113664 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-67d6739b-42cb-4304-86ff-679fd2d4baae tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:37.114583 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-67d6739b-42cb-4304-86ff-679fd2d4baae tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:37.120608 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-67d6739b-42cb-4304-86ff-679fd2d4baae tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:37.121057 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-67d6739b-42cb-4304-86ff-679fd2d4baae tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:37.121823 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-67d6739b-42cb-4304-86ff-679fd2d4baae tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:37.122260 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-67d6739b-42cb-4304-86ff-679fd2d4baae tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:37.137281 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-4500b44e-9673-46e6-9cde-122978b3a411 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044549 May 24 15:26:37.137842 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 490/963] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:37 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:37.150575 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-67d6739b-42cb-4304-86ff-679fd2d4baae tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041070 May 24 15:26:37.151115 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 474/964] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:26:37 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:26:38.011022 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e79aef02-6fc7-4a49-9c2e-98d63dca659a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:38.011963 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e79aef02-6fc7-4a49-9c2e-98d63dca659a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:38.017923 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e79aef02-6fc7-4a49-9c2e-98d63dca659a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:38.018369 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e79aef02-6fc7-4a49-9c2e-98d63dca659a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:38.019166 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e79aef02-6fc7-4a49-9c2e-98d63dca659a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:38.019593 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e79aef02-6fc7-4a49-9c2e-98d63dca659a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:38.047605 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e79aef02-6fc7-4a49-9c2e-98d63dca659a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040535 May 24 15:26:38.048140 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 491/965] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:38 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:38.148804 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a2cc5fd5-0bc6-4acb-b04c-bd0fd74bc243 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:38.149773 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a2cc5fd5-0bc6-4acb-b04c-bd0fd74bc243 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:38.156293 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a2cc5fd5-0bc6-4acb-b04c-bd0fd74bc243 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:38.156762 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a2cc5fd5-0bc6-4acb-b04c-bd0fd74bc243 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:38.157523 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a2cc5fd5-0bc6-4acb-b04c-bd0fd74bc243 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:38.157956 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a2cc5fd5-0bc6-4acb-b04c-bd0fd74bc243 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:38.162410 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-226bcc0a-1edd-4841-a2a6-f58d8b70eb9b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:38.163313 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-226bcc0a-1edd-4841-a2a6-f58d8b70eb9b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:38.170158 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-226bcc0a-1edd-4841-a2a6-f58d8b70eb9b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:38.170599 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-226bcc0a-1edd-4841-a2a6-f58d8b70eb9b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:38.171349 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-226bcc0a-1edd-4841-a2a6-f58d8b70eb9b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:38.171797 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-226bcc0a-1edd-4841-a2a6-f58d8b70eb9b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:38.187766 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a2cc5fd5-0bc6-4acb-b04c-bd0fd74bc243 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042904 May 24 15:26:38.188595 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 475/966] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:38 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:38.200993 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-226bcc0a-1edd-4841-a2a6-f58d8b70eb9b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042430 May 24 15:26:38.201537 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 492/967] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:26:38 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 15:26:39.059530 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-c563412f-fda3-422b-bf73-901b931641d9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:39.060514 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-c563412f-fda3-422b-bf73-901b931641d9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:39.066640 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c563412f-fda3-422b-bf73-901b931641d9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:39.067089 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c563412f-fda3-422b-bf73-901b931641d9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:39.067858 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c563412f-fda3-422b-bf73-901b931641d9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:39.068319 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c563412f-fda3-422b-bf73-901b931641d9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:39.093494 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:26:39.098557 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-c563412f-fda3-422b-bf73-901b931641d9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043555 May 24 15:26:39.099113 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 476/968] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:39 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:39.198933 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c8ef8c37-07d7-4b7e-b789-ad7962fa90ac tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:39.200536 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-c8ef8c37-07d7-4b7e-b789-ad7962fa90ac tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:39.207063 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c8ef8c37-07d7-4b7e-b789-ad7962fa90ac tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:39.207513 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c8ef8c37-07d7-4b7e-b789-ad7962fa90ac tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:39.208271 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c8ef8c37-07d7-4b7e-b789-ad7962fa90ac tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:39.208736 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c8ef8c37-07d7-4b7e-b789-ad7962fa90ac tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:39.212412 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-b79ebe16-511d-4ea5-9be7-04f8ceb34501 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:39.213335 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-b79ebe16-511d-4ea5-9be7-04f8ceb34501 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:39.219455 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b79ebe16-511d-4ea5-9be7-04f8ceb34501 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:39.219903 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b79ebe16-511d-4ea5-9be7-04f8ceb34501 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:39.220695 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b79ebe16-511d-4ea5-9be7-04f8ceb34501 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:39.221135 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b79ebe16-511d-4ea5-9be7-04f8ceb34501 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:39.232883 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:26:39.238299 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-c8ef8c37-07d7-4b7e-b789-ad7962fa90ac tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043284 May 24 15:26:39.238869 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 493/969] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:39 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:39.250692 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-b79ebe16-511d-4ea5-9be7-04f8ceb34501 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042315 May 24 15:26:39.251235 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 477/970] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:26:39 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:26:40.111220 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c6a7787a-a89b-4218-a3a6-7874b79ec393 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:40.112251 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-c6a7787a-a89b-4218-a3a6-7874b79ec393 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:40.118272 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c6a7787a-a89b-4218-a3a6-7874b79ec393 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:40.118716 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c6a7787a-a89b-4218-a3a6-7874b79ec393 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:40.119472 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c6a7787a-a89b-4218-a3a6-7874b79ec393 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:40.119904 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c6a7787a-a89b-4218-a3a6-7874b79ec393 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:40.147615 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-c6a7787a-a89b-4218-a3a6-7874b79ec393 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041478 May 24 15:26:40.148167 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 494/971] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:40 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:40.249825 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-6692403e-595f-47b5-8681-fb5be2824d93 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:40.250687 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-6692403e-595f-47b5-8681-fb5be2824d93 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:40.257159 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6692403e-595f-47b5-8681-fb5be2824d93 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:40.257603 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6692403e-595f-47b5-8681-fb5be2824d93 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:40.258353 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6692403e-595f-47b5-8681-fb5be2824d93 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:40.258780 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6692403e-595f-47b5-8681-fb5be2824d93 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:40.261814 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c82b8c2f-128c-438e-ba43-0a4013f9dff5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:40.263215 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-c82b8c2f-128c-438e-ba43-0a4013f9dff5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:40.269785 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c82b8c2f-128c-438e-ba43-0a4013f9dff5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:40.270231 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c82b8c2f-128c-438e-ba43-0a4013f9dff5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:40.271023 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c82b8c2f-128c-438e-ba43-0a4013f9dff5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:40.271453 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c82b8c2f-128c-438e-ba43-0a4013f9dff5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:40.288407 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-6692403e-595f-47b5-8681-fb5be2824d93 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042483 May 24 15:26:40.288948 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 478/972] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:40 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:40.300744 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-c82b8c2f-128c-438e-ba43-0a4013f9dff5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042889 May 24 15:26:40.301296 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 495/973] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:26:40 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 15:26:41.159187 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-6c0d1cb2-88aa-46d1-9e8a-ad67753c01ae tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:41.160155 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-6c0d1cb2-88aa-46d1-9e8a-ad67753c01ae tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:41.166322 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6c0d1cb2-88aa-46d1-9e8a-ad67753c01ae tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:41.166757 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6c0d1cb2-88aa-46d1-9e8a-ad67753c01ae tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:41.167502 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6c0d1cb2-88aa-46d1-9e8a-ad67753c01ae tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:41.167934 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6c0d1cb2-88aa-46d1-9e8a-ad67753c01ae tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:41.197179 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-6c0d1cb2-88aa-46d1-9e8a-ad67753c01ae tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041918 May 24 15:26:41.197712 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 479/974] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:41 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:41.311944 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a2a41aa5-a8e1-4fe5-97d6-b91b209b90a5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:41.312900 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a2a41aa5-a8e1-4fe5-97d6-b91b209b90a5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:41.319345 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a2a41aa5-a8e1-4fe5-97d6-b91b209b90a5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:41.319754 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a2a41aa5-a8e1-4fe5-97d6-b91b209b90a5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:41.320551 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a2a41aa5-a8e1-4fe5-97d6-b91b209b90a5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:41.320989 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a2a41aa5-a8e1-4fe5-97d6-b91b209b90a5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:41.350497 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a2a41aa5-a8e1-4fe5-97d6-b91b209b90a5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042421 May 24 15:26:41.351056 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 480/975] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:26:41 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 15:26:41.396489 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-71653512-cf4c-4a87-ae91-ccf2d8ee08be tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:41.397451 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-71653512-cf4c-4a87-ae91-ccf2d8ee08be tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:41.403938 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-71653512-cf4c-4a87-ae91-ccf2d8ee08be tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:41.404428 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-71653512-cf4c-4a87-ae91-ccf2d8ee08be tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:41.405193 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-71653512-cf4c-4a87-ae91-ccf2d8ee08be tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:41.405628 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-71653512-cf4c-4a87-ae91-ccf2d8ee08be tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:41.434541 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-71653512-cf4c-4a87-ae91-ccf2d8ee08be tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.138894 May 24 15:26:41.435100 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 496/976] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:41 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:42.208693 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-075455a3-3698-4cbc-8c89-be8b105cbaf5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:42.209625 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-075455a3-3698-4cbc-8c89-be8b105cbaf5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:42.215651 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-075455a3-3698-4cbc-8c89-be8b105cbaf5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:42.216101 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-075455a3-3698-4cbc-8c89-be8b105cbaf5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:42.216896 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-075455a3-3698-4cbc-8c89-be8b105cbaf5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:42.217330 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-075455a3-3698-4cbc-8c89-be8b105cbaf5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:42.245534 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-075455a3-3698-4cbc-8c89-be8b105cbaf5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040951 May 24 15:26:42.246071 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 481/977] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:42 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:42.362596 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-1a017ef3-1bc9-4b1b-8b23-5d49df4fd15c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:42.363427 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-1a017ef3-1bc9-4b1b-8b23-5d49df4fd15c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:42.369936 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1a017ef3-1bc9-4b1b-8b23-5d49df4fd15c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:42.370377 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1a017ef3-1bc9-4b1b-8b23-5d49df4fd15c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:42.371125 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1a017ef3-1bc9-4b1b-8b23-5d49df4fd15c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:42.372051 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1a017ef3-1bc9-4b1b-8b23-5d49df4fd15c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:42.400646 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-1a017ef3-1bc9-4b1b-8b23-5d49df4fd15c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042074 May 24 15:26:42.401274 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 497/978] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:26:42 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:26:42.445926 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f808df4f-6e7e-4cbb-9122-11f3d2ae34fd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:42.446847 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f808df4f-6e7e-4cbb-9122-11f3d2ae34fd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:42.453379 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f808df4f-6e7e-4cbb-9122-11f3d2ae34fd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:42.453830 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f808df4f-6e7e-4cbb-9122-11f3d2ae34fd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:42.454592 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f808df4f-6e7e-4cbb-9122-11f3d2ae34fd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:42.455059 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f808df4f-6e7e-4cbb-9122-11f3d2ae34fd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:42.483559 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f808df4f-6e7e-4cbb-9122-11f3d2ae34fd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041577 May 24 15:26:42.484101 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 482/979] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:42 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:43.257485 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-72fa8ef8-45ef-4211-b64a-5854e6c5fd0f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:43.258396 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-72fa8ef8-45ef-4211-b64a-5854e6c5fd0f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:43.264903 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-72fa8ef8-45ef-4211-b64a-5854e6c5fd0f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:43.265355 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-72fa8ef8-45ef-4211-b64a-5854e6c5fd0f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:43.266099 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-72fa8ef8-45ef-4211-b64a-5854e6c5fd0f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:43.266527 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-72fa8ef8-45ef-4211-b64a-5854e6c5fd0f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:43.295208 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-72fa8ef8-45ef-4211-b64a-5854e6c5fd0f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041657 May 24 15:26:43.295753 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 498/980] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:43 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:43.412585 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-29f8be3f-9436-4750-a672-12084e8af457 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:43.413419 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-29f8be3f-9436-4750-a672-12084e8af457 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:43.419466 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-29f8be3f-9436-4750-a672-12084e8af457 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:43.419905 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-29f8be3f-9436-4750-a672-12084e8af457 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:43.420676 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-29f8be3f-9436-4750-a672-12084e8af457 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:43.421108 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-29f8be3f-9436-4750-a672-12084e8af457 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:43.448952 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-29f8be3f-9436-4750-a672-12084e8af457 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040520 May 24 15:26:43.450059 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 483/981] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:26:43 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:26:43.494924 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-7dd63bef-4a76-4f73-be60-490a427fb8ec tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:43.495836 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-7dd63bef-4a76-4f73-be60-490a427fb8ec tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:43.502475 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7dd63bef-4a76-4f73-be60-490a427fb8ec tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:43.502927 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7dd63bef-4a76-4f73-be60-490a427fb8ec tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:43.503726 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7dd63bef-4a76-4f73-be60-490a427fb8ec tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:43.504157 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7dd63bef-4a76-4f73-be60-490a427fb8ec tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:43.532922 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-7dd63bef-4a76-4f73-be60-490a427fb8ec tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041960 May 24 15:26:43.533460 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 499/982] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:43 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:44.306771 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-56138a73-09b2-4358-8977-0c8cbd4e20b1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:44.307692 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-56138a73-09b2-4358-8977-0c8cbd4e20b1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:44.314190 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-56138a73-09b2-4358-8977-0c8cbd4e20b1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:44.314634 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-56138a73-09b2-4358-8977-0c8cbd4e20b1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:44.315393 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-56138a73-09b2-4358-8977-0c8cbd4e20b1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:44.315824 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-56138a73-09b2-4358-8977-0c8cbd4e20b1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:44.345658 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-56138a73-09b2-4358-8977-0c8cbd4e20b1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042840 May 24 15:26:44.346210 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 484/983] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:44 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:44.461182 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-04a9a806-7724-4b9f-9f33-5358d43e2c28 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:44.462103 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-04a9a806-7724-4b9f-9f33-5358d43e2c28 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:44.468689 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-04a9a806-7724-4b9f-9f33-5358d43e2c28 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:44.469133 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-04a9a806-7724-4b9f-9f33-5358d43e2c28 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:44.469889 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-04a9a806-7724-4b9f-9f33-5358d43e2c28 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:44.470323 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-04a9a806-7724-4b9f-9f33-5358d43e2c28 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:44.499100 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-04a9a806-7724-4b9f-9f33-5358d43e2c28 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041937 May 24 15:26:44.499704 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 500/984] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:26:44 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:26:44.544767 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-739a65df-0c39-425e-9a04-7a4d4b92ee47 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:44.545688 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-739a65df-0c39-425e-9a04-7a4d4b92ee47 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:44.551623 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-739a65df-0c39-425e-9a04-7a4d4b92ee47 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:44.552065 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-739a65df-0c39-425e-9a04-7a4d4b92ee47 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:44.552847 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-739a65df-0c39-425e-9a04-7a4d4b92ee47 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:44.553270 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-739a65df-0c39-425e-9a04-7a4d4b92ee47 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:44.581279 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-739a65df-0c39-425e-9a04-7a4d4b92ee47 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041013 May 24 15:26:44.581827 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 485/985] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:44 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:45.357203 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e08d8d6d-a7e5-45b0-8c30-aecf1bd6ce41 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:45.358294 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e08d8d6d-a7e5-45b0-8c30-aecf1bd6ce41 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:45.364722 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e08d8d6d-a7e5-45b0-8c30-aecf1bd6ce41 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:45.365170 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e08d8d6d-a7e5-45b0-8c30-aecf1bd6ce41 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:45.365928 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e08d8d6d-a7e5-45b0-8c30-aecf1bd6ce41 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:45.366361 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e08d8d6d-a7e5-45b0-8c30-aecf1bd6ce41 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:45.396184 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e08d8d6d-a7e5-45b0-8c30-aecf1bd6ce41 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043015 May 24 15:26:45.396777 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 501/986] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:45 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:45.510128 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-354066bb-5b18-4389-ae3e-b99632c346c1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:45.511126 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-354066bb-5b18-4389-ae3e-b99632c346c1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:45.517535 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-354066bb-5b18-4389-ae3e-b99632c346c1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:45.517977 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-354066bb-5b18-4389-ae3e-b99632c346c1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:45.518727 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-354066bb-5b18-4389-ae3e-b99632c346c1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:45.519153 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-354066bb-5b18-4389-ae3e-b99632c346c1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:45.547198 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-354066bb-5b18-4389-ae3e-b99632c346c1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041123 May 24 15:26:45.547781 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 486/987] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:26:45 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:26:45.592640 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-31365a17-728a-4013-82a7-c541a1ad5d07 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:45.593587 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-31365a17-728a-4013-82a7-c541a1ad5d07 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:45.599571 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-31365a17-728a-4013-82a7-c541a1ad5d07 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:45.600027 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-31365a17-728a-4013-82a7-c541a1ad5d07 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:45.600818 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-31365a17-728a-4013-82a7-c541a1ad5d07 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:45.601254 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-31365a17-728a-4013-82a7-c541a1ad5d07 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:45.630690 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-31365a17-728a-4013-82a7-c541a1ad5d07 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041955 May 24 15:26:45.631154 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 502/988] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:45 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:46.407735 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-51b6101b-1871-44d7-b371-ae8f099faecb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:46.408694 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-51b6101b-1871-44d7-b371-ae8f099faecb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:46.414657 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-51b6101b-1871-44d7-b371-ae8f099faecb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:46.415094 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-51b6101b-1871-44d7-b371-ae8f099faecb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:46.415843 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-51b6101b-1871-44d7-b371-ae8f099faecb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:46.416272 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-51b6101b-1871-44d7-b371-ae8f099faecb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:46.443651 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-51b6101b-1871-44d7-b371-ae8f099faecb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040013 May 24 15:26:46.444178 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 487/989] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:46 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:46.559626 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-4d4098fb-7477-43ba-b208-b62dbcefe546 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:46.560669 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-4d4098fb-7477-43ba-b208-b62dbcefe546 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:46.567259 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4d4098fb-7477-43ba-b208-b62dbcefe546 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:46.567701 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4d4098fb-7477-43ba-b208-b62dbcefe546 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:46.568482 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4d4098fb-7477-43ba-b208-b62dbcefe546 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:46.568911 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4d4098fb-7477-43ba-b208-b62dbcefe546 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:46.597609 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-4d4098fb-7477-43ba-b208-b62dbcefe546 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042378 May 24 15:26:46.598157 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 503/990] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:26:46 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:26:46.642510 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-b5a1f4c4-407e-4a36-b893-66dbde67fc06 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:46.643441 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-b5a1f4c4-407e-4a36-b893-66dbde67fc06 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:46.649994 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b5a1f4c4-407e-4a36-b893-66dbde67fc06 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:46.650447 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b5a1f4c4-407e-4a36-b893-66dbde67fc06 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:46.651209 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b5a1f4c4-407e-4a36-b893-66dbde67fc06 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:46.651648 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b5a1f4c4-407e-4a36-b893-66dbde67fc06 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:46.679445 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-b5a1f4c4-407e-4a36-b893-66dbde67fc06 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040842 May 24 15:26:46.680327 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 488/991] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:46 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:47.455075 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-5ddcb92b-e117-43bf-bc20-75532ea7d223 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:47.455920 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-5ddcb92b-e117-43bf-bc20-75532ea7d223 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:47.461897 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5ddcb92b-e117-43bf-bc20-75532ea7d223 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:47.462337 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5ddcb92b-e117-43bf-bc20-75532ea7d223 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:47.463081 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5ddcb92b-e117-43bf-bc20-75532ea7d223 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:47.463507 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5ddcb92b-e117-43bf-bc20-75532ea7d223 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:47.492287 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-5ddcb92b-e117-43bf-bc20-75532ea7d223 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041286 May 24 15:26:47.492841 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 504/992] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:47 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:47.610035 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-7c1f0aef-3277-40ea-a550-34eb5647d971 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:47.610988 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-7c1f0aef-3277-40ea-a550-34eb5647d971 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:47.617093 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7c1f0aef-3277-40ea-a550-34eb5647d971 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:47.617553 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7c1f0aef-3277-40ea-a550-34eb5647d971 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:47.618317 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7c1f0aef-3277-40ea-a550-34eb5647d971 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:47.618751 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7c1f0aef-3277-40ea-a550-34eb5647d971 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:47.646724 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-7c1f0aef-3277-40ea-a550-34eb5647d971 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041550 May 24 15:26:47.647286 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 489/993] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:26:47 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:26:47.691052 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-3097f508-d1bc-4bef-b05d-8eb1b1153a82 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:47.692067 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-3097f508-d1bc-4bef-b05d-8eb1b1153a82 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:47.698451 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3097f508-d1bc-4bef-b05d-8eb1b1153a82 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:47.698895 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3097f508-d1bc-4bef-b05d-8eb1b1153a82 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:47.700136 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3097f508-d1bc-4bef-b05d-8eb1b1153a82 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:47.700591 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3097f508-d1bc-4bef-b05d-8eb1b1153a82 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:47.729154 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-3097f508-d1bc-4bef-b05d-8eb1b1153a82 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041960 May 24 15:26:47.729716 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 505/994] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:47 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:48.503704 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-aaef0c79-f71a-44aa-ab9c-948e4dcb65a4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:48.504646 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-aaef0c79-f71a-44aa-ab9c-948e4dcb65a4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:48.511115 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-aaef0c79-f71a-44aa-ab9c-948e4dcb65a4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:48.511559 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-aaef0c79-f71a-44aa-ab9c-948e4dcb65a4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:48.512385 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-aaef0c79-f71a-44aa-ab9c-948e4dcb65a4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:48.512820 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-aaef0c79-f71a-44aa-ab9c-948e4dcb65a4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:48.540508 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-aaef0c79-f71a-44aa-ab9c-948e4dcb65a4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040731 May 24 15:26:48.541038 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 490/995] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:48 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:48.658361 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-fa8744e6-fb8d-4b65-b3f1-90bab34b7967 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:48.659218 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-fa8744e6-fb8d-4b65-b3f1-90bab34b7967 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:48.665213 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fa8744e6-fb8d-4b65-b3f1-90bab34b7967 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:48.665660 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fa8744e6-fb8d-4b65-b3f1-90bab34b7967 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:48.666416 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fa8744e6-fb8d-4b65-b3f1-90bab34b7967 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:48.666859 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fa8744e6-fb8d-4b65-b3f1-90bab34b7967 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:48.702264 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-fa8744e6-fb8d-4b65-b3f1-90bab34b7967 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047985 May 24 15:26:48.702897 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 506/996] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:26:48 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:26:48.740104 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a3e6ed28-d24d-47bc-93ef-493ad478f349 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:48.741070 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a3e6ed28-d24d-47bc-93ef-493ad478f349 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:48.747646 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a3e6ed28-d24d-47bc-93ef-493ad478f349 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:48.748088 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a3e6ed28-d24d-47bc-93ef-493ad478f349 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:48.748878 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a3e6ed28-d24d-47bc-93ef-493ad478f349 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:48.749311 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a3e6ed28-d24d-47bc-93ef-493ad478f349 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:48.776742 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a3e6ed28-d24d-47bc-93ef-493ad478f349 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040592 May 24 15:26:48.777286 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 491/997] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:48 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:49.551916 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-0153a26a-d08a-47cd-a7ff-6e09b4a5e15c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:49.552882 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-0153a26a-d08a-47cd-a7ff-6e09b4a5e15c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:49.559414 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0153a26a-d08a-47cd-a7ff-6e09b4a5e15c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:49.559894 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0153a26a-d08a-47cd-a7ff-6e09b4a5e15c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:49.560682 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0153a26a-d08a-47cd-a7ff-6e09b4a5e15c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:49.561116 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0153a26a-d08a-47cd-a7ff-6e09b4a5e15c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:49.589806 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-0153a26a-d08a-47cd-a7ff-6e09b4a5e15c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041779 May 24 15:26:49.590356 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 507/998] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:49 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:49.713517 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-03ee1942-4823-428d-9ad8-b009ddae0f65 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:49.714468 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-03ee1942-4823-428d-9ad8-b009ddae0f65 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:49.721056 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-03ee1942-4823-428d-9ad8-b009ddae0f65 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:49.721502 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-03ee1942-4823-428d-9ad8-b009ddae0f65 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:49.722255 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-03ee1942-4823-428d-9ad8-b009ddae0f65 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:49.722690 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-03ee1942-4823-428d-9ad8-b009ddae0f65 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:49.751661 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-03ee1942-4823-428d-9ad8-b009ddae0f65 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042114 May 24 15:26:49.752221 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 492/999] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:26:49 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:26:49.788596 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-6df6eb44-f6c9-4746-9f68-9504a2ef1200 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:49.789520 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-6df6eb44-f6c9-4746-9f68-9504a2ef1200 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:49.795565 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6df6eb44-f6c9-4746-9f68-9504a2ef1200 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:49.796047 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6df6eb44-f6c9-4746-9f68-9504a2ef1200 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:49.796800 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6df6eb44-f6c9-4746-9f68-9504a2ef1200 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:49.797264 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6df6eb44-f6c9-4746-9f68-9504a2ef1200 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:49.826131 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-6df6eb44-f6c9-4746-9f68-9504a2ef1200 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041443 May 24 15:26:49.826611 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 508/1000] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:49 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:50.601606 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d30edd5e-dce8-4290-b088-3069d3ec90a2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:50.602721 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d30edd5e-dce8-4290-b088-3069d3ec90a2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:50.609518 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d30edd5e-dce8-4290-b088-3069d3ec90a2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:50.609963 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d30edd5e-dce8-4290-b088-3069d3ec90a2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:50.610713 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d30edd5e-dce8-4290-b088-3069d3ec90a2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:50.611141 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d30edd5e-dce8-4290-b088-3069d3ec90a2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:50.627156 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:26:50.639780 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d30edd5e-dce8-4290-b088-3069d3ec90a2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042170 May 24 15:26:50.640330 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 493/1001] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:50 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:50.763743 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-0e976287-249d-4b25-a24e-c7d615a271b0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:50.764703 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-0e976287-249d-4b25-a24e-c7d615a271b0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:50.770660 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0e976287-249d-4b25-a24e-c7d615a271b0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:50.771109 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0e976287-249d-4b25-a24e-c7d615a271b0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:50.771855 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0e976287-249d-4b25-a24e-c7d615a271b0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:50.772284 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0e976287-249d-4b25-a24e-c7d615a271b0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:50.800949 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-0e976287-249d-4b25-a24e-c7d615a271b0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041748 May 24 15:26:50.801780 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 509/1002] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:26:50 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:26:50.837372 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f1ccca37-1d40-4660-b461-38f0fb3187eb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:50.838243 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f1ccca37-1d40-4660-b461-38f0fb3187eb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:50.845335 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f1ccca37-1d40-4660-b461-38f0fb3187eb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:50.845780 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f1ccca37-1d40-4660-b461-38f0fb3187eb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:50.846538 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f1ccca37-1d40-4660-b461-38f0fb3187eb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:50.846969 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f1ccca37-1d40-4660-b461-38f0fb3187eb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:50.874767 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f1ccca37-1d40-4660-b461-38f0fb3187eb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041366 May 24 15:26:50.875306 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 494/1003] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:50 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:51.651084 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c3c54bf1-b8db-4c20-a760-7c83fc0c79f0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:51.651927 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-c3c54bf1-b8db-4c20-a760-7c83fc0c79f0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:51.657794 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c3c54bf1-b8db-4c20-a760-7c83fc0c79f0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:51.658233 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c3c54bf1-b8db-4c20-a760-7c83fc0c79f0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:51.658976 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c3c54bf1-b8db-4c20-a760-7c83fc0c79f0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:51.659401 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c3c54bf1-b8db-4c20-a760-7c83fc0c79f0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:51.673151 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:26:51.688801 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-c3c54bf1-b8db-4c20-a760-7c83fc0c79f0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041767 May 24 15:26:51.689342 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 510/1004] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:51 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:51.812524 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-c1fbb932-d5d5-4aa1-b675-e0444f6ce35b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:51.813436 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-c1fbb932-d5d5-4aa1-b675-e0444f6ce35b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:51.819532 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c1fbb932-d5d5-4aa1-b675-e0444f6ce35b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:51.819968 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c1fbb932-d5d5-4aa1-b675-e0444f6ce35b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:51.820772 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c1fbb932-d5d5-4aa1-b675-e0444f6ce35b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:51.821198 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c1fbb932-d5d5-4aa1-b675-e0444f6ce35b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:51.849739 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-c1fbb932-d5d5-4aa1-b675-e0444f6ce35b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041212 May 24 15:26:51.850335 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 495/1005] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:26:51 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:26:51.886082 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-947f9e5b-2bac-407e-99e1-0983f2168641 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:51.887487 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-947f9e5b-2bac-407e-99e1-0983f2168641 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:51.893947 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-947f9e5b-2bac-407e-99e1-0983f2168641 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:51.894385 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-947f9e5b-2bac-407e-99e1-0983f2168641 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:51.895135 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-947f9e5b-2bac-407e-99e1-0983f2168641 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:51.895568 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-947f9e5b-2bac-407e-99e1-0983f2168641 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:51.924042 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-947f9e5b-2bac-407e-99e1-0983f2168641 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041738 May 24 15:26:51.924545 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 511/1006] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:51 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:52.701147 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-cca8cabf-6b2a-4189-bd77-e0099094686c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:52.702064 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-cca8cabf-6b2a-4189-bd77-e0099094686c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:52.708063 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cca8cabf-6b2a-4189-bd77-e0099094686c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:52.708535 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cca8cabf-6b2a-4189-bd77-e0099094686c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:52.709287 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cca8cabf-6b2a-4189-bd77-e0099094686c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:52.709714 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cca8cabf-6b2a-4189-bd77-e0099094686c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:52.737584 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-cca8cabf-6b2a-4189-bd77-e0099094686c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041136 May 24 15:26:52.738126 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 496/1007] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:52 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:52.872060 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-92ad9793-d5f2-4e86-9bb7-e2fc0fedee5d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:52.873415 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-92ad9793-d5f2-4e86-9bb7-e2fc0fedee5d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:52.879527 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-92ad9793-d5f2-4e86-9bb7-e2fc0fedee5d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:52.879976 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-92ad9793-d5f2-4e86-9bb7-e2fc0fedee5d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:52.880762 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-92ad9793-d5f2-4e86-9bb7-e2fc0fedee5d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:52.881195 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-92ad9793-d5f2-4e86-9bb7-e2fc0fedee5d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:52.911797 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-92ad9793-d5f2-4e86-9bb7-e2fc0fedee5d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054240 May 24 15:26:52.912499 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 512/1008] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:26:52 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:26:52.935609 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-ae5e2fdd-3a88-4b1f-a903-7a6e3214cb94 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:52.936572 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-ae5e2fdd-3a88-4b1f-a903-7a6e3214cb94 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:52.943013 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ae5e2fdd-3a88-4b1f-a903-7a6e3214cb94 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:52.943460 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ae5e2fdd-3a88-4b1f-a903-7a6e3214cb94 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:52.944216 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ae5e2fdd-3a88-4b1f-a903-7a6e3214cb94 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:52.944677 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ae5e2fdd-3a88-4b1f-a903-7a6e3214cb94 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:52.972102 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-ae5e2fdd-3a88-4b1f-a903-7a6e3214cb94 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041096 May 24 15:26:52.972683 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 497/1009] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:52 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:53.748628 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-cdbbc965-fecc-4073-baa0-e891e3618137 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:53.749698 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-cdbbc965-fecc-4073-baa0-e891e3618137 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:53.755649 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cdbbc965-fecc-4073-baa0-e891e3618137 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:53.756094 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cdbbc965-fecc-4073-baa0-e891e3618137 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:53.756885 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cdbbc965-fecc-4073-baa0-e891e3618137 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:53.757318 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cdbbc965-fecc-4073-baa0-e891e3618137 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:53.786184 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-cdbbc965-fecc-4073-baa0-e891e3618137 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041519 May 24 15:26:53.786724 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 513/1010] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:53 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:53.923481 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-2d460f72-6dcc-45d5-8ff6-f98765dd9ff2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:53.924432 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-2d460f72-6dcc-45d5-8ff6-f98765dd9ff2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:53.930485 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2d460f72-6dcc-45d5-8ff6-f98765dd9ff2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:53.930927 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2d460f72-6dcc-45d5-8ff6-f98765dd9ff2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:53.931681 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2d460f72-6dcc-45d5-8ff6-f98765dd9ff2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:53.932111 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2d460f72-6dcc-45d5-8ff6-f98765dd9ff2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:53.960445 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-2d460f72-6dcc-45d5-8ff6-f98765dd9ff2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041019 May 24 15:26:53.961023 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 498/1011] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:26:53 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:26:53.983321 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-9e90e483-b7d4-4bc1-80a1-c81967257939 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:53.984237 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-9e90e483-b7d4-4bc1-80a1-c81967257939 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:53.990562 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9e90e483-b7d4-4bc1-80a1-c81967257939 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:53.991003 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9e90e483-b7d4-4bc1-80a1-c81967257939 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:53.991782 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9e90e483-b7d4-4bc1-80a1-c81967257939 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:53.992215 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9e90e483-b7d4-4bc1-80a1-c81967257939 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:54.020961 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-9e90e483-b7d4-4bc1-80a1-c81967257939 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041933 May 24 15:26:54.021439 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 514/1012] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:53 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:54.798135 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-ec325d17-58f8-403c-a807-642ff9e7198e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:54.799061 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-ec325d17-58f8-403c-a807-642ff9e7198e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:54.805398 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ec325d17-58f8-403c-a807-642ff9e7198e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:54.805845 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ec325d17-58f8-403c-a807-642ff9e7198e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:54.806602 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ec325d17-58f8-403c-a807-642ff9e7198e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:54.807042 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ec325d17-58f8-403c-a807-642ff9e7198e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:54.834701 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-ec325d17-58f8-403c-a807-642ff9e7198e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041124 May 24 15:26:54.835184 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 499/1013] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:54 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:54.972465 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-7b699845-be94-457c-a818-b6db7bc1ca26 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:54.973382 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-7b699845-be94-457c-a818-b6db7bc1ca26 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:54.979396 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7b699845-be94-457c-a818-b6db7bc1ca26 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:54.979841 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7b699845-be94-457c-a818-b6db7bc1ca26 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:54.980623 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7b699845-be94-457c-a818-b6db7bc1ca26 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:54.981058 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7b699845-be94-457c-a818-b6db7bc1ca26 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:55.010577 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-7b699845-be94-457c-a818-b6db7bc1ca26 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042037 May 24 15:26:55.011205 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 515/1014] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:26:54 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:26:55.032572 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-6b2770b3-8186-4a96-87dc-a4459efa3b9e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:55.033495 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-6b2770b3-8186-4a96-87dc-a4459efa3b9e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:55.039801 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6b2770b3-8186-4a96-87dc-a4459efa3b9e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:55.040244 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6b2770b3-8186-4a96-87dc-a4459efa3b9e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:55.041025 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6b2770b3-8186-4a96-87dc-a4459efa3b9e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:55.041455 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6b2770b3-8186-4a96-87dc-a4459efa3b9e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:55.069612 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-6b2770b3-8186-4a96-87dc-a4459efa3b9e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041426 May 24 15:26:55.070610 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 500/1015] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:55 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:55.845939 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-319bbbfa-9ad5-47e9-8b74-7c259bdcc9a6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:55.846862 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-319bbbfa-9ad5-47e9-8b74-7c259bdcc9a6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:55.852869 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-319bbbfa-9ad5-47e9-8b74-7c259bdcc9a6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:55.853317 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-319bbbfa-9ad5-47e9-8b74-7c259bdcc9a6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:55.854066 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-319bbbfa-9ad5-47e9-8b74-7c259bdcc9a6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:55.854492 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-319bbbfa-9ad5-47e9-8b74-7c259bdcc9a6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:55.883238 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-319bbbfa-9ad5-47e9-8b74-7c259bdcc9a6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041183 May 24 15:26:55.883775 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 516/1016] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:55 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:56.022125 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-be2e58b2-129f-4cd3-aa97-f373759e8b81 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:56.023158 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-be2e58b2-129f-4cd3-aa97-f373759e8b81 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:56.029124 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-be2e58b2-129f-4cd3-aa97-f373759e8b81 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:56.029565 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-be2e58b2-129f-4cd3-aa97-f373759e8b81 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:56.030312 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-be2e58b2-129f-4cd3-aa97-f373759e8b81 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:56.030738 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-be2e58b2-129f-4cd3-aa97-f373759e8b81 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:56.058953 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-be2e58b2-129f-4cd3-aa97-f373759e8b81 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040808 May 24 15:26:56.059581 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 501/1017] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:26:56 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:26:56.080984 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-2ba0d5b5-68e5-4ce5-96ca-fed350bfc641 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:56.081911 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-2ba0d5b5-68e5-4ce5-96ca-fed350bfc641 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:56.088340 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2ba0d5b5-68e5-4ce5-96ca-fed350bfc641 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:56.088792 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2ba0d5b5-68e5-4ce5-96ca-fed350bfc641 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:56.089560 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2ba0d5b5-68e5-4ce5-96ca-fed350bfc641 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:56.089995 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2ba0d5b5-68e5-4ce5-96ca-fed350bfc641 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:56.118417 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-2ba0d5b5-68e5-4ce5-96ca-fed350bfc641 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041351 May 24 15:26:56.118907 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 517/1018] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:56 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:56.894732 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a52b7188-cf17-4544-982a-b100bee0da5f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:56.895666 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a52b7188-cf17-4544-982a-b100bee0da5f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:56.901705 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a52b7188-cf17-4544-982a-b100bee0da5f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:56.902147 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a52b7188-cf17-4544-982a-b100bee0da5f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:56.902899 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a52b7188-cf17-4544-982a-b100bee0da5f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:56.903982 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a52b7188-cf17-4544-982a-b100bee0da5f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:56.931754 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a52b7188-cf17-4544-982a-b100bee0da5f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041116 May 24 15:26:56.932380 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 502/1019] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:56 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:57.071086 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-89b17b22-9deb-470b-bff0-35a01547a66c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:57.071747 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-89b17b22-9deb-470b-bff0-35a01547a66c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:57.078494 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-89b17b22-9deb-470b-bff0-35a01547a66c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:57.078935 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-89b17b22-9deb-470b-bff0-35a01547a66c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:57.079739 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-89b17b22-9deb-470b-bff0-35a01547a66c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:57.080171 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-89b17b22-9deb-470b-bff0-35a01547a66c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:57.108845 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-89b17b22-9deb-470b-bff0-35a01547a66c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041800 May 24 15:26:57.109413 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 518/1020] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:26:57 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:26:57.129319 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d941499c-bce7-4e70-913c-6ba065c44598 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:57.130240 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d941499c-bce7-4e70-913c-6ba065c44598 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:57.136932 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d941499c-bce7-4e70-913c-6ba065c44598 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:57.137378 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d941499c-bce7-4e70-913c-6ba065c44598 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:57.138816 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d941499c-bce7-4e70-913c-6ba065c44598 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:57.139276 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d941499c-bce7-4e70-913c-6ba065c44598 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:57.167036 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d941499c-bce7-4e70-913c-6ba065c44598 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041882 May 24 15:26:57.167589 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 503/1021] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:57 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:57.943202 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-09476557-06d0-4df8-b98c-90b0be66f9e7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:57.944125 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-09476557-06d0-4df8-b98c-90b0be66f9e7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:57.950190 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-09476557-06d0-4df8-b98c-90b0be66f9e7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:57.950641 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-09476557-06d0-4df8-b98c-90b0be66f9e7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:57.951396 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-09476557-06d0-4df8-b98c-90b0be66f9e7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:57.951825 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-09476557-06d0-4df8-b98c-90b0be66f9e7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:57.979969 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-09476557-06d0-4df8-b98c-90b0be66f9e7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040700 May 24 15:26:57.980536 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 519/1022] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:57 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:58.120214 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-dc13a161-52e5-4eef-9c9f-bd766ce9c782 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:58.121191 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-dc13a161-52e5-4eef-9c9f-bd766ce9c782 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:58.123084 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_api:SELECT=88 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:26:58.128618 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dc13a161-52e5-4eef-9c9f-bd766ce9c782 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:58.129059 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dc13a161-52e5-4eef-9c9f-bd766ce9c782 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:58.129807 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dc13a161-52e5-4eef-9c9f-bd766ce9c782 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:58.130330 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dc13a161-52e5-4eef-9c9f-bd766ce9c782 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:58.160219 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-dc13a161-52e5-4eef-9c9f-bd766ce9c782 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044052 May 24 15:26:58.160797 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 504/1023] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:26:58 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:26:58.178322 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-320f6a7f-c65b-49a1-b7fd-d1fe8de5730d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:58.179241 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-320f6a7f-c65b-49a1-b7fd-d1fe8de5730d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:58.185689 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-320f6a7f-c65b-49a1-b7fd-d1fe8de5730d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:58.186135 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-320f6a7f-c65b-49a1-b7fd-d1fe8de5730d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:58.186890 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-320f6a7f-c65b-49a1-b7fd-d1fe8de5730d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:58.187324 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-320f6a7f-c65b-49a1-b7fd-d1fe8de5730d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:58.215119 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-320f6a7f-c65b-49a1-b7fd-d1fe8de5730d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040683 May 24 15:26:58.215594 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 520/1024] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:58 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:58.992189 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-b7ede3d3-1b73-401d-82e0-afd889469a4e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:58.993176 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-b7ede3d3-1b73-401d-82e0-afd889469a4e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:58.999899 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b7ede3d3-1b73-401d-82e0-afd889469a4e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:59.000362 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b7ede3d3-1b73-401d-82e0-afd889469a4e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:59.001120 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b7ede3d3-1b73-401d-82e0-afd889469a4e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:59.001547 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b7ede3d3-1b73-401d-82e0-afd889469a4e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:59.029734 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-b7ede3d3-1b73-401d-82e0-afd889469a4e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041459 May 24 15:26:59.030284 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 505/1025] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:58 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:26:59.172144 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-4bac0288-1fff-490f-b9cb-afb4177eec12 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:59.173083 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-4bac0288-1fff-490f-b9cb-afb4177eec12 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:59.179076 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4bac0288-1fff-490f-b9cb-afb4177eec12 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:59.179610 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4bac0288-1fff-490f-b9cb-afb4177eec12 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:59.180245 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4bac0288-1fff-490f-b9cb-afb4177eec12 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:59.180695 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4bac0288-1fff-490f-b9cb-afb4177eec12 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:59.208782 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-4bac0288-1fff-490f-b9cb-afb4177eec12 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041034 May 24 15:26:59.209318 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 521/1026] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:26:59 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:26:59.226769 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-1cb0f62c-d5d4-4761-b572-c00db657db7a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:26:59.227685 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-1cb0f62c-d5d4-4761-b572-c00db657db7a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:26:59.234811 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1cb0f62c-d5d4-4761-b572-c00db657db7a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:59.235253 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1cb0f62c-d5d4-4761-b572-c00db657db7a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:59.236004 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1cb0f62c-d5d4-4761-b572-c00db657db7a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:26:59.236530 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1cb0f62c-d5d4-4761-b572-c00db657db7a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:26:59.264559 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-1cb0f62c-d5d4-4761-b572-c00db657db7a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041608 May 24 15:26:59.265035 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 506/1027] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:26:59 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:00.041198 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-bda48bf0-d61c-404f-839b-a63030637848 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:00.042144 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-bda48bf0-d61c-404f-839b-a63030637848 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:00.048158 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bda48bf0-d61c-404f-839b-a63030637848 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:00.048626 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bda48bf0-d61c-404f-839b-a63030637848 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:00.049374 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bda48bf0-d61c-404f-839b-a63030637848 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:00.049804 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bda48bf0-d61c-404f-839b-a63030637848 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:00.078274 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-bda48bf0-d61c-404f-839b-a63030637848 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040942 May 24 15:27:00.078824 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 522/1028] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:00 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:00.221114 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-ae097305-5b65-43bb-a2fe-af67f242a9c0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:00.222036 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-ae097305-5b65-43bb-a2fe-af67f242a9c0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:00.228061 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ae097305-5b65-43bb-a2fe-af67f242a9c0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:00.228676 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ae097305-5b65-43bb-a2fe-af67f242a9c0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:00.229289 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ae097305-5b65-43bb-a2fe-af67f242a9c0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:00.229721 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ae097305-5b65-43bb-a2fe-af67f242a9c0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:00.258336 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-ae097305-5b65-43bb-a2fe-af67f242a9c0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041959 May 24 15:27:00.258882 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 507/1029] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:27:00 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:27:00.275395 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-167848d9-ae06-49d2-9485-f684dde90bfd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:00.277023 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-167848d9-ae06-49d2-9485-f684dde90bfd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:00.285208 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-167848d9-ae06-49d2-9485-f684dde90bfd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:00.285653 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-167848d9-ae06-49d2-9485-f684dde90bfd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:00.286421 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-167848d9-ae06-49d2-9485-f684dde90bfd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:00.286969 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-167848d9-ae06-49d2-9485-f684dde90bfd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:00.314927 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-167848d9-ae06-49d2-9485-f684dde90bfd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043763 May 24 15:27:00.315401 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 523/1030] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:00 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:01.090304 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-57a48108-2506-4470-9edf-d46dae19fac2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:01.091232 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-57a48108-2506-4470-9edf-d46dae19fac2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:01.097381 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-57a48108-2506-4470-9edf-d46dae19fac2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:01.097827 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-57a48108-2506-4470-9edf-d46dae19fac2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:01.098588 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-57a48108-2506-4470-9edf-d46dae19fac2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:01.099023 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-57a48108-2506-4470-9edf-d46dae19fac2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:01.129068 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-57a48108-2506-4470-9edf-d46dae19fac2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042953 May 24 15:27:01.129624 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 508/1031] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:01 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:01.270157 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-44331570-5902-4f37-850f-649fbc5a4e7e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:01.271081 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-44331570-5902-4f37-850f-649fbc5a4e7e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:01.277288 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-44331570-5902-4f37-850f-649fbc5a4e7e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:01.277853 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-44331570-5902-4f37-850f-649fbc5a4e7e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:01.278437 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-44331570-5902-4f37-850f-649fbc5a4e7e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:01.278871 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-44331570-5902-4f37-850f-649fbc5a4e7e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:01.308018 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-44331570-5902-4f37-850f-649fbc5a4e7e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041869 May 24 15:27:01.308610 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 524/1032] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:27:01 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:27:01.325662 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-404c9697-a5d1-4eaa-92f0-79368712cd8c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:01.326591 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-404c9697-a5d1-4eaa-92f0-79368712cd8c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:01.333068 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-404c9697-a5d1-4eaa-92f0-79368712cd8c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:01.333517 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-404c9697-a5d1-4eaa-92f0-79368712cd8c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:01.334281 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-404c9697-a5d1-4eaa-92f0-79368712cd8c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:01.334719 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-404c9697-a5d1-4eaa-92f0-79368712cd8c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:01.363630 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-404c9697-a5d1-4eaa-92f0-79368712cd8c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041845 May 24 15:27:01.364168 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 509/1033] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:01 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:02.141096 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-626b0b4d-bbc3-4595-a20f-4cd615f0070b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:02.142039 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-626b0b4d-bbc3-4595-a20f-4cd615f0070b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:02.147981 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-626b0b4d-bbc3-4595-a20f-4cd615f0070b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:02.148461 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-626b0b4d-bbc3-4595-a20f-4cd615f0070b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:02.149206 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-626b0b4d-bbc3-4595-a20f-4cd615f0070b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:02.149633 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-626b0b4d-bbc3-4595-a20f-4cd615f0070b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:02.177118 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-626b0b4d-bbc3-4595-a20f-4cd615f0070b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040641 May 24 15:27:02.177760 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 525/1034] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:02 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:02.319339 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-dd4054ba-d836-453a-928e-9571645bb7fa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:02.320289 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-dd4054ba-d836-453a-928e-9571645bb7fa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:02.326481 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dd4054ba-d836-453a-928e-9571645bb7fa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:02.327028 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dd4054ba-d836-453a-928e-9571645bb7fa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:02.327623 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dd4054ba-d836-453a-928e-9571645bb7fa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:02.328054 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dd4054ba-d836-453a-928e-9571645bb7fa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:02.332103 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:27:02.357152 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-dd4054ba-d836-453a-928e-9571645bb7fa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041895 May 24 15:27:02.358449 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 510/1035] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:27:02 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:27:02.375690 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c4b79037-1140-4330-acdb-622c90f7858b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:02.376660 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-c4b79037-1140-4330-acdb-622c90f7858b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:02.383094 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c4b79037-1140-4330-acdb-622c90f7858b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:02.383542 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c4b79037-1140-4330-acdb-622c90f7858b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:02.384325 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c4b79037-1140-4330-acdb-622c90f7858b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:02.384776 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c4b79037-1140-4330-acdb-622c90f7858b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:02.413366 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-c4b79037-1140-4330-acdb-622c90f7858b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042361 May 24 15:27:02.413924 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 526/1036] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:02 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:03.188421 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e891eead-21f9-4f4c-aece-f22e8e0894e9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:03.189421 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-e891eead-21f9-4f4c-aece-f22e8e0894e9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:03.195396 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e891eead-21f9-4f4c-aece-f22e8e0894e9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:03.195844 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e891eead-21f9-4f4c-aece-f22e8e0894e9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:03.196635 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e891eead-21f9-4f4c-aece-f22e8e0894e9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:03.197072 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e891eead-21f9-4f4c-aece-f22e8e0894e9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:03.226265 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-e891eead-21f9-4f4c-aece-f22e8e0894e9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041914 May 24 15:27:03.226824 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 511/1037] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:03 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:03.369210 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-2193f143-4cb6-45c5-bf84-8b7b4f87cc55 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:03.370081 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-2193f143-4cb6-45c5-bf84-8b7b4f87cc55 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:03.376652 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2193f143-4cb6-45c5-bf84-8b7b4f87cc55 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:03.377212 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2193f143-4cb6-45c5-bf84-8b7b4f87cc55 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:03.377837 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2193f143-4cb6-45c5-bf84-8b7b4f87cc55 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:03.378269 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2193f143-4cb6-45c5-bf84-8b7b4f87cc55 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:03.381082 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:27:03.408441 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-2193f143-4cb6-45c5-bf84-8b7b4f87cc55 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043216 May 24 15:27:03.408979 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 527/1038] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:27:03 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:27:03.424770 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-61fa7888-97cd-4172-8e72-ab216b144718 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:03.425696 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-61fa7888-97cd-4172-8e72-ab216b144718 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:03.432055 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-61fa7888-97cd-4172-8e72-ab216b144718 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:03.432540 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-61fa7888-97cd-4172-8e72-ab216b144718 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:03.433308 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-61fa7888-97cd-4172-8e72-ab216b144718 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:03.433742 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-61fa7888-97cd-4172-8e72-ab216b144718 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:03.462281 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-61fa7888-97cd-4172-8e72-ab216b144718 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041409 May 24 15:27:03.462815 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 512/1039] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:03 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:04.238397 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-67177068-f3b6-41fb-8112-ee92f30fb7c0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:04.239312 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-67177068-f3b6-41fb-8112-ee92f30fb7c0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:04.245322 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-67177068-f3b6-41fb-8112-ee92f30fb7c0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:04.245762 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-67177068-f3b6-41fb-8112-ee92f30fb7c0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:04.246505 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-67177068-f3b6-41fb-8112-ee92f30fb7c0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:04.246929 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-67177068-f3b6-41fb-8112-ee92f30fb7c0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:04.274405 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-67177068-f3b6-41fb-8112-ee92f30fb7c0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039959 May 24 15:27:04.274934 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 528/1040] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:04 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:04.424498 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a40504bc-f050-40ce-9fb4-3019a051659b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:04.425347 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a40504bc-f050-40ce-9fb4-3019a051659b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:04.431545 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a40504bc-f050-40ce-9fb4-3019a051659b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:04.431988 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a40504bc-f050-40ce-9fb4-3019a051659b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:04.432782 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a40504bc-f050-40ce-9fb4-3019a051659b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:04.433217 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a40504bc-f050-40ce-9fb4-3019a051659b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:04.461758 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a40504bc-f050-40ce-9fb4-3019a051659b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041778 May 24 15:27:04.462327 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 513/1041] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:27:04 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:27:04.474079 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-34234aa1-b779-4ad8-9f12-252e22d9b417 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:04.474994 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-34234aa1-b779-4ad8-9f12-252e22d9b417 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:04.481342 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-34234aa1-b779-4ad8-9f12-252e22d9b417 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:04.481783 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-34234aa1-b779-4ad8-9f12-252e22d9b417 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:04.483460 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-34234aa1-b779-4ad8-9f12-252e22d9b417 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:04.483887 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-34234aa1-b779-4ad8-9f12-252e22d9b417 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:04.511200 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-34234aa1-b779-4ad8-9f12-252e22d9b417 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041037 May 24 15:27:04.511735 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 529/1042] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:04 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:05.285973 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-3e5264d2-58ce-4a27-a766-cedcc7a79635 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:05.286926 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-3e5264d2-58ce-4a27-a766-cedcc7a79635 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:05.293004 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3e5264d2-58ce-4a27-a766-cedcc7a79635 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:05.293447 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3e5264d2-58ce-4a27-a766-cedcc7a79635 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:05.294202 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3e5264d2-58ce-4a27-a766-cedcc7a79635 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:05.294634 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3e5264d2-58ce-4a27-a766-cedcc7a79635 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:05.324704 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-3e5264d2-58ce-4a27-a766-cedcc7a79635 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042574 May 24 15:27:05.325186 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 514/1043] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:05 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:05.473447 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-5e94591b-6ce8-4daa-b737-79ab674a9c9e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:05.474357 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-5e94591b-6ce8-4daa-b737-79ab674a9c9e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:05.480567 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5e94591b-6ce8-4daa-b737-79ab674a9c9e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:05.481016 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5e94591b-6ce8-4daa-b737-79ab674a9c9e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:05.481765 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5e94591b-6ce8-4daa-b737-79ab674a9c9e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:05.482191 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5e94591b-6ce8-4daa-b737-79ab674a9c9e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:05.511669 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-5e94591b-6ce8-4daa-b737-79ab674a9c9e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042276 May 24 15:27:05.512207 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 530/1044] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:27:05 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 15:27:05.522936 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d1bb76fc-3313-4207-9f2e-8f6f739d5af5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:05.523860 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d1bb76fc-3313-4207-9f2e-8f6f739d5af5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:05.530419 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d1bb76fc-3313-4207-9f2e-8f6f739d5af5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:05.530858 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d1bb76fc-3313-4207-9f2e-8f6f739d5af5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:05.531613 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d1bb76fc-3313-4207-9f2e-8f6f739d5af5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:05.532040 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d1bb76fc-3313-4207-9f2e-8f6f739d5af5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:05.559923 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d1bb76fc-3313-4207-9f2e-8f6f739d5af5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040881 May 24 15:27:05.560476 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 515/1045] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:05 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:06.335228 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-9b31826f-d225-4803-bc61-61a516691c48 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:06.336070 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-9b31826f-d225-4803-bc61-61a516691c48 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:06.342762 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9b31826f-d225-4803-bc61-61a516691c48 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:06.343207 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9b31826f-d225-4803-bc61-61a516691c48 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:06.343953 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9b31826f-d225-4803-bc61-61a516691c48 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:06.344404 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9b31826f-d225-4803-bc61-61a516691c48 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:06.372441 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-9b31826f-d225-4803-bc61-61a516691c48 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041073 May 24 15:27:06.372983 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 531/1046] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:06 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:06.523083 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-620a2399-6f7c-454c-91fc-98fb216e955d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:06.524023 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-620a2399-6f7c-454c-91fc-98fb216e955d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:06.530215 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-620a2399-6f7c-454c-91fc-98fb216e955d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:06.530656 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-620a2399-6f7c-454c-91fc-98fb216e955d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:06.531412 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-620a2399-6f7c-454c-91fc-98fb216e955d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:06.531836 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-620a2399-6f7c-454c-91fc-98fb216e955d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:06.559960 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-620a2399-6f7c-454c-91fc-98fb216e955d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040897 May 24 15:27:06.560521 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 516/1047] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:27:06 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:27:06.573223 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-5eef7e95-1382-4fa5-a762-10f1e9dbd48a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:06.574148 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-5eef7e95-1382-4fa5-a762-10f1e9dbd48a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:06.581239 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5eef7e95-1382-4fa5-a762-10f1e9dbd48a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:06.581683 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5eef7e95-1382-4fa5-a762-10f1e9dbd48a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:06.582438 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5eef7e95-1382-4fa5-a762-10f1e9dbd48a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:06.582870 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5eef7e95-1382-4fa5-a762-10f1e9dbd48a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:06.610578 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-5eef7e95-1382-4fa5-a762-10f1e9dbd48a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041184 May 24 15:27:06.611066 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 532/1048] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:06 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:07.384807 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-b6bf483b-5a08-48fd-b93a-29b93d750b95 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:07.385650 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-b6bf483b-5a08-48fd-b93a-29b93d750b95 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:07.396064 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b6bf483b-5a08-48fd-b93a-29b93d750b95 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:07.396564 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b6bf483b-5a08-48fd-b93a-29b93d750b95 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:07.397323 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b6bf483b-5a08-48fd-b93a-29b93d750b95 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:07.397754 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b6bf483b-5a08-48fd-b93a-29b93d750b95 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:07.426868 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-b6bf483b-5a08-48fd-b93a-29b93d750b95 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046298 May 24 15:27:07.427413 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 517/1049] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:07 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:07.574246 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-ea5f08da-840b-4b26-a512-d17be2758256 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:07.575157 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-ea5f08da-840b-4b26-a512-d17be2758256 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:07.577970 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_api:SELECT=86 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:27:07.583447 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ea5f08da-840b-4b26-a512-d17be2758256 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:07.583895 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ea5f08da-840b-4b26-a512-d17be2758256 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:07.584690 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ea5f08da-840b-4b26-a512-d17be2758256 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:07.585126 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ea5f08da-840b-4b26-a512-d17be2758256 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:07.614060 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-ea5f08da-840b-4b26-a512-d17be2758256 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046098 May 24 15:27:07.614601 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 533/1050] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:27:07 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:27:07.621823 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-1b60d956-2382-4c4b-a397-e3d254e62c1d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:07.622737 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-1b60d956-2382-4c4b-a397-e3d254e62c1d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:07.628722 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1b60d956-2382-4c4b-a397-e3d254e62c1d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:07.629165 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1b60d956-2382-4c4b-a397-e3d254e62c1d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:07.629912 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1b60d956-2382-4c4b-a397-e3d254e62c1d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:07.630340 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1b60d956-2382-4c4b-a397-e3d254e62c1d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:07.658961 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-1b60d956-2382-4c4b-a397-e3d254e62c1d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040970 May 24 15:27:07.659439 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 518/1051] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:07 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:08.439012 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-948402e0-de31-433c-849a-728288584c8f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:08.439927 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-948402e0-de31-433c-849a-728288584c8f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:08.446252 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-948402e0-de31-433c-849a-728288584c8f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:08.446696 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-948402e0-de31-433c-849a-728288584c8f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:08.447442 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-948402e0-de31-433c-849a-728288584c8f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:08.447869 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-948402e0-de31-433c-849a-728288584c8f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:08.475388 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-948402e0-de31-433c-849a-728288584c8f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041002 May 24 15:27:08.475924 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 534/1052] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:08 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:08.625866 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-4dfe9184-e0fc-4437-ad79-9e893261ee6b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:08.626819 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-4dfe9184-e0fc-4437-ad79-9e893261ee6b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:08.633274 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4dfe9184-e0fc-4437-ad79-9e893261ee6b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:08.633726 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4dfe9184-e0fc-4437-ad79-9e893261ee6b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:08.634488 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4dfe9184-e0fc-4437-ad79-9e893261ee6b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:08.634922 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4dfe9184-e0fc-4437-ad79-9e893261ee6b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:08.663170 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-4dfe9184-e0fc-4437-ad79-9e893261ee6b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041270 May 24 15:27:08.663702 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 519/1053] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:27:08 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:27:08.670251 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-0d1287b5-3dc0-4708-b0d4-b19fef46ee33 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:08.671165 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-0d1287b5-3dc0-4708-b0d4-b19fef46ee33 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:08.678270 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0d1287b5-3dc0-4708-b0d4-b19fef46ee33 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:08.678715 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0d1287b5-3dc0-4708-b0d4-b19fef46ee33 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:08.679467 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0d1287b5-3dc0-4708-b0d4-b19fef46ee33 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:08.679897 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0d1287b5-3dc0-4708-b0d4-b19fef46ee33 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:08.707208 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-0d1287b5-3dc0-4708-b0d4-b19fef46ee33 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040770 May 24 15:27:08.707747 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 535/1054] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:08 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:27:09.487243 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-24a6b6f7-324b-45ab-b734-d729ddb3b1a2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:09.488163 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-24a6b6f7-324b-45ab-b734-d729ddb3b1a2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:09.494183 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-24a6b6f7-324b-45ab-b734-d729ddb3b1a2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:09.494628 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-24a6b6f7-324b-45ab-b734-d729ddb3b1a2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:09.495374 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-24a6b6f7-324b-45ab-b734-d729ddb3b1a2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:09.495802 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-24a6b6f7-324b-45ab-b734-d729ddb3b1a2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:09.524425 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-24a6b6f7-324b-45ab-b734-d729ddb3b1a2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041152 May 24 15:27:09.524953 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 520/1055] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:09 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:09.674832 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-a7d677dc-d567-431a-a39a-9f75825a8234 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:09.675745 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-a7d677dc-d567-431a-a39a-9f75825a8234 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:09.682212 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a7d677dc-d567-431a-a39a-9f75825a8234 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:09.682656 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a7d677dc-d567-431a-a39a-9f75825a8234 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:09.683406 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a7d677dc-d567-431a-a39a-9f75825a8234 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:09.683838 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a7d677dc-d567-431a-a39a-9f75825a8234 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:09.712788 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-a7d677dc-d567-431a-a39a-9f75825a8234 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041962 May 24 15:27:09.713550 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 536/1056] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:27:09 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:27:09.718728 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-0849e4c7-4a1a-4676-a6ed-426945324e7d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:09.719677 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-0849e4c7-4a1a-4676-a6ed-426945324e7d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:09.726142 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0849e4c7-4a1a-4676-a6ed-426945324e7d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:09.726580 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0849e4c7-4a1a-4676-a6ed-426945324e7d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:09.727334 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0849e4c7-4a1a-4676-a6ed-426945324e7d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:09.727760 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0849e4c7-4a1a-4676-a6ed-426945324e7d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:09.756606 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-0849e4c7-4a1a-4676-a6ed-426945324e7d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041778 May 24 15:27:09.757086 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 521/1057] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:09 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:10.536342 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-065b92d0-6bef-4113-895f-9c836b09a785 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:10.537287 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-065b92d0-6bef-4113-895f-9c836b09a785 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:10.543458 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-065b92d0-6bef-4113-895f-9c836b09a785 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:10.543907 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-065b92d0-6bef-4113-895f-9c836b09a785 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:10.544696 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-065b92d0-6bef-4113-895f-9c836b09a785 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:10.545131 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-065b92d0-6bef-4113-895f-9c836b09a785 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:10.573209 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-065b92d0-6bef-4113-895f-9c836b09a785 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040786 May 24 15:27:10.573750 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 537/1058] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:10 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:10.725002 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-7d0ba236-f670-4a22-b421-c749f815c67a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:10.725945 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-7d0ba236-f670-4a22-b421-c749f815c67a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:10.732705 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7d0ba236-f670-4a22-b421-c749f815c67a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:10.733146 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7d0ba236-f670-4a22-b421-c749f815c67a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:10.733902 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7d0ba236-f670-4a22-b421-c749f815c67a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:10.734373 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7d0ba236-f670-4a22-b421-c749f815c67a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:10.762007 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-7d0ba236-f670-4a22-b421-c749f815c67a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040964 May 24 15:27:10.762554 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 522/1059] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:27:10 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:27:10.768117 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-cc96a16a-90e2-47e2-a706-1409ebcc7987 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:10.769103 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-cc96a16a-90e2-47e2-a706-1409ebcc7987 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:10.775357 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cc96a16a-90e2-47e2-a706-1409ebcc7987 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:10.775798 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cc96a16a-90e2-47e2-a706-1409ebcc7987 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:10.776574 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cc96a16a-90e2-47e2-a706-1409ebcc7987 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:10.777003 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cc96a16a-90e2-47e2-a706-1409ebcc7987 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:10.805964 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-cc96a16a-90e2-47e2-a706-1409ebcc7987 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042847 May 24 15:27:10.806440 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 538/1060] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:10 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:27:11.584759 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-5a2df81f-ea2f-447a-b502-7f1c97936088 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:11.585694 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-5a2df81f-ea2f-447a-b502-7f1c97936088 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:11.591810 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5a2df81f-ea2f-447a-b502-7f1c97936088 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:11.592261 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5a2df81f-ea2f-447a-b502-7f1c97936088 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:11.593055 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5a2df81f-ea2f-447a-b502-7f1c97936088 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:11.593991 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5a2df81f-ea2f-447a-b502-7f1c97936088 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:11.622881 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-5a2df81f-ea2f-447a-b502-7f1c97936088 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042129 May 24 15:27:11.623489 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 523/1061] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:11 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:11.774248 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c9740937-d31c-48fb-8d42-3e748e59a3e5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:11.775165 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-c9740937-d31c-48fb-8d42-3e748e59a3e5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:11.782157 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c9740937-d31c-48fb-8d42-3e748e59a3e5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:11.782611 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c9740937-d31c-48fb-8d42-3e748e59a3e5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:11.783367 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c9740937-d31c-48fb-8d42-3e748e59a3e5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:11.783802 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c9740937-d31c-48fb-8d42-3e748e59a3e5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:11.817228 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e4a1d63b-0393-4e79-bd90-ef01023f4081 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:11.818899 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-e4a1d63b-0393-4e79-bd90-ef01023f4081 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:11.825970 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e4a1d63b-0393-4e79-bd90-ef01023f4081 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:11.826418 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e4a1d63b-0393-4e79-bd90-ef01023f4081 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:11.827204 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e4a1d63b-0393-4e79-bd90-ef01023f4081 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:11.827640 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e4a1d63b-0393-4e79-bd90-ef01023f4081 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:11.860485 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-e4a1d63b-0393-4e79-bd90-ef01023f4081 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047492 May 24 15:27:11.860990 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 524/1062] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:11 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:27:11.963448 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-c9740937-d31c-48fb-8d42-3e748e59a3e5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.193376 May 24 15:27:11.964279 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 539/1063] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:27:11 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:27:12.634489 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-4c5a80c1-76bc-420a-9f3e-13d336c9ad5c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:12.635412 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-4c5a80c1-76bc-420a-9f3e-13d336c9ad5c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:12.642162 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4c5a80c1-76bc-420a-9f3e-13d336c9ad5c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:12.642608 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4c5a80c1-76bc-420a-9f3e-13d336c9ad5c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:12.643368 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4c5a80c1-76bc-420a-9f3e-13d336c9ad5c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:12.643800 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4c5a80c1-76bc-420a-9f3e-13d336c9ad5c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:12.671502 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-4c5a80c1-76bc-420a-9f3e-13d336c9ad5c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041002 May 24 15:27:12.672033 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 525/1064] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:12 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:12.872154 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-a2f76bc3-c7d2-4946-870e-c1f0d0bdff40 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:12.873012 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-a2f76bc3-c7d2-4946-870e-c1f0d0bdff40 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:12.879991 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a2f76bc3-c7d2-4946-870e-c1f0d0bdff40 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:12.880467 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a2f76bc3-c7d2-4946-870e-c1f0d0bdff40 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:12.881222 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a2f76bc3-c7d2-4946-870e-c1f0d0bdff40 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:12.881652 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a2f76bc3-c7d2-4946-870e-c1f0d0bdff40 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:12.909476 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-a2f76bc3-c7d2-4946-870e-c1f0d0bdff40 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041357 May 24 15:27:12.910010 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 540/1065] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:12 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:12.975093 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-244eac59-2065-413f-890e-fcec3a0de484 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:12.976174 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-244eac59-2065-413f-890e-fcec3a0de484 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:12.982748 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-244eac59-2065-413f-890e-fcec3a0de484 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:12.985003 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-244eac59-2065-413f-890e-fcec3a0de484 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:12.985003 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-244eac59-2065-413f-890e-fcec3a0de484 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:12.985003 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-244eac59-2065-413f-890e-fcec3a0de484 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:13.009736 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:27:13.021341 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-244eac59-2065-413f-890e-fcec3a0de484 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043966 May 24 15:27:13.021341 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 526/1066] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:27:12 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:27:13.682865 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-0ca0ae61-b9c3-4786-8ece-d5a3ae75d1eb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:13.683797 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-0ca0ae61-b9c3-4786-8ece-d5a3ae75d1eb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:13.689794 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0ca0ae61-b9c3-4786-8ece-d5a3ae75d1eb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:13.690231 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0ca0ae61-b9c3-4786-8ece-d5a3ae75d1eb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:13.690979 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0ca0ae61-b9c3-4786-8ece-d5a3ae75d1eb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:13.691403 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0ca0ae61-b9c3-4786-8ece-d5a3ae75d1eb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:13.720276 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-0ca0ae61-b9c3-4786-8ece-d5a3ae75d1eb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041339 May 24 15:27:13.720832 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 541/1067] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:13 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:13.921392 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-00dd24ae-9ed4-4c48-abe5-8f871f591d6a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:13.922490 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-00dd24ae-9ed4-4c48-abe5-8f871f591d6a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:13.929087 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-00dd24ae-9ed4-4c48-abe5-8f871f591d6a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:13.929561 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-00dd24ae-9ed4-4c48-abe5-8f871f591d6a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:13.930325 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-00dd24ae-9ed4-4c48-abe5-8f871f591d6a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:13.930756 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-00dd24ae-9ed4-4c48-abe5-8f871f591d6a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:13.959689 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-00dd24ae-9ed4-4c48-abe5-8f871f591d6a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042147 May 24 15:27:13.960173 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 527/1068] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:13 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:14.026456 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-3e2f57b2-280d-4dbb-a1a5-bd5b269dc130 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:14.027482 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-3e2f57b2-280d-4dbb-a1a5-bd5b269dc130 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:14.034090 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3e2f57b2-280d-4dbb-a1a5-bd5b269dc130 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:14.034559 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3e2f57b2-280d-4dbb-a1a5-bd5b269dc130 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:14.035311 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3e2f57b2-280d-4dbb-a1a5-bd5b269dc130 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:14.035738 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3e2f57b2-280d-4dbb-a1a5-bd5b269dc130 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:14.064904 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-3e2f57b2-280d-4dbb-a1a5-bd5b269dc130 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042283 May 24 15:27:14.065608 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 542/1069] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:27:14 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:27:14.731739 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-0ef960f0-4a74-4446-81ed-27627976794b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:14.732949 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-0ef960f0-4a74-4446-81ed-27627976794b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:14.740051 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0ef960f0-4a74-4446-81ed-27627976794b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:14.740540 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0ef960f0-4a74-4446-81ed-27627976794b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:14.741305 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0ef960f0-4a74-4446-81ed-27627976794b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:14.741737 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0ef960f0-4a74-4446-81ed-27627976794b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:14.770171 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-0ef960f0-4a74-4446-81ed-27627976794b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042413 May 24 15:27:14.770715 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 528/1070] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:14 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:14.971669 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-3821d1d5-1354-4121-9329-013bd842ba7c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:14.972653 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-3821d1d5-1354-4121-9329-013bd842ba7c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:14.978723 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3821d1d5-1354-4121-9329-013bd842ba7c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:14.979162 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3821d1d5-1354-4121-9329-013bd842ba7c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:14.979913 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3821d1d5-1354-4121-9329-013bd842ba7c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:14.980371 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3821d1d5-1354-4121-9329-013bd842ba7c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:15.004034 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:27:15.008495 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-3821d1d5-1354-4121-9329-013bd842ba7c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041353 May 24 15:27:15.009051 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 543/1071] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:14 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:15.076607 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-4ce6b4f7-1fc6-4d5d-98c5-cab8c448b76e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:15.078147 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-4ce6b4f7-1fc6-4d5d-98c5-cab8c448b76e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:15.084356 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4ce6b4f7-1fc6-4d5d-98c5-cab8c448b76e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:15.084875 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4ce6b4f7-1fc6-4d5d-98c5-cab8c448b76e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:15.085700 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4ce6b4f7-1fc6-4d5d-98c5-cab8c448b76e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:15.086195 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4ce6b4f7-1fc6-4d5d-98c5-cab8c448b76e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:15.116407 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-4ce6b4f7-1fc6-4d5d-98c5-cab8c448b76e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044019 May 24 15:27:15.117052 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 529/1072] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:27:15 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:27:15.781252 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-8fdf15ab-763b-4c66-ba27-d13a18bab9eb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:15.782085 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-8fdf15ab-763b-4c66-ba27-d13a18bab9eb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:15.788559 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8fdf15ab-763b-4c66-ba27-d13a18bab9eb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:15.789001 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8fdf15ab-763b-4c66-ba27-d13a18bab9eb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:15.789748 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8fdf15ab-763b-4c66-ba27-d13a18bab9eb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:15.790175 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8fdf15ab-763b-4c66-ba27-d13a18bab9eb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:15.818859 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-8fdf15ab-763b-4c66-ba27-d13a18bab9eb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042028 May 24 15:27:15.819392 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 544/1073] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:15 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:16.019726 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-5154d24b-9029-4918-9bcf-e455f24d513d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:16.020673 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-5154d24b-9029-4918-9bcf-e455f24d513d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:16.027197 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5154d24b-9029-4918-9bcf-e455f24d513d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:16.027652 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5154d24b-9029-4918-9bcf-e455f24d513d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:16.028433 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5154d24b-9029-4918-9bcf-e455f24d513d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:16.028870 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5154d24b-9029-4918-9bcf-e455f24d513d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:16.056879 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-5154d24b-9029-4918-9bcf-e455f24d513d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041044 May 24 15:27:16.057365 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 530/1074] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:16 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:16.127670 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-2435ce3c-cb84-476c-a585-19411f81e87b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:16.128641 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-2435ce3c-cb84-476c-a585-19411f81e87b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:16.134511 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2435ce3c-cb84-476c-a585-19411f81e87b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:16.134953 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2435ce3c-cb84-476c-a585-19411f81e87b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:16.135706 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2435ce3c-cb84-476c-a585-19411f81e87b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:16.136138 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2435ce3c-cb84-476c-a585-19411f81e87b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:16.164963 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-2435ce3c-cb84-476c-a585-19411f81e87b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041181 May 24 15:27:16.165508 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 545/1075] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:27:16 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:27:16.830898 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-4d20db27-d46e-4b0f-99ec-c555469233b7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:16.831903 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-4d20db27-d46e-4b0f-99ec-c555469233b7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:16.837925 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4d20db27-d46e-4b0f-99ec-c555469233b7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:16.838315 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4d20db27-d46e-4b0f-99ec-c555469233b7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:16.839070 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4d20db27-d46e-4b0f-99ec-c555469233b7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:16.839495 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4d20db27-d46e-4b0f-99ec-c555469233b7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:16.869593 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-4d20db27-d46e-4b0f-99ec-c555469233b7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043105 May 24 15:27:16.870139 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 531/1076] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:16 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:17.068659 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-181199d8-62cc-4f4a-925e-9f369b7d639a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:17.069615 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-181199d8-62cc-4f4a-925e-9f369b7d639a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:17.076225 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-181199d8-62cc-4f4a-925e-9f369b7d639a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:17.076687 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-181199d8-62cc-4f4a-925e-9f369b7d639a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:17.077456 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-181199d8-62cc-4f4a-925e-9f369b7d639a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:17.078466 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-181199d8-62cc-4f4a-925e-9f369b7d639a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:17.106320 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-181199d8-62cc-4f4a-925e-9f369b7d639a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041584 May 24 15:27:17.106801 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 546/1077] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:17 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:17.176445 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d33c612c-6bb3-47f1-8026-725fbd65bec3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:17.177365 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d33c612c-6bb3-47f1-8026-725fbd65bec3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:17.183629 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d33c612c-6bb3-47f1-8026-725fbd65bec3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:17.184260 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d33c612c-6bb3-47f1-8026-725fbd65bec3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:17.185230 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d33c612c-6bb3-47f1-8026-725fbd65bec3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:17.185671 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d33c612c-6bb3-47f1-8026-725fbd65bec3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:17.215400 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d33c612c-6bb3-47f1-8026-725fbd65bec3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042893 May 24 15:27:17.219428 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 532/1078] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:27:17 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:27:17.880977 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-f3a6fa0d-d546-4b68-b344-00182216d468 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:17.881923 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-f3a6fa0d-d546-4b68-b344-00182216d468 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:17.888019 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f3a6fa0d-d546-4b68-b344-00182216d468 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:17.888498 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f3a6fa0d-d546-4b68-b344-00182216d468 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:17.889255 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f3a6fa0d-d546-4b68-b344-00182216d468 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:17.889684 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f3a6fa0d-d546-4b68-b344-00182216d468 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:17.919160 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-f3a6fa0d-d546-4b68-b344-00182216d468 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042128 May 24 15:27:17.919698 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 547/1079] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:17 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:18.118295 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-7ac0dcbb-ba6b-4b75-870a-32c2a45017b4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:18.119183 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-7ac0dcbb-ba6b-4b75-870a-32c2a45017b4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:18.125241 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7ac0dcbb-ba6b-4b75-870a-32c2a45017b4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:18.125667 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7ac0dcbb-ba6b-4b75-870a-32c2a45017b4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:18.126412 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7ac0dcbb-ba6b-4b75-870a-32c2a45017b4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:18.126839 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7ac0dcbb-ba6b-4b75-870a-32c2a45017b4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:18.154662 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-7ac0dcbb-ba6b-4b75-870a-32c2a45017b4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040363 May 24 15:27:18.155206 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 533/1080] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:18 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:18.226239 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c3a9cfa8-9eda-4537-aaa1-c9f15164cc9f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:18.226978 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-c3a9cfa8-9eda-4537-aaa1-c9f15164cc9f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:18.233555 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c3a9cfa8-9eda-4537-aaa1-c9f15164cc9f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:18.234030 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c3a9cfa8-9eda-4537-aaa1-c9f15164cc9f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:18.234776 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c3a9cfa8-9eda-4537-aaa1-c9f15164cc9f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:18.235204 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c3a9cfa8-9eda-4537-aaa1-c9f15164cc9f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:18.263539 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-c3a9cfa8-9eda-4537-aaa1-c9f15164cc9f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041421 May 24 15:27:18.264246 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 548/1081] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:27:18 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:27:18.930393 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-92e678e5-dfee-4b50-baec-069725771fdc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:18.931252 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-92e678e5-dfee-4b50-baec-069725771fdc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:18.938441 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-92e678e5-dfee-4b50-baec-069725771fdc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:18.938888 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-92e678e5-dfee-4b50-baec-069725771fdc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:18.939644 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-92e678e5-dfee-4b50-baec-069725771fdc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:18.940076 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-92e678e5-dfee-4b50-baec-069725771fdc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:18.968095 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-92e678e5-dfee-4b50-baec-069725771fdc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041735 May 24 15:27:18.968672 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 534/1082] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:18 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:19.166591 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-5c0a9e11-e764-4b38-96fe-c3d8ab26b79f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:19.167537 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-5c0a9e11-e764-4b38-96fe-c3d8ab26b79f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:19.174182 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5c0a9e11-e764-4b38-96fe-c3d8ab26b79f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:19.174629 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5c0a9e11-e764-4b38-96fe-c3d8ab26b79f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:19.175384 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5c0a9e11-e764-4b38-96fe-c3d8ab26b79f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:19.175812 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5c0a9e11-e764-4b38-96fe-c3d8ab26b79f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:19.203011 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-5c0a9e11-e764-4b38-96fe-c3d8ab26b79f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040359 May 24 15:27:19.203482 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 549/1083] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:19 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:19.274820 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-043436ff-418e-4662-91cf-929121f64796 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:19.275733 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-043436ff-418e-4662-91cf-929121f64796 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:19.282187 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-043436ff-418e-4662-91cf-929121f64796 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:19.282626 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-043436ff-418e-4662-91cf-929121f64796 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:19.283383 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-043436ff-418e-4662-91cf-929121f64796 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:19.283808 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-043436ff-418e-4662-91cf-929121f64796 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:19.313536 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-043436ff-418e-4662-91cf-929121f64796 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042546 May 24 15:27:19.314094 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 535/1084] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:27:19 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:27:19.979013 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-57b9fe3b-5f7c-4e4b-9ff5-1114b42831f2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:19.979922 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-57b9fe3b-5f7c-4e4b-9ff5-1114b42831f2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:19.986336 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-57b9fe3b-5f7c-4e4b-9ff5-1114b42831f2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:19.986778 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-57b9fe3b-5f7c-4e4b-9ff5-1114b42831f2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:19.987527 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-57b9fe3b-5f7c-4e4b-9ff5-1114b42831f2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:19.987955 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-57b9fe3b-5f7c-4e4b-9ff5-1114b42831f2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:20.016612 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-57b9fe3b-5f7c-4e4b-9ff5-1114b42831f2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040868 May 24 15:27:20.020504 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 550/1085] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:19 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:20.214526 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-2591e6c8-00fc-457e-aa37-64a791deb322 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:20.215513 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-2591e6c8-00fc-457e-aa37-64a791deb322 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:20.222124 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2591e6c8-00fc-457e-aa37-64a791deb322 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:20.222564 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2591e6c8-00fc-457e-aa37-64a791deb322 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:20.223317 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2591e6c8-00fc-457e-aa37-64a791deb322 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:20.223744 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2591e6c8-00fc-457e-aa37-64a791deb322 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:20.252740 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-2591e6c8-00fc-457e-aa37-64a791deb322 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042105 May 24 15:27:20.253244 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 536/1086] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:20 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:20.324987 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-dd9e51b5-6e3f-4935-9d2d-138b33c72822 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:20.325904 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-dd9e51b5-6e3f-4935-9d2d-138b33c72822 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:20.331775 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dd9e51b5-6e3f-4935-9d2d-138b33c72822 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:20.332221 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dd9e51b5-6e3f-4935-9d2d-138b33c72822 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:20.333018 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dd9e51b5-6e3f-4935-9d2d-138b33c72822 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:20.333448 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dd9e51b5-6e3f-4935-9d2d-138b33c72822 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:20.362660 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-dd9e51b5-6e3f-4935-9d2d-138b33c72822 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041629 May 24 15:27:20.363229 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 551/1087] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:27:20 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:27:21.028002 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a5b4718e-4f2c-439a-8564-15d0ad199114 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:21.028957 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a5b4718e-4f2c-439a-8564-15d0ad199114 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:21.035574 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a5b4718e-4f2c-439a-8564-15d0ad199114 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:21.036017 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a5b4718e-4f2c-439a-8564-15d0ad199114 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:21.036801 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a5b4718e-4f2c-439a-8564-15d0ad199114 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:21.037230 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a5b4718e-4f2c-439a-8564-15d0ad199114 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:21.066954 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a5b4718e-4f2c-439a-8564-15d0ad199114 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042876 May 24 15:27:21.067516 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 537/1088] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:21 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:21.264282 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-de58384d-616c-433f-9051-a1b9fed44df4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:21.265206 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-de58384d-616c-433f-9051-a1b9fed44df4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:21.272059 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-de58384d-616c-433f-9051-a1b9fed44df4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:21.272539 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-de58384d-616c-433f-9051-a1b9fed44df4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:21.273288 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-de58384d-616c-433f-9051-a1b9fed44df4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:21.273734 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-de58384d-616c-433f-9051-a1b9fed44df4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:21.301536 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-de58384d-616c-433f-9051-a1b9fed44df4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041264 May 24 15:27:21.302079 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 552/1089] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:21 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:21.374081 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-b20ffaf0-f30c-426e-8b03-99f35c7e3ad2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:21.375005 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-b20ffaf0-f30c-426e-8b03-99f35c7e3ad2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:21.382118 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b20ffaf0-f30c-426e-8b03-99f35c7e3ad2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:21.382568 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b20ffaf0-f30c-426e-8b03-99f35c7e3ad2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:21.383372 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b20ffaf0-f30c-426e-8b03-99f35c7e3ad2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:21.383807 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b20ffaf0-f30c-426e-8b03-99f35c7e3ad2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:21.420780 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-b20ffaf0-f30c-426e-8b03-99f35c7e3ad2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050657 May 24 15:27:21.421339 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 538/1090] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:27:21 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:27:22.078484 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-478fc173-21bd-4c21-a2c7-710ede4166fd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:22.079398 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-478fc173-21bd-4c21-a2c7-710ede4166fd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:22.085368 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-478fc173-21bd-4c21-a2c7-710ede4166fd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:22.085807 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-478fc173-21bd-4c21-a2c7-710ede4166fd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:22.086556 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-478fc173-21bd-4c21-a2c7-710ede4166fd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:22.086981 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-478fc173-21bd-4c21-a2c7-710ede4166fd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:22.115800 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-478fc173-21bd-4c21-a2c7-710ede4166fd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041273 May 24 15:27:22.116349 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 553/1091] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:22 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:22.313025 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-5c66041a-6664-4cda-8a37-74f72260cf83 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:22.313951 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-5c66041a-6664-4cda-8a37-74f72260cf83 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:22.320041 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5c66041a-6664-4cda-8a37-74f72260cf83 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:22.320537 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5c66041a-6664-4cda-8a37-74f72260cf83 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:22.321346 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5c66041a-6664-4cda-8a37-74f72260cf83 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:22.321734 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5c66041a-6664-4cda-8a37-74f72260cf83 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:22.349765 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-5c66041a-6664-4cda-8a37-74f72260cf83 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040706 May 24 15:27:22.350308 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 539/1092] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:22 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:22.432065 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-ac478661-99d8-4256-81fd-7507c0aa40d5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:22.433021 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-ac478661-99d8-4256-81fd-7507c0aa40d5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:22.439126 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ac478661-99d8-4256-81fd-7507c0aa40d5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:22.439579 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ac478661-99d8-4256-81fd-7507c0aa40d5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:22.440370 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ac478661-99d8-4256-81fd-7507c0aa40d5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:22.440805 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ac478661-99d8-4256-81fd-7507c0aa40d5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:22.471080 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-ac478661-99d8-4256-81fd-7507c0aa40d5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042884 May 24 15:27:22.471649 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 554/1093] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:27:22 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:27:23.128110 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-94c3e0df-dd59-4611-9338-4f814c7060ac tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:23.129118 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-94c3e0df-dd59-4611-9338-4f814c7060ac tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:23.136289 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-94c3e0df-dd59-4611-9338-4f814c7060ac tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:23.136765 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-94c3e0df-dd59-4611-9338-4f814c7060ac tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:23.137528 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-94c3e0df-dd59-4611-9338-4f814c7060ac tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:23.137954 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-94c3e0df-dd59-4611-9338-4f814c7060ac tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:23.167661 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-94c3e0df-dd59-4611-9338-4f814c7060ac tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044392 May 24 15:27:23.168247 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 540/1094] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:23 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:23.361273 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-71dd75a7-049c-4e16-94dd-52dad251a669 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:23.362111 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-71dd75a7-049c-4e16-94dd-52dad251a669 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:23.368202 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-71dd75a7-049c-4e16-94dd-52dad251a669 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:23.368684 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-71dd75a7-049c-4e16-94dd-52dad251a669 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:23.369438 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-71dd75a7-049c-4e16-94dd-52dad251a669 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:23.369869 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-71dd75a7-049c-4e16-94dd-52dad251a669 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:23.400139 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-71dd75a7-049c-4e16-94dd-52dad251a669 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043669 May 24 15:27:23.400723 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 555/1095] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:23 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:27:23.483113 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-0d7ae4f5-7f7d-401e-bcf6-b42962f53118 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:23.483784 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-0d7ae4f5-7f7d-401e-bcf6-b42962f53118 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:23.490503 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0d7ae4f5-7f7d-401e-bcf6-b42962f53118 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:23.490944 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0d7ae4f5-7f7d-401e-bcf6-b42962f53118 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:23.491708 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0d7ae4f5-7f7d-401e-bcf6-b42962f53118 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:23.492131 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0d7ae4f5-7f7d-401e-bcf6-b42962f53118 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:23.520927 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-0d7ae4f5-7f7d-401e-bcf6-b42962f53118 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042328 May 24 15:27:23.521476 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 541/1096] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:27:23 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:27:24.179071 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-0c4cb77a-1589-451e-8bda-e39ec22fb28d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:24.179986 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-0c4cb77a-1589-451e-8bda-e39ec22fb28d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:24.186445 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0c4cb77a-1589-451e-8bda-e39ec22fb28d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:24.186885 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0c4cb77a-1589-451e-8bda-e39ec22fb28d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:24.187631 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0c4cb77a-1589-451e-8bda-e39ec22fb28d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:24.188058 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0c4cb77a-1589-451e-8bda-e39ec22fb28d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:24.215794 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-0c4cb77a-1589-451e-8bda-e39ec22fb28d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040740 May 24 15:27:24.216341 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 556/1097] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:24 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:24.411118 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a0049098-6b8c-44de-b2e0-98cdf7562dcb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:24.411960 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a0049098-6b8c-44de-b2e0-98cdf7562dcb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:24.418597 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a0049098-6b8c-44de-b2e0-98cdf7562dcb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:24.419041 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a0049098-6b8c-44de-b2e0-98cdf7562dcb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:24.419796 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a0049098-6b8c-44de-b2e0-98cdf7562dcb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:24.420222 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a0049098-6b8c-44de-b2e0-98cdf7562dcb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:24.448344 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a0049098-6b8c-44de-b2e0-98cdf7562dcb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041242 May 24 15:27:24.448880 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 542/1098] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:24 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:24.532000 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-b39d1015-ea59-47e1-b0ac-24ff39e5dbc6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:24.532931 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-b39d1015-ea59-47e1-b0ac-24ff39e5dbc6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:24.538797 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b39d1015-ea59-47e1-b0ac-24ff39e5dbc6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:24.539236 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b39d1015-ea59-47e1-b0ac-24ff39e5dbc6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:24.539989 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b39d1015-ea59-47e1-b0ac-24ff39e5dbc6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:24.540427 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b39d1015-ea59-47e1-b0ac-24ff39e5dbc6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:24.569282 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-b39d1015-ea59-47e1-b0ac-24ff39e5dbc6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041238 May 24 15:27:24.569829 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 557/1099] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:27:24 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:27:25.227988 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a1b311b0-ac64-43e7-be4e-9d0512a10da2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:25.228935 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a1b311b0-ac64-43e7-be4e-9d0512a10da2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:25.235827 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a1b311b0-ac64-43e7-be4e-9d0512a10da2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:25.236273 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a1b311b0-ac64-43e7-be4e-9d0512a10da2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:25.237054 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a1b311b0-ac64-43e7-be4e-9d0512a10da2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:25.237489 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a1b311b0-ac64-43e7-be4e-9d0512a10da2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:25.253609 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:27:25.266335 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a1b311b0-ac64-43e7-be4e-9d0512a10da2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042406 May 24 15:27:25.266879 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 543/1100] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:25 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:25.459675 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-f471605e-592c-4375-ae91-d3e970f74200 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:25.460557 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-f471605e-592c-4375-ae91-d3e970f74200 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:25.467243 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f471605e-592c-4375-ae91-d3e970f74200 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:25.467695 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f471605e-592c-4375-ae91-d3e970f74200 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:25.468498 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f471605e-592c-4375-ae91-d3e970f74200 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:25.469587 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f471605e-592c-4375-ae91-d3e970f74200 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:25.497178 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-f471605e-592c-4375-ae91-d3e970f74200 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041574 May 24 15:27:25.497718 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 558/1101] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:25 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:25.581234 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-0fe2c456-b647-4f14-a60e-8053160aeb49 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:25.582252 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-0fe2c456-b647-4f14-a60e-8053160aeb49 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:25.588792 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0fe2c456-b647-4f14-a60e-8053160aeb49 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:25.589241 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0fe2c456-b647-4f14-a60e-8053160aeb49 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:25.590000 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0fe2c456-b647-4f14-a60e-8053160aeb49 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:25.590423 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0fe2c456-b647-4f14-a60e-8053160aeb49 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:25.620273 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-0fe2c456-b647-4f14-a60e-8053160aeb49 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043475 May 24 15:27:25.621103 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 544/1102] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:27:25 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:27:26.277870 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-455365b9-766c-4aab-b3fd-009045d27b4d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:26.278800 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-455365b9-766c-4aab-b3fd-009045d27b4d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:26.284969 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-455365b9-766c-4aab-b3fd-009045d27b4d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:26.285420 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-455365b9-766c-4aab-b3fd-009045d27b4d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:26.286183 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-455365b9-766c-4aab-b3fd-009045d27b4d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:26.286618 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-455365b9-766c-4aab-b3fd-009045d27b4d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:26.316141 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-455365b9-766c-4aab-b3fd-009045d27b4d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042302 May 24 15:27:26.316716 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 559/1103] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:26 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:26.508515 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-5ab156c6-3e13-4552-ab06-56d04b7738cb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:26.509483 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-5ab156c6-3e13-4552-ab06-56d04b7738cb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:26.515481 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5ab156c6-3e13-4552-ab06-56d04b7738cb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:26.515919 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5ab156c6-3e13-4552-ab06-56d04b7738cb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:26.516694 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5ab156c6-3e13-4552-ab06-56d04b7738cb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:26.517124 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5ab156c6-3e13-4552-ab06-56d04b7738cb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:26.544524 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-5ab156c6-3e13-4552-ab06-56d04b7738cb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039931 May 24 15:27:26.545050 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 545/1104] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:26 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:26.631214 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-f2989761-c205-4685-83e2-e326aca6eed1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:26.632124 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-f2989761-c205-4685-83e2-e326aca6eed1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:26.638691 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f2989761-c205-4685-83e2-e326aca6eed1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:26.639144 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f2989761-c205-4685-83e2-e326aca6eed1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:26.639933 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f2989761-c205-4685-83e2-e326aca6eed1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:26.640396 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f2989761-c205-4685-83e2-e326aca6eed1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:26.662675 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:27:26.679430 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-f2989761-c205-4685-83e2-e326aca6eed1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052408 May 24 15:27:26.679982 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 560/1105] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:27:26 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:27:27.327021 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-39ffc72a-69e8-4f70-bfa4-c36f5aa0d957 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:27.327945 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-39ffc72a-69e8-4f70-bfa4-c36f5aa0d957 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:27.335010 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-39ffc72a-69e8-4f70-bfa4-c36f5aa0d957 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:27.335450 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-39ffc72a-69e8-4f70-bfa4-c36f5aa0d957 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:27.336198 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-39ffc72a-69e8-4f70-bfa4-c36f5aa0d957 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:27.336651 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-39ffc72a-69e8-4f70-bfa4-c36f5aa0d957 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:27.364610 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-39ffc72a-69e8-4f70-bfa4-c36f5aa0d957 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041561 May 24 15:27:27.365154 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 546/1106] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:27 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:27.556288 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-7eb3aaea-6d56-41c3-a6e8-d0d78e6bc65f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:27.557252 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-7eb3aaea-6d56-41c3-a6e8-d0d78e6bc65f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:27.563734 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7eb3aaea-6d56-41c3-a6e8-d0d78e6bc65f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:27.564179 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7eb3aaea-6d56-41c3-a6e8-d0d78e6bc65f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:27.564967 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7eb3aaea-6d56-41c3-a6e8-d0d78e6bc65f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:27.565401 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7eb3aaea-6d56-41c3-a6e8-d0d78e6bc65f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:27.593304 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-7eb3aaea-6d56-41c3-a6e8-d0d78e6bc65f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040891 May 24 15:27:27.593786 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 561/1107] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:27 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:27.691321 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-8149ff3d-e9c0-417d-a457-4ce702dc6e39 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:27.692263 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-8149ff3d-e9c0-417d-a457-4ce702dc6e39 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:27.698268 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8149ff3d-e9c0-417d-a457-4ce702dc6e39 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:27.698605 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8149ff3d-e9c0-417d-a457-4ce702dc6e39 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:27.699357 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8149ff3d-e9c0-417d-a457-4ce702dc6e39 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:27.699782 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8149ff3d-e9c0-417d-a457-4ce702dc6e39 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:27.728159 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-8149ff3d-e9c0-417d-a457-4ce702dc6e39 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041308 May 24 15:27:27.728733 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 547/1108] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:27:27 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:27:28.374983 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d16b0554-061a-431d-bd81-45bf8ecb8976 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:28.375934 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d16b0554-061a-431d-bd81-45bf8ecb8976 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:28.382415 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d16b0554-061a-431d-bd81-45bf8ecb8976 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:28.382856 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d16b0554-061a-431d-bd81-45bf8ecb8976 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:28.383602 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d16b0554-061a-431d-bd81-45bf8ecb8976 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:28.384029 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d16b0554-061a-431d-bd81-45bf8ecb8976 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:28.412261 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d16b0554-061a-431d-bd81-45bf8ecb8976 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041233 May 24 15:27:28.412827 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 562/1109] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:28 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:28.603601 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a4aa7b66-0f0f-495a-83de-d08fdddff714 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:28.604550 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a4aa7b66-0f0f-495a-83de-d08fdddff714 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:28.606819 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_api:SELECT=88 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:27:28.612210 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a4aa7b66-0f0f-495a-83de-d08fdddff714 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:28.612909 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a4aa7b66-0f0f-495a-83de-d08fdddff714 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:28.613664 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a4aa7b66-0f0f-495a-83de-d08fdddff714 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:28.614089 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a4aa7b66-0f0f-495a-83de-d08fdddff714 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:28.642086 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a4aa7b66-0f0f-495a-83de-d08fdddff714 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042477 May 24 15:27:28.642619 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 548/1110] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:28 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:28.739077 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-4ce6380a-d021-4033-84d9-f4c6395f124e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:28.739985 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-4ce6380a-d021-4033-84d9-f4c6395f124e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:28.745982 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4ce6380a-d021-4033-84d9-f4c6395f124e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:28.746277 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4ce6380a-d021-4033-84d9-f4c6395f124e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:28.747027 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4ce6380a-d021-4033-84d9-f4c6395f124e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:28.747519 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4ce6380a-d021-4033-84d9-f4c6395f124e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:28.776579 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-4ce6380a-d021-4033-84d9-f4c6395f124e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041318 May 24 15:27:28.777125 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 563/1111] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:27:28 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:27:29.423728 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-34a2e438-871e-4057-9018-06c8b21f362c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:29.424584 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-34a2e438-871e-4057-9018-06c8b21f362c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:29.430659 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-34a2e438-871e-4057-9018-06c8b21f362c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:29.431101 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-34a2e438-871e-4057-9018-06c8b21f362c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:29.431849 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-34a2e438-871e-4057-9018-06c8b21f362c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:29.432276 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-34a2e438-871e-4057-9018-06c8b21f362c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:29.461597 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-34a2e438-871e-4057-9018-06c8b21f362c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042476 May 24 15:27:29.462135 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 549/1112] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:29 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:29.653413 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-89e96327-9cba-4ba6-9fbd-a1d4f5e5c62b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:29.654373 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-89e96327-9cba-4ba6-9fbd-a1d4f5e5c62b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:29.661385 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-89e96327-9cba-4ba6-9fbd-a1d4f5e5c62b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:29.661825 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-89e96327-9cba-4ba6-9fbd-a1d4f5e5c62b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:29.662567 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-89e96327-9cba-4ba6-9fbd-a1d4f5e5c62b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:29.662991 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-89e96327-9cba-4ba6-9fbd-a1d4f5e5c62b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:29.690862 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-89e96327-9cba-4ba6-9fbd-a1d4f5e5c62b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041324 May 24 15:27:29.691340 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 564/1113] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:29 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:29.787345 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-350f16cc-065f-4d7a-92d3-f27fc5b158c7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:29.788258 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-350f16cc-065f-4d7a-92d3-f27fc5b158c7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:29.794632 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-350f16cc-065f-4d7a-92d3-f27fc5b158c7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:29.795083 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-350f16cc-065f-4d7a-92d3-f27fc5b158c7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:29.795847 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-350f16cc-065f-4d7a-92d3-f27fc5b158c7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:29.796273 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-350f16cc-065f-4d7a-92d3-f27fc5b158c7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:29.825790 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-350f16cc-065f-4d7a-92d3-f27fc5b158c7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042384 May 24 15:27:29.826330 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 550/1114] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:27:29 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:27:30.473175 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-11e980bc-fec1-4d66-88de-f11d13ac8655 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:30.474093 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-11e980bc-fec1-4d66-88de-f11d13ac8655 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:30.480101 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-11e980bc-fec1-4d66-88de-f11d13ac8655 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:30.480579 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-11e980bc-fec1-4d66-88de-f11d13ac8655 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:30.481332 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-11e980bc-fec1-4d66-88de-f11d13ac8655 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:30.481763 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-11e980bc-fec1-4d66-88de-f11d13ac8655 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:30.510318 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-11e980bc-fec1-4d66-88de-f11d13ac8655 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041652 May 24 15:27:30.510863 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 565/1115] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:30 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:30.702594 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-244ff4ff-94d1-4d84-a710-e02755b99172 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:30.704011 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-244ff4ff-94d1-4d84-a710-e02755b99172 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:30.710047 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-244ff4ff-94d1-4d84-a710-e02755b99172 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:30.710487 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-244ff4ff-94d1-4d84-a710-e02755b99172 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:30.711241 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-244ff4ff-94d1-4d84-a710-e02755b99172 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:30.711671 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-244ff4ff-94d1-4d84-a710-e02755b99172 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:30.739940 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-244ff4ff-94d1-4d84-a710-e02755b99172 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041444 May 24 15:27:30.740448 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 551/1116] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:30 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:30.837635 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-13a1d7eb-6d5b-44c0-b9d1-446e85939a05 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:30.838647 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-13a1d7eb-6d5b-44c0-b9d1-446e85939a05 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:30.845699 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-13a1d7eb-6d5b-44c0-b9d1-446e85939a05 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:30.846144 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-13a1d7eb-6d5b-44c0-b9d1-446e85939a05 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:30.846899 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-13a1d7eb-6d5b-44c0-b9d1-446e85939a05 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:30.847329 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-13a1d7eb-6d5b-44c0-b9d1-446e85939a05 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:30.883826 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-13a1d7eb-6d5b-44c0-b9d1-446e85939a05 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050148 May 24 15:27:30.884457 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 566/1117] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:27:30 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:27:31.521840 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-48c6c77d-e190-4493-aa08-b998c3edd706 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:31.522761 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-48c6c77d-e190-4493-aa08-b998c3edd706 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:31.529296 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-48c6c77d-e190-4493-aa08-b998c3edd706 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:31.529740 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-48c6c77d-e190-4493-aa08-b998c3edd706 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:31.530494 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-48c6c77d-e190-4493-aa08-b998c3edd706 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:31.530923 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-48c6c77d-e190-4493-aa08-b998c3edd706 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:31.559192 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-48c6c77d-e190-4493-aa08-b998c3edd706 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041290 May 24 15:27:31.559725 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 552/1118] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:31 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:31.751677 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-489ef445-817b-4037-9472-eaac27043517 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:31.752626 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-489ef445-817b-4037-9472-eaac27043517 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:31.758588 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-489ef445-817b-4037-9472-eaac27043517 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:31.759034 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-489ef445-817b-4037-9472-eaac27043517 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:31.759789 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-489ef445-817b-4037-9472-eaac27043517 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:31.760222 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-489ef445-817b-4037-9472-eaac27043517 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:31.787531 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-489ef445-817b-4037-9472-eaac27043517 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040353 May 24 15:27:31.788007 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 567/1119] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:31 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:31.895278 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-af3dcf0d-d072-4fd1-bca6-3717619e5b62 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:31.896347 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-af3dcf0d-d072-4fd1-bca6-3717619e5b62 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:31.902530 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-af3dcf0d-d072-4fd1-bca6-3717619e5b62 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:31.902973 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-af3dcf0d-d072-4fd1-bca6-3717619e5b62 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:31.903729 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-af3dcf0d-d072-4fd1-bca6-3717619e5b62 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:31.904154 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-af3dcf0d-d072-4fd1-bca6-3717619e5b62 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:31.934014 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-af3dcf0d-d072-4fd1-bca6-3717619e5b62 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042623 May 24 15:27:31.934562 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 553/1120] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:27:31 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:27:32.571342 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d3607e86-794c-456d-b507-9eb6445f8344 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:32.572267 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d3607e86-794c-456d-b507-9eb6445f8344 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:32.579348 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d3607e86-794c-456d-b507-9eb6445f8344 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:32.579798 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d3607e86-794c-456d-b507-9eb6445f8344 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:32.580576 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d3607e86-794c-456d-b507-9eb6445f8344 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:32.581009 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d3607e86-794c-456d-b507-9eb6445f8344 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:32.608977 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d3607e86-794c-456d-b507-9eb6445f8344 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041669 May 24 15:27:32.609528 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 568/1121] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:32 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:32.798887 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-73a848e5-9112-4695-995a-bedb8b70be4f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:32.799760 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-73a848e5-9112-4695-995a-bedb8b70be4f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:32.806248 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-73a848e5-9112-4695-995a-bedb8b70be4f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:32.806730 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-73a848e5-9112-4695-995a-bedb8b70be4f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:32.807491 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-73a848e5-9112-4695-995a-bedb8b70be4f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:32.807927 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-73a848e5-9112-4695-995a-bedb8b70be4f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:32.836665 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-73a848e5-9112-4695-995a-bedb8b70be4f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041766 May 24 15:27:32.837278 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 554/1122] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:32 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:32.944652 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-da60634d-86aa-4108-a010-8c6c9532a6a9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:32.945650 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-da60634d-86aa-4108-a010-8c6c9532a6a9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:32.951625 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-da60634d-86aa-4108-a010-8c6c9532a6a9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:32.952077 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-da60634d-86aa-4108-a010-8c6c9532a6a9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:32.952877 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-da60634d-86aa-4108-a010-8c6c9532a6a9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:32.953332 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-da60634d-86aa-4108-a010-8c6c9532a6a9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:32.981975 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-da60634d-86aa-4108-a010-8c6c9532a6a9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041311 May 24 15:27:32.982781 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 569/1123] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:27:32 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:27:33.619536 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-2c8c2f57-afc4-4cbe-991b-9bb813fb1d73 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:33.620481 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-2c8c2f57-afc4-4cbe-991b-9bb813fb1d73 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:33.626643 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2c8c2f57-afc4-4cbe-991b-9bb813fb1d73 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:33.627084 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2c8c2f57-afc4-4cbe-991b-9bb813fb1d73 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:33.627829 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2c8c2f57-afc4-4cbe-991b-9bb813fb1d73 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:33.628259 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2c8c2f57-afc4-4cbe-991b-9bb813fb1d73 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:33.655834 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-2c8c2f57-afc4-4cbe-991b-9bb813fb1d73 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040262 May 24 15:27:33.656892 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 555/1124] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:33 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:33.847661 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e23a86cd-7bd0-4d37-8235-117b4befb73b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:33.848613 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e23a86cd-7bd0-4d37-8235-117b4befb73b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:33.854989 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e23a86cd-7bd0-4d37-8235-117b4befb73b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:33.855437 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e23a86cd-7bd0-4d37-8235-117b4befb73b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:33.856198 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e23a86cd-7bd0-4d37-8235-117b4befb73b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:33.856654 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e23a86cd-7bd0-4d37-8235-117b4befb73b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:33.884936 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e23a86cd-7bd0-4d37-8235-117b4befb73b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041766 May 24 15:27:33.885422 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 570/1125] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:33 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:33.994096 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-80cd1b40-2d71-49e3-85ec-d49dcefc8645 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:33.995009 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-80cd1b40-2d71-49e3-85ec-d49dcefc8645 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:34.001495 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-80cd1b40-2d71-49e3-85ec-d49dcefc8645 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:34.001938 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-80cd1b40-2d71-49e3-85ec-d49dcefc8645 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:34.002690 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-80cd1b40-2d71-49e3-85ec-d49dcefc8645 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:34.003124 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-80cd1b40-2d71-49e3-85ec-d49dcefc8645 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:34.033907 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-80cd1b40-2d71-49e3-85ec-d49dcefc8645 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043723 May 24 15:27:34.034454 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 556/1126] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:27:33 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:27:34.668196 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-18ff2001-cfd3-429c-bce2-cb1fdfa55eac tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:34.669170 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-18ff2001-cfd3-429c-bce2-cb1fdfa55eac tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:34.675683 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-18ff2001-cfd3-429c-bce2-cb1fdfa55eac tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:34.676129 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-18ff2001-cfd3-429c-bce2-cb1fdfa55eac tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:34.676919 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-18ff2001-cfd3-429c-bce2-cb1fdfa55eac tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:34.677353 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-18ff2001-cfd3-429c-bce2-cb1fdfa55eac tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:34.706208 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-18ff2001-cfd3-429c-bce2-cb1fdfa55eac tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041965 May 24 15:27:34.706756 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 571/1127] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:34 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:34.896756 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-60cb2119-ebbe-472c-9d96-648969cefec5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:34.897609 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-60cb2119-ebbe-472c-9d96-648969cefec5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:34.903565 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-60cb2119-ebbe-472c-9d96-648969cefec5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:34.904005 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-60cb2119-ebbe-472c-9d96-648969cefec5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:34.904771 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-60cb2119-ebbe-472c-9d96-648969cefec5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:34.905197 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-60cb2119-ebbe-472c-9d96-648969cefec5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:34.933632 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-60cb2119-ebbe-472c-9d96-648969cefec5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040918 May 24 15:27:34.934168 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 557/1128] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:34 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:35.045253 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-7b5c5bd8-5553-482b-a448-ec842aa65e66 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:35.046193 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-7b5c5bd8-5553-482b-a448-ec842aa65e66 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:35.053293 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7b5c5bd8-5553-482b-a448-ec842aa65e66 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:35.053734 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7b5c5bd8-5553-482b-a448-ec842aa65e66 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:35.054490 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7b5c5bd8-5553-482b-a448-ec842aa65e66 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:35.054916 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7b5c5bd8-5553-482b-a448-ec842aa65e66 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:35.086616 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-7b5c5bd8-5553-482b-a448-ec842aa65e66 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045236 May 24 15:27:35.087310 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 572/1129] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:27:35 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:27:35.717601 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-2ebfa0f0-84a5-450e-b028-be71c2425157 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:35.718518 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-2ebfa0f0-84a5-450e-b028-be71c2425157 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:35.724974 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2ebfa0f0-84a5-450e-b028-be71c2425157 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:35.725414 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2ebfa0f0-84a5-450e-b028-be71c2425157 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:35.726163 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2ebfa0f0-84a5-450e-b028-be71c2425157 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:35.726589 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2ebfa0f0-84a5-450e-b028-be71c2425157 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:35.755027 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-2ebfa0f0-84a5-450e-b028-be71c2425157 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041353 May 24 15:27:35.755562 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 558/1130] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:35 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:35.945251 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-f9c930a9-92bf-40be-9a71-6b844e0b582e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:35.946175 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-f9c930a9-92bf-40be-9a71-6b844e0b582e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:35.952202 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f9c930a9-92bf-40be-9a71-6b844e0b582e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:35.952691 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f9c930a9-92bf-40be-9a71-6b844e0b582e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:35.953449 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f9c930a9-92bf-40be-9a71-6b844e0b582e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:35.953884 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f9c930a9-92bf-40be-9a71-6b844e0b582e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:35.981695 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-f9c930a9-92bf-40be-9a71-6b844e0b582e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040383 May 24 15:27:35.982423 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 573/1131] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:35 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:36.098290 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-c80f0d26-9b58-4e01-8316-4bf414159407 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:36.099209 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-c80f0d26-9b58-4e01-8316-4bf414159407 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:36.105528 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c80f0d26-9b58-4e01-8316-4bf414159407 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:36.105962 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c80f0d26-9b58-4e01-8316-4bf414159407 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:36.106715 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c80f0d26-9b58-4e01-8316-4bf414159407 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:36.107143 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c80f0d26-9b58-4e01-8316-4bf414159407 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:36.136631 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-c80f0d26-9b58-4e01-8316-4bf414159407 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042291 May 24 15:27:36.137168 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 559/1132] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:27:36 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:27:36.766592 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-f72b19f6-1080-4c2b-8fbd-154354255093 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:36.767999 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-f72b19f6-1080-4c2b-8fbd-154354255093 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:36.774517 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f72b19f6-1080-4c2b-8fbd-154354255093 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:36.774963 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f72b19f6-1080-4c2b-8fbd-154354255093 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:36.775715 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f72b19f6-1080-4c2b-8fbd-154354255093 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:36.776151 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f72b19f6-1080-4c2b-8fbd-154354255093 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:36.804312 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-f72b19f6-1080-4c2b-8fbd-154354255093 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041719 May 24 15:27:36.804868 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 574/1133] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:36 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:36.993865 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-83b8e958-7c5b-4b02-a245-630d870da824 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:36.994814 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-83b8e958-7c5b-4b02-a245-630d870da824 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:37.001240 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-83b8e958-7c5b-4b02-a245-630d870da824 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:37.001682 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-83b8e958-7c5b-4b02-a245-630d870da824 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:37.002431 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-83b8e958-7c5b-4b02-a245-630d870da824 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:37.002860 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-83b8e958-7c5b-4b02-a245-630d870da824 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:37.006362 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:27:37.031106 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-83b8e958-7c5b-4b02-a245-630d870da824 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041270 May 24 15:27:37.031645 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 560/1134] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:36 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:37.148771 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e2af2bb9-ea2a-4528-b869-ea28a34e5168 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:37.149810 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e2af2bb9-ea2a-4528-b869-ea28a34e5168 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:37.156286 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e2af2bb9-ea2a-4528-b869-ea28a34e5168 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:37.156773 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e2af2bb9-ea2a-4528-b869-ea28a34e5168 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:37.157542 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e2af2bb9-ea2a-4528-b869-ea28a34e5168 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:37.157995 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e2af2bb9-ea2a-4528-b869-ea28a34e5168 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:37.186762 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e2af2bb9-ea2a-4528-b869-ea28a34e5168 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041863 May 24 15:27:37.187305 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 575/1135] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:27:37 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:27:37.815753 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-653b650b-1995-4adf-a442-8af359dd37b3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:37.816723 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-653b650b-1995-4adf-a442-8af359dd37b3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:37.822769 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-653b650b-1995-4adf-a442-8af359dd37b3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:37.823214 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-653b650b-1995-4adf-a442-8af359dd37b3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:37.823999 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-653b650b-1995-4adf-a442-8af359dd37b3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:37.824458 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-653b650b-1995-4adf-a442-8af359dd37b3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:37.852657 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-653b650b-1995-4adf-a442-8af359dd37b3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040847 May 24 15:27:37.853194 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 561/1136] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:37 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:38.043141 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-520df5ce-c8f1-43c8-9664-b14775da0452 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:38.044058 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-520df5ce-c8f1-43c8-9664-b14775da0452 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:38.046364 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_api:SELECT=86 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:27:38.052164 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-520df5ce-c8f1-43c8-9664-b14775da0452 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:38.052637 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-520df5ce-c8f1-43c8-9664-b14775da0452 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:38.053421 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-520df5ce-c8f1-43c8-9664-b14775da0452 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:38.053852 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-520df5ce-c8f1-43c8-9664-b14775da0452 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:38.082213 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-520df5ce-c8f1-43c8-9664-b14775da0452 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042961 May 24 15:27:38.082771 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 576/1137] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:38 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:38.199934 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a13cac2a-c16d-4dcc-9884-6030703e165c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:38.200898 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a13cac2a-c16d-4dcc-9884-6030703e165c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:38.207505 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a13cac2a-c16d-4dcc-9884-6030703e165c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:38.207953 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a13cac2a-c16d-4dcc-9884-6030703e165c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:38.208734 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a13cac2a-c16d-4dcc-9884-6030703e165c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:38.209164 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a13cac2a-c16d-4dcc-9884-6030703e165c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:38.238523 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a13cac2a-c16d-4dcc-9884-6030703e165c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042247 May 24 15:27:38.239061 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 562/1138] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:27:38 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:27:38.864467 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-9ed5b55c-3d30-4f58-88d5-05a725516a2d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:38.865336 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-9ed5b55c-3d30-4f58-88d5-05a725516a2d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:38.872205 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9ed5b55c-3d30-4f58-88d5-05a725516a2d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:38.872682 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9ed5b55c-3d30-4f58-88d5-05a725516a2d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:38.873572 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9ed5b55c-3d30-4f58-88d5-05a725516a2d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:38.874015 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9ed5b55c-3d30-4f58-88d5-05a725516a2d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:38.878146 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:27:38.903544 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-9ed5b55c-3d30-4f58-88d5-05a725516a2d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043110 May 24 15:27:38.904088 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 577/1139] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:38 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:39.093884 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-75dd02c4-95cc-4e4e-84cc-18e4e382b315 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:39.094809 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-75dd02c4-95cc-4e4e-84cc-18e4e382b315 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:39.100906 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-75dd02c4-95cc-4e4e-84cc-18e4e382b315 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:39.101351 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-75dd02c4-95cc-4e4e-84cc-18e4e382b315 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:39.102105 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-75dd02c4-95cc-4e4e-84cc-18e4e382b315 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:39.102536 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-75dd02c4-95cc-4e4e-84cc-18e4e382b315 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:39.131476 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-75dd02c4-95cc-4e4e-84cc-18e4e382b315 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041506 May 24 15:27:39.131955 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 563/1140] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:39 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:39.249929 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-eecd6bd5-73a0-4928-98c2-9104d00ef979 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:39.250854 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-eecd6bd5-73a0-4928-98c2-9104d00ef979 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:39.258073 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-eecd6bd5-73a0-4928-98c2-9104d00ef979 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:39.258523 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-eecd6bd5-73a0-4928-98c2-9104d00ef979 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:39.259283 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-eecd6bd5-73a0-4928-98c2-9104d00ef979 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:39.259713 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-eecd6bd5-73a0-4928-98c2-9104d00ef979 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:39.288155 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-eecd6bd5-73a0-4928-98c2-9104d00ef979 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042194 May 24 15:27:39.288727 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 578/1141] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:27:39 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 15:27:39.914891 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f7dbd670-964b-4484-bbfc-f8234afb7e28 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:39.915841 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f7dbd670-964b-4484-bbfc-f8234afb7e28 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:39.922263 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f7dbd670-964b-4484-bbfc-f8234afb7e28 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:39.922710 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f7dbd670-964b-4484-bbfc-f8234afb7e28 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:39.923471 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f7dbd670-964b-4484-bbfc-f8234afb7e28 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:39.923905 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f7dbd670-964b-4484-bbfc-f8234afb7e28 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:39.952228 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f7dbd670-964b-4484-bbfc-f8234afb7e28 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041304 May 24 15:27:39.952806 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 564/1142] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:39 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:40.143538 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-0ad2e5a7-34ac-4a3d-a9a2-1176a1c709e0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:40.144497 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-0ad2e5a7-34ac-4a3d-a9a2-1176a1c709e0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:40.150548 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0ad2e5a7-34ac-4a3d-a9a2-1176a1c709e0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:40.150997 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0ad2e5a7-34ac-4a3d-a9a2-1176a1c709e0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:40.151754 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0ad2e5a7-34ac-4a3d-a9a2-1176a1c709e0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:40.152192 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0ad2e5a7-34ac-4a3d-a9a2-1176a1c709e0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:40.179686 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-0ad2e5a7-34ac-4a3d-a9a2-1176a1c709e0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040715 May 24 15:27:40.180172 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 579/1143] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:40 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:40.299387 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-99f60daf-1288-4037-9871-7bd21cebbe01 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:40.300324 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-99f60daf-1288-4037-9871-7bd21cebbe01 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:40.306303 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-99f60daf-1288-4037-9871-7bd21cebbe01 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:40.306751 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-99f60daf-1288-4037-9871-7bd21cebbe01 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:40.307532 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-99f60daf-1288-4037-9871-7bd21cebbe01 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:40.307963 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-99f60daf-1288-4037-9871-7bd21cebbe01 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:40.337399 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-99f60daf-1288-4037-9871-7bd21cebbe01 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041923 May 24 15:27:40.337938 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 565/1144] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:27:40 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:27:40.964540 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-27dfc068-b8a7-4756-9993-3207a8b971b4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:40.965385 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-27dfc068-b8a7-4756-9993-3207a8b971b4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:40.971946 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-27dfc068-b8a7-4756-9993-3207a8b971b4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:40.972431 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-27dfc068-b8a7-4756-9993-3207a8b971b4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:40.973188 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-27dfc068-b8a7-4756-9993-3207a8b971b4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:40.973620 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-27dfc068-b8a7-4756-9993-3207a8b971b4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:41.002126 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-27dfc068-b8a7-4756-9993-3207a8b971b4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041204 May 24 15:27:41.002673 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 580/1145] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:40 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:41.191737 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f27dae6f-1d45-43de-b21d-d1533c3ce614 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:41.192678 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f27dae6f-1d45-43de-b21d-d1533c3ce614 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:41.199109 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f27dae6f-1d45-43de-b21d-d1533c3ce614 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:41.199553 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f27dae6f-1d45-43de-b21d-d1533c3ce614 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:41.200324 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f27dae6f-1d45-43de-b21d-d1533c3ce614 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:41.200762 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f27dae6f-1d45-43de-b21d-d1533c3ce614 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:41.228154 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f27dae6f-1d45-43de-b21d-d1533c3ce614 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041028 May 24 15:27:41.228738 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 566/1146] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:41 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:41.348825 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-836df357-920c-40f4-8872-9d8f39763ef0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:41.349740 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-836df357-920c-40f4-8872-9d8f39763ef0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:41.355702 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-836df357-920c-40f4-8872-9d8f39763ef0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:41.356148 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-836df357-920c-40f4-8872-9d8f39763ef0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:41.356935 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-836df357-920c-40f4-8872-9d8f39763ef0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:41.357630 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-836df357-920c-40f4-8872-9d8f39763ef0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:41.386482 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-836df357-920c-40f4-8872-9d8f39763ef0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041720 May 24 15:27:41.387025 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 581/1147] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:27:41 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:27:42.013635 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-cdc6185a-ad50-4de1-9c40-22ff98600594 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:42.014562 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-cdc6185a-ad50-4de1-9c40-22ff98600594 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:42.021173 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cdc6185a-ad50-4de1-9c40-22ff98600594 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:42.021619 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cdc6185a-ad50-4de1-9c40-22ff98600594 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:42.022376 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cdc6185a-ad50-4de1-9c40-22ff98600594 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:42.022809 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cdc6185a-ad50-4de1-9c40-22ff98600594 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:42.052021 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-cdc6185a-ad50-4de1-9c40-22ff98600594 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042293 May 24 15:27:42.052604 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 567/1148] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:42 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:42.239455 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-86843dcf-fca6-41da-af3b-7f1298326f35 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:42.240384 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-86843dcf-fca6-41da-af3b-7f1298326f35 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:42.246926 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-86843dcf-fca6-41da-af3b-7f1298326f35 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:42.247360 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-86843dcf-fca6-41da-af3b-7f1298326f35 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:42.248104 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-86843dcf-fca6-41da-af3b-7f1298326f35 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:42.248552 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-86843dcf-fca6-41da-af3b-7f1298326f35 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:42.276288 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-86843dcf-fca6-41da-af3b-7f1298326f35 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040732 May 24 15:27:42.276785 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 582/1149] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:42 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:42.398887 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-c276109c-38d2-434c-b0f1-40dcd92e9e2e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:42.399840 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-c276109c-38d2-434c-b0f1-40dcd92e9e2e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:42.406446 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c276109c-38d2-434c-b0f1-40dcd92e9e2e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:42.406897 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c276109c-38d2-434c-b0f1-40dcd92e9e2e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:42.407664 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c276109c-38d2-434c-b0f1-40dcd92e9e2e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:42.408097 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c276109c-38d2-434c-b0f1-40dcd92e9e2e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:42.436197 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-c276109c-38d2-434c-b0f1-40dcd92e9e2e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041577 May 24 15:27:42.436780 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 568/1150] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:27:42 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:27:43.062711 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-bbd943ec-9fd8-49d8-a39a-9204f13eb0a0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:43.063629 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-bbd943ec-9fd8-49d8-a39a-9204f13eb0a0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:43.069734 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bbd943ec-9fd8-49d8-a39a-9204f13eb0a0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:43.070179 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bbd943ec-9fd8-49d8-a39a-9204f13eb0a0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:43.071174 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bbd943ec-9fd8-49d8-a39a-9204f13eb0a0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:43.071355 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bbd943ec-9fd8-49d8-a39a-9204f13eb0a0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:43.100946 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-bbd943ec-9fd8-49d8-a39a-9204f13eb0a0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042205 May 24 15:27:43.101488 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 583/1151] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:43 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:43.287540 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-0bb3e2e7-51c4-4fd1-b8a0-e97c0d33460a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:43.288748 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-0bb3e2e7-51c4-4fd1-b8a0-e97c0d33460a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:43.294690 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0bb3e2e7-51c4-4fd1-b8a0-e97c0d33460a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:43.295130 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0bb3e2e7-51c4-4fd1-b8a0-e97c0d33460a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:43.295878 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0bb3e2e7-51c4-4fd1-b8a0-e97c0d33460a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:43.296322 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0bb3e2e7-51c4-4fd1-b8a0-e97c0d33460a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:43.323993 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-0bb3e2e7-51c4-4fd1-b8a0-e97c0d33460a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040373 May 24 15:27:43.324511 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 569/1152] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:43 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:43.448207 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-640a7744-865e-43d4-9711-54888ec0bf0c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:43.449141 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-640a7744-865e-43d4-9711-54888ec0bf0c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:43.455933 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-640a7744-865e-43d4-9711-54888ec0bf0c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:43.456408 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-640a7744-865e-43d4-9711-54888ec0bf0c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:43.457154 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-640a7744-865e-43d4-9711-54888ec0bf0c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:43.457577 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-640a7744-865e-43d4-9711-54888ec0bf0c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:43.485915 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-640a7744-865e-43d4-9711-54888ec0bf0c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041642 May 24 15:27:43.486455 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 584/1153] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:27:43 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:27:44.112860 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-84c655e2-8d89-4ce2-82cb-72f97ad3f7ab tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:44.113786 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-84c655e2-8d89-4ce2-82cb-72f97ad3f7ab tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:44.120484 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-84c655e2-8d89-4ce2-82cb-72f97ad3f7ab tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:44.120929 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-84c655e2-8d89-4ce2-82cb-72f97ad3f7ab tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:44.121715 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-84c655e2-8d89-4ce2-82cb-72f97ad3f7ab tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:44.122149 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-84c655e2-8d89-4ce2-82cb-72f97ad3f7ab tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:44.151289 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-84c655e2-8d89-4ce2-82cb-72f97ad3f7ab tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042481 May 24 15:27:44.151832 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 570/1154] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:44 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:44.335551 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-65a4bc7c-b1a6-40c7-873b-2b81e778838c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:44.336411 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-65a4bc7c-b1a6-40c7-873b-2b81e778838c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:44.343041 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-65a4bc7c-b1a6-40c7-873b-2b81e778838c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:44.343873 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-65a4bc7c-b1a6-40c7-873b-2b81e778838c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:44.344970 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-65a4bc7c-b1a6-40c7-873b-2b81e778838c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:44.345564 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-65a4bc7c-b1a6-40c7-873b-2b81e778838c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:44.374330 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-65a4bc7c-b1a6-40c7-873b-2b81e778838c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042779 May 24 15:27:44.374873 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 585/1155] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:44 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:44.496713 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-8da5772c-4de7-4ef9-a336-bd75d8d0be4f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:44.497633 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-8da5772c-4de7-4ef9-a336-bd75d8d0be4f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:44.504218 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8da5772c-4de7-4ef9-a336-bd75d8d0be4f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:44.504697 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8da5772c-4de7-4ef9-a336-bd75d8d0be4f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:44.505445 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8da5772c-4de7-4ef9-a336-bd75d8d0be4f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:44.505873 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8da5772c-4de7-4ef9-a336-bd75d8d0be4f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:44.533907 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-8da5772c-4de7-4ef9-a336-bd75d8d0be4f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041149 May 24 15:27:44.534443 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 571/1156] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:27:44 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:27:45.163066 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-3426ad96-f8ec-4a5c-acc2-0932628304c4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:45.163983 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-3426ad96-f8ec-4a5c-acc2-0932628304c4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:45.171330 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3426ad96-f8ec-4a5c-acc2-0932628304c4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:45.171780 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3426ad96-f8ec-4a5c-acc2-0932628304c4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:45.172571 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3426ad96-f8ec-4a5c-acc2-0932628304c4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:45.173011 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3426ad96-f8ec-4a5c-acc2-0932628304c4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:45.213264 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-3426ad96-f8ec-4a5c-acc2-0932628304c4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053682 May 24 15:27:45.214266 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 586/1157] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:45 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:45.386427 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-3198720c-d899-4a7d-81ee-0b28f67c3fe1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:45.387280 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-3198720c-d899-4a7d-81ee-0b28f67c3fe1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:45.394602 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3198720c-d899-4a7d-81ee-0b28f67c3fe1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:45.395053 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3198720c-d899-4a7d-81ee-0b28f67c3fe1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:45.395824 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3198720c-d899-4a7d-81ee-0b28f67c3fe1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:45.396326 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3198720c-d899-4a7d-81ee-0b28f67c3fe1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:45.428433 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-3198720c-d899-4a7d-81ee-0b28f67c3fe1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045986 May 24 15:27:45.429044 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 572/1158] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:45 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:45.545583 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c0374090-a962-4293-b1c9-ad9598212774 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:45.546529 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-c0374090-a962-4293-b1c9-ad9598212774 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:45.552443 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c0374090-a962-4293-b1c9-ad9598212774 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:45.552887 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c0374090-a962-4293-b1c9-ad9598212774 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:45.553637 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c0374090-a962-4293-b1c9-ad9598212774 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:45.554061 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c0374090-a962-4293-b1c9-ad9598212774 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:45.582693 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-c0374090-a962-4293-b1c9-ad9598212774 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041265 May 24 15:27:45.583237 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 587/1159] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:27:45 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:27:46.227255 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-2bafdc60-1514-4cca-bfdc-4c77ef1cf266 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:46.228185 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-2bafdc60-1514-4cca-bfdc-4c77ef1cf266 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:46.234489 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2bafdc60-1514-4cca-bfdc-4c77ef1cf266 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:46.234932 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2bafdc60-1514-4cca-bfdc-4c77ef1cf266 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:46.236325 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2bafdc60-1514-4cca-bfdc-4c77ef1cf266 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:46.236766 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2bafdc60-1514-4cca-bfdc-4c77ef1cf266 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:46.264929 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-2bafdc60-1514-4cca-bfdc-4c77ef1cf266 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041629 May 24 15:27:46.265471 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 573/1160] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:46 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:46.439973 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d3d3ed42-910a-415c-bd25-480447fabddd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:46.440969 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d3d3ed42-910a-415c-bd25-480447fabddd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:46.447406 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d3d3ed42-910a-415c-bd25-480447fabddd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:46.447843 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d3d3ed42-910a-415c-bd25-480447fabddd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:46.448622 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d3d3ed42-910a-415c-bd25-480447fabddd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:46.449050 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d3d3ed42-910a-415c-bd25-480447fabddd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:46.477467 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d3d3ed42-910a-415c-bd25-480447fabddd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041483 May 24 15:27:46.478005 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 588/1161] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:46 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:27:46.594362 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-654ba725-a8a6-481b-9670-9678bbd2f7e0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:46.595900 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-654ba725-a8a6-481b-9670-9678bbd2f7e0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:46.602599 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-654ba725-a8a6-481b-9670-9678bbd2f7e0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:46.602885 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-654ba725-a8a6-481b-9670-9678bbd2f7e0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:46.603645 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-654ba725-a8a6-481b-9670-9678bbd2f7e0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:46.604069 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-654ba725-a8a6-481b-9670-9678bbd2f7e0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:46.632748 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-654ba725-a8a6-481b-9670-9678bbd2f7e0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042234 May 24 15:27:46.633312 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 574/1162] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:27:46 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:27:47.276307 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c0edc1b8-f67f-4718-a621-7734656659ee tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:47.277248 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-c0edc1b8-f67f-4718-a621-7734656659ee tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:47.283251 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c0edc1b8-f67f-4718-a621-7734656659ee tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:47.283688 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c0edc1b8-f67f-4718-a621-7734656659ee tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:47.284464 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c0edc1b8-f67f-4718-a621-7734656659ee tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:47.284892 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c0edc1b8-f67f-4718-a621-7734656659ee tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:47.313186 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-c0edc1b8-f67f-4718-a621-7734656659ee tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040856 May 24 15:27:47.313726 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 589/1163] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:47 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:47.489820 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-52347c33-5365-4742-aeeb-6c7b009a55e5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:47.490749 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-52347c33-5365-4742-aeeb-6c7b009a55e5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:47.496838 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-52347c33-5365-4742-aeeb-6c7b009a55e5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:47.497289 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-52347c33-5365-4742-aeeb-6c7b009a55e5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:47.498043 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-52347c33-5365-4742-aeeb-6c7b009a55e5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:47.498476 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-52347c33-5365-4742-aeeb-6c7b009a55e5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:47.526507 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-52347c33-5365-4742-aeeb-6c7b009a55e5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041130 May 24 15:27:47.526985 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 575/1164] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:47 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:47.643361 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-b5136abf-a9a8-4d0f-b4e1-11be82d3ad69 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:47.644277 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-b5136abf-a9a8-4d0f-b4e1-11be82d3ad69 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:47.650627 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b5136abf-a9a8-4d0f-b4e1-11be82d3ad69 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:47.651069 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b5136abf-a9a8-4d0f-b4e1-11be82d3ad69 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:47.651814 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b5136abf-a9a8-4d0f-b4e1-11be82d3ad69 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:47.652244 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b5136abf-a9a8-4d0f-b4e1-11be82d3ad69 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:47.680868 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-b5136abf-a9a8-4d0f-b4e1-11be82d3ad69 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041461 May 24 15:27:47.681398 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 590/1165] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:27:47 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:27:48.325229 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-3c1db647-88eb-4ccf-8911-ded2431f8b08 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:48.326070 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-3c1db647-88eb-4ccf-8911-ded2431f8b08 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:48.333091 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3c1db647-88eb-4ccf-8911-ded2431f8b08 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:48.333532 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3c1db647-88eb-4ccf-8911-ded2431f8b08 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:48.334293 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3c1db647-88eb-4ccf-8911-ded2431f8b08 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:48.334724 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3c1db647-88eb-4ccf-8911-ded2431f8b08 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:48.359698 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:27:48.364852 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-3c1db647-88eb-4ccf-8911-ded2431f8b08 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043667 May 24 15:27:48.365413 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 576/1166] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:48 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:48.538258 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-fb693813-b6a9-4228-837a-0915860537a9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:48.539181 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-fb693813-b6a9-4228-837a-0915860537a9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:48.545212 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fb693813-b6a9-4228-837a-0915860537a9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:48.545650 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fb693813-b6a9-4228-837a-0915860537a9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:48.546395 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fb693813-b6a9-4228-837a-0915860537a9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:48.546822 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fb693813-b6a9-4228-837a-0915860537a9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:48.574830 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-fb693813-b6a9-4228-837a-0915860537a9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040500 May 24 15:27:48.575413 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 591/1167] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:48 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:48.693055 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f1408c4c-9726-4352-9c3e-6e4cd29fc037 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:48.694107 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f1408c4c-9726-4352-9c3e-6e4cd29fc037 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:48.699941 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f1408c4c-9726-4352-9c3e-6e4cd29fc037 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:48.700414 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f1408c4c-9726-4352-9c3e-6e4cd29fc037 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:48.701164 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f1408c4c-9726-4352-9c3e-6e4cd29fc037 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:48.701591 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f1408c4c-9726-4352-9c3e-6e4cd29fc037 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:48.729172 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f1408c4c-9726-4352-9c3e-6e4cd29fc037 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040894 May 24 15:27:48.729702 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 577/1168] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:27:48 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:27:49.376470 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-9fcb1628-9740-433a-80d0-4acbfd0dff5c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:49.377326 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-9fcb1628-9740-433a-80d0-4acbfd0dff5c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:49.383769 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9fcb1628-9740-433a-80d0-4acbfd0dff5c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:49.384220 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9fcb1628-9740-433a-80d0-4acbfd0dff5c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:49.385017 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9fcb1628-9740-433a-80d0-4acbfd0dff5c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:49.385455 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9fcb1628-9740-433a-80d0-4acbfd0dff5c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:49.414627 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-9fcb1628-9740-433a-80d0-4acbfd0dff5c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042261 May 24 15:27:49.415172 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 592/1169] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:49 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:49.586543 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f2dc0fb9-990d-4b30-bcef-b43694c996a0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:49.587499 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f2dc0fb9-990d-4b30-bcef-b43694c996a0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:49.593931 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f2dc0fb9-990d-4b30-bcef-b43694c996a0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:49.594371 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f2dc0fb9-990d-4b30-bcef-b43694c996a0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:49.595721 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f2dc0fb9-990d-4b30-bcef-b43694c996a0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:49.596150 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f2dc0fb9-990d-4b30-bcef-b43694c996a0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:49.624625 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f2dc0fb9-990d-4b30-bcef-b43694c996a0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041966 May 24 15:27:49.625155 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 578/1170] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:49 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:49.740545 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-85373b58-2e08-49f3-b2ce-90e27bd8824b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:49.741464 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-85373b58-2e08-49f3-b2ce-90e27bd8824b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:49.747590 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-85373b58-2e08-49f3-b2ce-90e27bd8824b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:49.748031 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-85373b58-2e08-49f3-b2ce-90e27bd8824b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:49.748843 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-85373b58-2e08-49f3-b2ce-90e27bd8824b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:49.749271 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-85373b58-2e08-49f3-b2ce-90e27bd8824b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:49.773733 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:27:49.778667 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-85373b58-2e08-49f3-b2ce-90e27bd8824b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042256 May 24 15:27:49.779215 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 593/1171] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:27:49 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:27:50.426659 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-519b8c02-6f0b-4a63-8ed3-2c90dbf5b891 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:50.427498 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-519b8c02-6f0b-4a63-8ed3-2c90dbf5b891 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:50.433502 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-519b8c02-6f0b-4a63-8ed3-2c90dbf5b891 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:50.433943 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-519b8c02-6f0b-4a63-8ed3-2c90dbf5b891 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:50.434695 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-519b8c02-6f0b-4a63-8ed3-2c90dbf5b891 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:50.435121 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-519b8c02-6f0b-4a63-8ed3-2c90dbf5b891 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:50.463624 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-519b8c02-6f0b-4a63-8ed3-2c90dbf5b891 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041471 May 24 15:27:50.464166 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 579/1172] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:50 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:50.635068 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-586bb568-762b-42c2-8663-bbc557c890f7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:50.635982 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-586bb568-762b-42c2-8663-bbc557c890f7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:50.642175 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-586bb568-762b-42c2-8663-bbc557c890f7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:50.642616 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-586bb568-762b-42c2-8663-bbc557c890f7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:50.643391 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-586bb568-762b-42c2-8663-bbc557c890f7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:50.643816 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-586bb568-762b-42c2-8663-bbc557c890f7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:50.671627 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-586bb568-762b-42c2-8663-bbc557c890f7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040533 May 24 15:27:50.672164 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 594/1173] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:50 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:50.789684 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-672e3bf2-b34c-4bac-b56d-3a204bb6fc3f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:50.790634 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-672e3bf2-b34c-4bac-b56d-3a204bb6fc3f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:50.797394 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-672e3bf2-b34c-4bac-b56d-3a204bb6fc3f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:50.797834 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-672e3bf2-b34c-4bac-b56d-3a204bb6fc3f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:50.799272 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-672e3bf2-b34c-4bac-b56d-3a204bb6fc3f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:50.799695 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-672e3bf2-b34c-4bac-b56d-3a204bb6fc3f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:50.828374 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-672e3bf2-b34c-4bac-b56d-3a204bb6fc3f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042613 May 24 15:27:50.828924 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 580/1174] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:27:50 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:27:51.475137 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-8b5a1bdc-dd38-44b4-96bc-93df49e333fc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:51.476061 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-8b5a1bdc-dd38-44b4-96bc-93df49e333fc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:51.482813 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8b5a1bdc-dd38-44b4-96bc-93df49e333fc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:51.483262 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8b5a1bdc-dd38-44b4-96bc-93df49e333fc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:51.484024 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8b5a1bdc-dd38-44b4-96bc-93df49e333fc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:51.484503 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8b5a1bdc-dd38-44b4-96bc-93df49e333fc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:51.513217 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-8b5a1bdc-dd38-44b4-96bc-93df49e333fc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042142 May 24 15:27:51.513759 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 595/1175] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:51 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:27:51.683705 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-2288e1b0-a59a-4276-a3e5-2cd169b73e16 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:51.684768 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-2288e1b0-a59a-4276-a3e5-2cd169b73e16 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:51.691290 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2288e1b0-a59a-4276-a3e5-2cd169b73e16 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:51.691726 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2288e1b0-a59a-4276-a3e5-2cd169b73e16 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:51.692506 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2288e1b0-a59a-4276-a3e5-2cd169b73e16 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:51.692933 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2288e1b0-a59a-4276-a3e5-2cd169b73e16 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:51.719976 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-2288e1b0-a59a-4276-a3e5-2cd169b73e16 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040169 May 24 15:27:51.720538 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 581/1176] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:51 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:51.839037 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-65d439d2-0140-454a-9bc7-df67cc723521 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:51.839957 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-65d439d2-0140-454a-9bc7-df67cc723521 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:51.846012 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-65d439d2-0140-454a-9bc7-df67cc723521 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:51.846469 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-65d439d2-0140-454a-9bc7-df67cc723521 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:51.847227 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-65d439d2-0140-454a-9bc7-df67cc723521 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:51.847666 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-65d439d2-0140-454a-9bc7-df67cc723521 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:51.876962 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-65d439d2-0140-454a-9bc7-df67cc723521 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041296 May 24 15:27:51.877508 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 596/1177] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:27:51 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:27:52.525496 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-74548ff7-4522-4ffe-ac16-f6d3bda1275b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:52.526422 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-74548ff7-4522-4ffe-ac16-f6d3bda1275b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:52.533559 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-74548ff7-4522-4ffe-ac16-f6d3bda1275b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:52.533941 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-74548ff7-4522-4ffe-ac16-f6d3bda1275b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:52.534691 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-74548ff7-4522-4ffe-ac16-f6d3bda1275b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:52.535115 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-74548ff7-4522-4ffe-ac16-f6d3bda1275b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:52.562824 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-74548ff7-4522-4ffe-ac16-f6d3bda1275b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041490 May 24 15:27:52.563364 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 582/1178] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:52 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:52.730999 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-f8f38549-12a7-49f0-b215-13dae342daeb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:52.731912 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-f8f38549-12a7-49f0-b215-13dae342daeb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:52.738610 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f8f38549-12a7-49f0-b215-13dae342daeb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:52.739050 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f8f38549-12a7-49f0-b215-13dae342daeb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:52.739792 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f8f38549-12a7-49f0-b215-13dae342daeb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:52.740221 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f8f38549-12a7-49f0-b215-13dae342daeb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:52.767865 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-f8f38549-12a7-49f0-b215-13dae342daeb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040841 May 24 15:27:52.768427 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 597/1179] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:52 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:52.888116 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e1b74a6c-923b-4fa0-821f-c2a7dace8d52 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:52.889063 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-e1b74a6c-923b-4fa0-821f-c2a7dace8d52 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:52.895856 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e1b74a6c-923b-4fa0-821f-c2a7dace8d52 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:52.896320 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e1b74a6c-923b-4fa0-821f-c2a7dace8d52 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:52.897108 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e1b74a6c-923b-4fa0-821f-c2a7dace8d52 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:52.897539 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e1b74a6c-923b-4fa0-821f-c2a7dace8d52 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:52.927281 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-e1b74a6c-923b-4fa0-821f-c2a7dace8d52 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042979 May 24 15:27:52.927829 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 583/1180] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:27:52 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:27:53.574102 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-547b4a5d-87fe-4863-8732-33b079d2f43a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:53.575026 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-547b4a5d-87fe-4863-8732-33b079d2f43a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:53.581095 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-547b4a5d-87fe-4863-8732-33b079d2f43a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:53.581547 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-547b4a5d-87fe-4863-8732-33b079d2f43a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:53.582299 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-547b4a5d-87fe-4863-8732-33b079d2f43a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:53.582733 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-547b4a5d-87fe-4863-8732-33b079d2f43a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:53.611519 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-547b4a5d-87fe-4863-8732-33b079d2f43a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040878 May 24 15:27:53.612050 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 598/1181] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:53 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:53.779179 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-b4023331-b4fb-4f13-89b6-625bc51210f7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:53.780109 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-b4023331-b4fb-4f13-89b6-625bc51210f7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:53.787047 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b4023331-b4fb-4f13-89b6-625bc51210f7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:53.787485 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b4023331-b4fb-4f13-89b6-625bc51210f7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:53.788229 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b4023331-b4fb-4f13-89b6-625bc51210f7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:53.788682 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b4023331-b4fb-4f13-89b6-625bc51210f7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:53.816631 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-b4023331-b4fb-4f13-89b6-625bc51210f7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041382 May 24 15:27:53.817162 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 584/1182] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:53 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:53.938754 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-619bbbbb-c7f3-431e-a2da-31f4df466799 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:53.939732 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-619bbbbb-c7f3-431e-a2da-31f4df466799 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:53.946200 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-619bbbbb-c7f3-431e-a2da-31f4df466799 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:53.946666 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-619bbbbb-c7f3-431e-a2da-31f4df466799 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:53.947399 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-619bbbbb-c7f3-431e-a2da-31f4df466799 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:53.947840 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-619bbbbb-c7f3-431e-a2da-31f4df466799 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:53.976840 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-619bbbbb-c7f3-431e-a2da-31f4df466799 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042047 May 24 15:27:53.977385 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 599/1183] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:27:53 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:27:54.622926 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-8c45d606-a79d-43b0-9638-34bf7542d45f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:54.623912 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-8c45d606-a79d-43b0-9638-34bf7542d45f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:54.630578 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8c45d606-a79d-43b0-9638-34bf7542d45f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:54.631021 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8c45d606-a79d-43b0-9638-34bf7542d45f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:54.631776 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8c45d606-a79d-43b0-9638-34bf7542d45f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:54.632378 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8c45d606-a79d-43b0-9638-34bf7542d45f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:54.667415 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-8c45d606-a79d-43b0-9638-34bf7542d45f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048424 May 24 15:27:54.667964 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 585/1184] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:54 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:54.827327 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-0bd86fe4-7701-4f5c-8dda-5c465b2b65a2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:54.828234 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-0bd86fe4-7701-4f5c-8dda-5c465b2b65a2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:54.834345 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0bd86fe4-7701-4f5c-8dda-5c465b2b65a2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:54.834785 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0bd86fe4-7701-4f5c-8dda-5c465b2b65a2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:54.835530 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0bd86fe4-7701-4f5c-8dda-5c465b2b65a2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:54.835959 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0bd86fe4-7701-4f5c-8dda-5c465b2b65a2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:54.863957 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-0bd86fe4-7701-4f5c-8dda-5c465b2b65a2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040585 May 24 15:27:54.864452 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 600/1185] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:54 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:54.988983 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-9a099a62-1ef6-47ca-a111-6c97f3759c09 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:54.989904 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-9a099a62-1ef6-47ca-a111-6c97f3759c09 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:54.996279 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9a099a62-1ef6-47ca-a111-6c97f3759c09 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:54.996751 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9a099a62-1ef6-47ca-a111-6c97f3759c09 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:54.997509 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9a099a62-1ef6-47ca-a111-6c97f3759c09 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:54.997936 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9a099a62-1ef6-47ca-a111-6c97f3759c09 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:55.026252 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-9a099a62-1ef6-47ca-a111-6c97f3759c09 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041693 May 24 15:27:55.026794 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 586/1186] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:27:54 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:27:55.678945 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-0f7e9341-a553-4c62-b7c9-a38a64709398 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:55.679861 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-0f7e9341-a553-4c62-b7c9-a38a64709398 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:55.686450 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0f7e9341-a553-4c62-b7c9-a38a64709398 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:55.686903 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0f7e9341-a553-4c62-b7c9-a38a64709398 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:55.687665 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0f7e9341-a553-4c62-b7c9-a38a64709398 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:55.688109 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0f7e9341-a553-4c62-b7c9-a38a64709398 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:55.716646 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-0f7e9341-a553-4c62-b7c9-a38a64709398 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041624 May 24 15:27:55.717201 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 601/1187] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:55 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:55.874939 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-01fd907d-18e3-40bc-b6cb-72f1ddd59ec8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:55.875861 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-01fd907d-18e3-40bc-b6cb-72f1ddd59ec8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:55.882378 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-01fd907d-18e3-40bc-b6cb-72f1ddd59ec8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:55.882822 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-01fd907d-18e3-40bc-b6cb-72f1ddd59ec8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:55.883575 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-01fd907d-18e3-40bc-b6cb-72f1ddd59ec8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:55.884005 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-01fd907d-18e3-40bc-b6cb-72f1ddd59ec8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:55.911949 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-01fd907d-18e3-40bc-b6cb-72f1ddd59ec8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040929 May 24 15:27:55.912515 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 587/1188] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:55 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:56.037587 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-07163c43-7a05-4892-b656-c6d739c174b5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:56.038498 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-07163c43-7a05-4892-b656-c6d739c174b5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:56.044361 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-07163c43-7a05-4892-b656-c6d739c174b5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:56.044806 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-07163c43-7a05-4892-b656-c6d739c174b5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:56.045553 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-07163c43-7a05-4892-b656-c6d739c174b5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:56.045974 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-07163c43-7a05-4892-b656-c6d739c174b5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:56.074158 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-07163c43-7a05-4892-b656-c6d739c174b5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040466 May 24 15:27:56.074708 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 602/1189] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:27:56 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:27:56.729230 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-cb43527c-5dd0-4dd6-aa4e-200f2f5e39be tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:56.730158 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-cb43527c-5dd0-4dd6-aa4e-200f2f5e39be tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:56.737570 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cb43527c-5dd0-4dd6-aa4e-200f2f5e39be tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:56.738015 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cb43527c-5dd0-4dd6-aa4e-200f2f5e39be tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:56.738776 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cb43527c-5dd0-4dd6-aa4e-200f2f5e39be tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:56.739208 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cb43527c-5dd0-4dd6-aa4e-200f2f5e39be tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:56.767358 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-cb43527c-5dd0-4dd6-aa4e-200f2f5e39be tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042127 May 24 15:27:56.767894 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 588/1190] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:56 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:56.923859 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-db143f02-d307-4316-9daa-2d8d8aea5bed tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:56.924723 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-db143f02-d307-4316-9daa-2d8d8aea5bed tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:56.931069 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-db143f02-d307-4316-9daa-2d8d8aea5bed tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:56.931510 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-db143f02-d307-4316-9daa-2d8d8aea5bed tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:56.932255 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-db143f02-d307-4316-9daa-2d8d8aea5bed tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:56.932709 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-db143f02-d307-4316-9daa-2d8d8aea5bed tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:56.960635 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-db143f02-d307-4316-9daa-2d8d8aea5bed tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040957 May 24 15:27:56.961184 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 603/1191] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:56 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:57.085889 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-416942e1-7ce3-4df5-a005-110d8d66617e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:57.086818 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-416942e1-7ce3-4df5-a005-110d8d66617e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:57.092946 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-416942e1-7ce3-4df5-a005-110d8d66617e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:57.093398 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-416942e1-7ce3-4df5-a005-110d8d66617e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:57.094161 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-416942e1-7ce3-4df5-a005-110d8d66617e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:57.094606 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-416942e1-7ce3-4df5-a005-110d8d66617e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:57.123487 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-416942e1-7ce3-4df5-a005-110d8d66617e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041574 May 24 15:27:57.124031 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 589/1192] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:27:57 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:27:57.778548 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-cadd8405-989d-45d3-a078-c9e77d55b20c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:57.779465 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-cadd8405-989d-45d3-a078-c9e77d55b20c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:57.786122 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cadd8405-989d-45d3-a078-c9e77d55b20c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:57.786567 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cadd8405-989d-45d3-a078-c9e77d55b20c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:57.787324 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cadd8405-989d-45d3-a078-c9e77d55b20c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:57.787754 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cadd8405-989d-45d3-a078-c9e77d55b20c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:57.815917 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-cadd8405-989d-45d3-a078-c9e77d55b20c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041337 May 24 15:27:57.816535 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 604/1193] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:57 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:57.972736 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f0f5c039-4ea3-44d7-bb29-463ce1bb421c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:57.973657 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f0f5c039-4ea3-44d7-bb29-463ce1bb421c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:57.980098 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f0f5c039-4ea3-44d7-bb29-463ce1bb421c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:57.980581 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f0f5c039-4ea3-44d7-bb29-463ce1bb421c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:57.981342 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f0f5c039-4ea3-44d7-bb29-463ce1bb421c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:57.981779 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f0f5c039-4ea3-44d7-bb29-463ce1bb421c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:58.009345 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f0f5c039-4ea3-44d7-bb29-463ce1bb421c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041261 May 24 15:27:58.009899 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 590/1194] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:57 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:58.134871 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-da3f7a08-5ac7-4093-ae00-e5e7662ce849 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:58.135772 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-da3f7a08-5ac7-4093-ae00-e5e7662ce849 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:58.142763 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-da3f7a08-5ac7-4093-ae00-e5e7662ce849 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:58.143205 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-da3f7a08-5ac7-4093-ae00-e5e7662ce849 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:58.143983 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-da3f7a08-5ac7-4093-ae00-e5e7662ce849 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:58.144450 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-da3f7a08-5ac7-4093-ae00-e5e7662ce849 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:58.172050 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-da3f7a08-5ac7-4093-ae00-e5e7662ce849 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041127 May 24 15:27:58.172630 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 605/1195] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:27:58 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:27:58.827069 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-b3f28d94-91a5-4af7-8bdb-2d10741615a5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:58.827999 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-b3f28d94-91a5-4af7-8bdb-2d10741615a5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:58.829889 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_api:SELECT=86 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:27:58.835302 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b3f28d94-91a5-4af7-8bdb-2d10741615a5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:58.835746 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b3f28d94-91a5-4af7-8bdb-2d10741615a5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:58.836544 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b3f28d94-91a5-4af7-8bdb-2d10741615a5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:58.836979 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b3f28d94-91a5-4af7-8bdb-2d10741615a5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:58.866243 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-b3f28d94-91a5-4af7-8bdb-2d10741615a5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043043 May 24 15:27:58.866726 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 591/1196] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:58 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:59.020478 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-494d7da6-22e5-4408-b311-c708ac0720dc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:59.021409 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-494d7da6-22e5-4408-b311-c708ac0720dc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:59.027456 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-494d7da6-22e5-4408-b311-c708ac0720dc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:59.027905 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-494d7da6-22e5-4408-b311-c708ac0720dc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:59.028699 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-494d7da6-22e5-4408-b311-c708ac0720dc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:59.029135 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-494d7da6-22e5-4408-b311-c708ac0720dc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:59.057686 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-494d7da6-22e5-4408-b311-c708ac0720dc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041255 May 24 15:27:59.058251 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 606/1197] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:59 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:27:59.182860 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-155a8eb7-1a8a-45c3-9e5b-cdbcd894f9a9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:59.183770 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-155a8eb7-1a8a-45c3-9e5b-cdbcd894f9a9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:59.190152 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-155a8eb7-1a8a-45c3-9e5b-cdbcd894f9a9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:59.190588 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-155a8eb7-1a8a-45c3-9e5b-cdbcd894f9a9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:59.191334 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-155a8eb7-1a8a-45c3-9e5b-cdbcd894f9a9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:59.191760 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-155a8eb7-1a8a-45c3-9e5b-cdbcd894f9a9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:59.220649 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-155a8eb7-1a8a-45c3-9e5b-cdbcd894f9a9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041015 May 24 15:27:59.221180 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 592/1198] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:27:59 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:27:59.878111 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-f72bc3e5-328c-45d1-a657-25a1603da615 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:27:59.879025 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-f72bc3e5-328c-45d1-a657-25a1603da615 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:27:59.885381 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f72bc3e5-328c-45d1-a657-25a1603da615 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:59.885824 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f72bc3e5-328c-45d1-a657-25a1603da615 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:59.886573 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f72bc3e5-328c-45d1-a657-25a1603da615 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:27:59.887000 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f72bc3e5-328c-45d1-a657-25a1603da615 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:27:59.915837 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-f72bc3e5-328c-45d1-a657-25a1603da615 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042215 May 24 15:27:59.916389 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 607/1199] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:27:59 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:00.069798 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-6bf909d3-8827-4791-9269-6565f14cbad7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:00.070727 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-6bf909d3-8827-4791-9269-6565f14cbad7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:00.077263 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6bf909d3-8827-4791-9269-6565f14cbad7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:00.077708 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6bf909d3-8827-4791-9269-6565f14cbad7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:00.078468 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6bf909d3-8827-4791-9269-6565f14cbad7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:00.078895 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6bf909d3-8827-4791-9269-6565f14cbad7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:00.096631 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:28:00.109506 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-6bf909d3-8827-4791-9269-6565f14cbad7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043723 May 24 15:28:00.110072 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 593/1200] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:00 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:00.231963 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-ef32e99f-6fc7-4106-8611-5e6a545b1aaa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:00.233256 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-ef32e99f-6fc7-4106-8611-5e6a545b1aaa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:00.239586 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ef32e99f-6fc7-4106-8611-5e6a545b1aaa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:00.240032 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ef32e99f-6fc7-4106-8611-5e6a545b1aaa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:00.240850 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ef32e99f-6fc7-4106-8611-5e6a545b1aaa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:00.241285 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ef32e99f-6fc7-4106-8611-5e6a545b1aaa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:00.269572 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-ef32e99f-6fc7-4106-8611-5e6a545b1aaa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041503 May 24 15:28:00.270114 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 608/1201] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:28:00 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:28:00.927717 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-b8146136-5d7f-405d-8999-833ace7b2723 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:00.928584 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-b8146136-5d7f-405d-8999-833ace7b2723 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:00.934963 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b8146136-5d7f-405d-8999-833ace7b2723 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:00.935398 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b8146136-5d7f-405d-8999-833ace7b2723 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:00.936177 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b8146136-5d7f-405d-8999-833ace7b2723 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:00.936637 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b8146136-5d7f-405d-8999-833ace7b2723 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:00.965703 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-b8146136-5d7f-405d-8999-833ace7b2723 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042430 May 24 15:28:00.966256 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 594/1202] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:00 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:01.121566 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c459165f-1267-4912-b9a9-5c6e07a70d96 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:01.122527 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-c459165f-1267-4912-b9a9-5c6e07a70d96 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:01.129531 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c459165f-1267-4912-b9a9-5c6e07a70d96 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:01.129984 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c459165f-1267-4912-b9a9-5c6e07a70d96 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:01.130748 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c459165f-1267-4912-b9a9-5c6e07a70d96 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:01.131181 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c459165f-1267-4912-b9a9-5c6e07a70d96 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:01.159629 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-c459165f-1267-4912-b9a9-5c6e07a70d96 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042044 May 24 15:28:01.160176 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 609/1203] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:01 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:28:01.280905 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e196d5be-c738-4ffe-9d16-a35573fca93d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:01.281819 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-e196d5be-c738-4ffe-9d16-a35573fca93d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:01.287759 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e196d5be-c738-4ffe-9d16-a35573fca93d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:01.288193 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e196d5be-c738-4ffe-9d16-a35573fca93d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:01.288970 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e196d5be-c738-4ffe-9d16-a35573fca93d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:01.289396 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e196d5be-c738-4ffe-9d16-a35573fca93d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:01.317897 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-e196d5be-c738-4ffe-9d16-a35573fca93d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040901 May 24 15:28:01.318441 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 595/1204] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:28:01 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:28:01.977917 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-2e79f170-1e0f-4cca-bccb-2e039adb2b0f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:01.978840 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-2e79f170-1e0f-4cca-bccb-2e039adb2b0f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:01.985225 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2e79f170-1e0f-4cca-bccb-2e039adb2b0f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:01.985676 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2e79f170-1e0f-4cca-bccb-2e039adb2b0f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:01.986433 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2e79f170-1e0f-4cca-bccb-2e039adb2b0f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:01.986867 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2e79f170-1e0f-4cca-bccb-2e039adb2b0f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:02.000894 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:28:02.016044 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-2e79f170-1e0f-4cca-bccb-2e039adb2b0f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042137 May 24 15:28:02.016615 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 610/1205] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:01 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:02.171035 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-99c18e17-cc8f-4a93-915f-48844a86c028 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:02.171973 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-99c18e17-cc8f-4a93-915f-48844a86c028 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:02.178506 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-99c18e17-cc8f-4a93-915f-48844a86c028 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:02.178955 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-99c18e17-cc8f-4a93-915f-48844a86c028 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:02.179712 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-99c18e17-cc8f-4a93-915f-48844a86c028 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:02.180143 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-99c18e17-cc8f-4a93-915f-48844a86c028 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:02.212080 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-99c18e17-cc8f-4a93-915f-48844a86c028 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044970 May 24 15:28:02.212650 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 596/1206] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:02 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:02.329311 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-15d57adb-b4de-4996-ba9c-b6bcc9dd6720 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:02.330225 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-15d57adb-b4de-4996-ba9c-b6bcc9dd6720 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:02.337191 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-15d57adb-b4de-4996-ba9c-b6bcc9dd6720 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:02.337639 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-15d57adb-b4de-4996-ba9c-b6bcc9dd6720 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:02.338401 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-15d57adb-b4de-4996-ba9c-b6bcc9dd6720 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:02.338836 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-15d57adb-b4de-4996-ba9c-b6bcc9dd6720 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:02.368207 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-15d57adb-b4de-4996-ba9c-b6bcc9dd6720 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042830 May 24 15:28:02.368782 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 611/1207] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:28:02 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:28:03.027515 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e4f22d7d-e9cd-4d5e-9fbb-83a9f1f24df9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:03.028486 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-e4f22d7d-e9cd-4d5e-9fbb-83a9f1f24df9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:03.035193 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e4f22d7d-e9cd-4d5e-9fbb-83a9f1f24df9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:03.035640 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e4f22d7d-e9cd-4d5e-9fbb-83a9f1f24df9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:03.036424 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e4f22d7d-e9cd-4d5e-9fbb-83a9f1f24df9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:03.036858 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e4f22d7d-e9cd-4d5e-9fbb-83a9f1f24df9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:03.064710 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-e4f22d7d-e9cd-4d5e-9fbb-83a9f1f24df9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041167 May 24 15:28:03.065264 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 597/1208] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:03 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:03.224438 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-921ec746-a60f-4e83-a2cf-0d64dee68aa8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:03.225356 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-921ec746-a60f-4e83-a2cf-0d64dee68aa8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:03.231482 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-921ec746-a60f-4e83-a2cf-0d64dee68aa8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:03.231929 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-921ec746-a60f-4e83-a2cf-0d64dee68aa8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:03.232732 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-921ec746-a60f-4e83-a2cf-0d64dee68aa8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:03.233418 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-921ec746-a60f-4e83-a2cf-0d64dee68aa8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:03.263519 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-921ec746-a60f-4e83-a2cf-0d64dee68aa8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043683 May 24 15:28:03.264078 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 612/1209] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:03 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:03.379506 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d285a844-ea60-4263-a70b-968785da9689 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:03.380464 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d285a844-ea60-4263-a70b-968785da9689 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:03.386817 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d285a844-ea60-4263-a70b-968785da9689 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:03.387257 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d285a844-ea60-4263-a70b-968785da9689 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:03.388005 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d285a844-ea60-4263-a70b-968785da9689 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:03.388464 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d285a844-ea60-4263-a70b-968785da9689 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:03.417001 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d285a844-ea60-4263-a70b-968785da9689 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041987 May 24 15:28:03.417540 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 598/1210] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:28:03 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:28:04.076371 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-366c79b7-b0c7-499d-ab55-98004c564840 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:04.077287 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-366c79b7-b0c7-499d-ab55-98004c564840 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:04.083804 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-366c79b7-b0c7-499d-ab55-98004c564840 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:04.084253 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-366c79b7-b0c7-499d-ab55-98004c564840 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:04.085045 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-366c79b7-b0c7-499d-ab55-98004c564840 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:04.085805 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-366c79b7-b0c7-499d-ab55-98004c564840 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:04.115304 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-366c79b7-b0c7-499d-ab55-98004c564840 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042950 May 24 15:28:04.115848 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 613/1211] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:04 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:04.274762 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-2aa5a369-64aa-4013-94a3-ef83adb7acad tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:04.275680 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-2aa5a369-64aa-4013-94a3-ef83adb7acad tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:04.281748 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2aa5a369-64aa-4013-94a3-ef83adb7acad tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:04.282181 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2aa5a369-64aa-4013-94a3-ef83adb7acad tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:04.282925 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2aa5a369-64aa-4013-94a3-ef83adb7acad tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:04.283377 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2aa5a369-64aa-4013-94a3-ef83adb7acad tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:04.311851 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-2aa5a369-64aa-4013-94a3-ef83adb7acad tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041142 May 24 15:28:04.312398 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 599/1212] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:04 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:04.428400 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-0f92f8b3-9134-4d9e-84bf-5a690a9350b2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:04.429315 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-0f92f8b3-9134-4d9e-84bf-5a690a9350b2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:04.435251 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0f92f8b3-9134-4d9e-84bf-5a690a9350b2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:04.435698 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0f92f8b3-9134-4d9e-84bf-5a690a9350b2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:04.436480 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0f92f8b3-9134-4d9e-84bf-5a690a9350b2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:04.436913 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0f92f8b3-9134-4d9e-84bf-5a690a9350b2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:04.465692 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-0f92f8b3-9134-4d9e-84bf-5a690a9350b2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041209 May 24 15:28:04.466241 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 614/1213] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:28:04 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 15:28:05.126742 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-5ee8f8c8-fc89-4894-843f-f5eb07662125 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:05.128339 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-5ee8f8c8-fc89-4894-843f-f5eb07662125 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:05.134864 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5ee8f8c8-fc89-4894-843f-f5eb07662125 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:05.135306 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5ee8f8c8-fc89-4894-843f-f5eb07662125 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:05.136062 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5ee8f8c8-fc89-4894-843f-f5eb07662125 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:05.136523 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5ee8f8c8-fc89-4894-843f-f5eb07662125 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:05.164657 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-5ee8f8c8-fc89-4894-843f-f5eb07662125 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041838 May 24 15:28:05.165193 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 600/1214] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:05 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:05.323009 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-24615768-0820-4ebc-ab12-9072317a21e4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:05.323901 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-24615768-0820-4ebc-ab12-9072317a21e4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:05.330362 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-24615768-0820-4ebc-ab12-9072317a21e4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:05.330810 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-24615768-0820-4ebc-ab12-9072317a21e4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:05.331572 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-24615768-0820-4ebc-ab12-9072317a21e4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:05.332009 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-24615768-0820-4ebc-ab12-9072317a21e4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:05.359947 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-24615768-0820-4ebc-ab12-9072317a21e4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040933 May 24 15:28:05.360530 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 615/1215] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:05 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:05.477718 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-dd51c4c0-1ee6-40a3-a836-1b7aec06f4a9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:05.478639 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-dd51c4c0-1ee6-40a3-a836-1b7aec06f4a9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:05.484867 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dd51c4c0-1ee6-40a3-a836-1b7aec06f4a9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:05.485311 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dd51c4c0-1ee6-40a3-a836-1b7aec06f4a9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:05.486071 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dd51c4c0-1ee6-40a3-a836-1b7aec06f4a9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:05.486505 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dd51c4c0-1ee6-40a3-a836-1b7aec06f4a9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:05.514907 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-dd51c4c0-1ee6-40a3-a836-1b7aec06f4a9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041174 May 24 15:28:05.515447 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 601/1216] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:28:05 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:28:06.176195 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-f721de54-6cf6-4512-aff8-5a9dde45b685 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:06.177176 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-f721de54-6cf6-4512-aff8-5a9dde45b685 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:06.183307 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f721de54-6cf6-4512-aff8-5a9dde45b685 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:06.183702 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f721de54-6cf6-4512-aff8-5a9dde45b685 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:06.184512 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f721de54-6cf6-4512-aff8-5a9dde45b685 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:06.184940 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f721de54-6cf6-4512-aff8-5a9dde45b685 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:06.213503 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-f721de54-6cf6-4512-aff8-5a9dde45b685 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041190 May 24 15:28:06.214043 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 616/1217] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:06 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:06.371873 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a739d9ce-9f87-47d7-a11a-509c508634e1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:06.372990 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a739d9ce-9f87-47d7-a11a-509c508634e1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:06.379499 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a739d9ce-9f87-47d7-a11a-509c508634e1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:06.379942 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a739d9ce-9f87-47d7-a11a-509c508634e1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:06.380734 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a739d9ce-9f87-47d7-a11a-509c508634e1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:06.381161 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a739d9ce-9f87-47d7-a11a-509c508634e1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:06.412753 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a739d9ce-9f87-47d7-a11a-509c508634e1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044678 May 24 15:28:06.413303 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 602/1218] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:06 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:06.526242 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-16498f39-2475-465a-924c-291fc5ed6815 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:06.527161 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-16498f39-2475-465a-924c-291fc5ed6815 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:06.533569 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-16498f39-2475-465a-924c-291fc5ed6815 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:06.534508 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-16498f39-2475-465a-924c-291fc5ed6815 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:06.535260 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-16498f39-2475-465a-924c-291fc5ed6815 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:06.535692 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-16498f39-2475-465a-924c-291fc5ed6815 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:06.564338 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-16498f39-2475-465a-924c-291fc5ed6815 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041870 May 24 15:28:06.564888 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 617/1219] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:28:06 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:28:07.225605 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-829dd70e-bee7-4678-8e52-7e8e312de164 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:07.226530 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-829dd70e-bee7-4678-8e52-7e8e312de164 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:07.232597 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-829dd70e-bee7-4678-8e52-7e8e312de164 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:07.233301 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-829dd70e-bee7-4678-8e52-7e8e312de164 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:07.234050 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-829dd70e-bee7-4678-8e52-7e8e312de164 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:07.234477 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-829dd70e-bee7-4678-8e52-7e8e312de164 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:07.262666 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-829dd70e-bee7-4678-8e52-7e8e312de164 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041937 May 24 15:28:07.263197 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 603/1220] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:07 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:07.424084 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-f3ff98f4-a62b-4036-8507-49a8be833a05 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:07.425076 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-f3ff98f4-a62b-4036-8507-49a8be833a05 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:07.431308 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f3ff98f4-a62b-4036-8507-49a8be833a05 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:07.431752 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f3ff98f4-a62b-4036-8507-49a8be833a05 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:07.432540 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f3ff98f4-a62b-4036-8507-49a8be833a05 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:07.432968 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f3ff98f4-a62b-4036-8507-49a8be833a05 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:07.460669 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-f3ff98f4-a62b-4036-8507-49a8be833a05 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040420 May 24 15:28:07.461200 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 618/1221] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:07 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:07.575269 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-839726d6-be25-43ec-b7d4-002a329bc02a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:07.576183 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-839726d6-be25-43ec-b7d4-002a329bc02a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:07.582635 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-839726d6-be25-43ec-b7d4-002a329bc02a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:07.583067 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-839726d6-be25-43ec-b7d4-002a329bc02a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:07.583828 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-839726d6-be25-43ec-b7d4-002a329bc02a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:07.584258 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-839726d6-be25-43ec-b7d4-002a329bc02a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:07.612647 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-839726d6-be25-43ec-b7d4-002a329bc02a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041269 May 24 15:28:07.613193 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 604/1222] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:28:07 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:28:08.274121 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-3b0af763-b220-4b24-ad3c-f7122d958414 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:08.275036 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-3b0af763-b220-4b24-ad3c-f7122d958414 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:08.277452 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_api:SELECT=86 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:28:08.282628 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3b0af763-b220-4b24-ad3c-f7122d958414 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:08.283070 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3b0af763-b220-4b24-ad3c-f7122d958414 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:08.283853 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3b0af763-b220-4b24-ad3c-f7122d958414 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:08.284286 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3b0af763-b220-4b24-ad3c-f7122d958414 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:08.312184 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-3b0af763-b220-4b24-ad3c-f7122d958414 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042001 May 24 15:28:08.312758 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 619/1223] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:08 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:08.471900 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-572cbe75-4393-424b-8ba2-c1a6e456a9b8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:08.472845 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-572cbe75-4393-424b-8ba2-c1a6e456a9b8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:08.479249 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-572cbe75-4393-424b-8ba2-c1a6e456a9b8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:08.479686 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-572cbe75-4393-424b-8ba2-c1a6e456a9b8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:08.480469 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-572cbe75-4393-424b-8ba2-c1a6e456a9b8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:08.480897 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-572cbe75-4393-424b-8ba2-c1a6e456a9b8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:08.508681 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-572cbe75-4393-424b-8ba2-c1a6e456a9b8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040745 May 24 15:28:08.509211 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 605/1224] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:08 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:08.622892 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-1caf1f66-42a3-49cd-b3b7-429d08eef8fe tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:08.623803 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-1caf1f66-42a3-49cd-b3b7-429d08eef8fe tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:08.630325 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1caf1f66-42a3-49cd-b3b7-429d08eef8fe tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:08.630769 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1caf1f66-42a3-49cd-b3b7-429d08eef8fe tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:08.631512 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1caf1f66-42a3-49cd-b3b7-429d08eef8fe tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:08.631936 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1caf1f66-42a3-49cd-b3b7-429d08eef8fe tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:08.659236 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-1caf1f66-42a3-49cd-b3b7-429d08eef8fe tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040274 May 24 15:28:08.659764 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 620/1225] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:28:08 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:28:09.324144 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-32ad79b2-c9b2-41b8-9363-1fcb9f7ebf2f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:09.325031 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-32ad79b2-c9b2-41b8-9363-1fcb9f7ebf2f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:09.331617 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-32ad79b2-c9b2-41b8-9363-1fcb9f7ebf2f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:09.332065 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-32ad79b2-c9b2-41b8-9363-1fcb9f7ebf2f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:09.332847 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-32ad79b2-c9b2-41b8-9363-1fcb9f7ebf2f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:09.333288 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-32ad79b2-c9b2-41b8-9363-1fcb9f7ebf2f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:09.362072 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-32ad79b2-c9b2-41b8-9363-1fcb9f7ebf2f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041926 May 24 15:28:09.362614 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 606/1226] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:09 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:09.520520 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-8b790d6e-7acd-493b-89b8-da3d2ef24405 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:09.521477 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-8b790d6e-7acd-493b-89b8-da3d2ef24405 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:09.528083 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8b790d6e-7acd-493b-89b8-da3d2ef24405 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:09.528568 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8b790d6e-7acd-493b-89b8-da3d2ef24405 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:09.529331 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8b790d6e-7acd-493b-89b8-da3d2ef24405 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:09.529765 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8b790d6e-7acd-493b-89b8-da3d2ef24405 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:09.558025 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-8b790d6e-7acd-493b-89b8-da3d2ef24405 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041978 May 24 15:28:09.558580 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 621/1227] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:09 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:09.670749 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-40c20ecd-1324-4873-aae9-12201f832d18 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:09.671670 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-40c20ecd-1324-4873-aae9-12201f832d18 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:09.678028 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-40c20ecd-1324-4873-aae9-12201f832d18 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:09.678472 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-40c20ecd-1324-4873-aae9-12201f832d18 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:09.679228 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-40c20ecd-1324-4873-aae9-12201f832d18 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:09.679656 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-40c20ecd-1324-4873-aae9-12201f832d18 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:09.709209 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-40c20ecd-1324-4873-aae9-12201f832d18 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042454 May 24 15:28:09.709769 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 607/1228] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:28:09 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:28:10.373101 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-dd5b3eb7-6452-4ad3-a002-95ad7594aaef tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:10.374057 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-dd5b3eb7-6452-4ad3-a002-95ad7594aaef tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:10.380765 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dd5b3eb7-6452-4ad3-a002-95ad7594aaef tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:10.381217 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dd5b3eb7-6452-4ad3-a002-95ad7594aaef tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:10.381973 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dd5b3eb7-6452-4ad3-a002-95ad7594aaef tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:10.382409 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dd5b3eb7-6452-4ad3-a002-95ad7594aaef tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:10.411001 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-dd5b3eb7-6452-4ad3-a002-95ad7594aaef tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041790 May 24 15:28:10.411536 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 622/1229] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:10 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:10.568598 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f5ff4034-326c-4756-bda0-568f144c2ff5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:10.569527 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f5ff4034-326c-4756-bda0-568f144c2ff5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:10.575574 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f5ff4034-326c-4756-bda0-568f144c2ff5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:10.576023 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f5ff4034-326c-4756-bda0-568f144c2ff5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:10.576817 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f5ff4034-326c-4756-bda0-568f144c2ff5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:10.577255 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f5ff4034-326c-4756-bda0-568f144c2ff5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:10.605198 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f5ff4034-326c-4756-bda0-568f144c2ff5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040572 May 24 15:28:10.605733 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 608/1230] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:10 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:10.720680 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d1df2b61-4978-4d4c-816f-0fb7deecd21b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:10.722076 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d1df2b61-4978-4d4c-816f-0fb7deecd21b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:10.728510 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d1df2b61-4978-4d4c-816f-0fb7deecd21b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:10.728957 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d1df2b61-4978-4d4c-816f-0fb7deecd21b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:10.729699 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d1df2b61-4978-4d4c-816f-0fb7deecd21b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:10.730126 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d1df2b61-4978-4d4c-816f-0fb7deecd21b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:10.758497 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d1df2b61-4978-4d4c-816f-0fb7deecd21b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041853 May 24 15:28:10.759033 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 623/1231] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:28:10 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:28:11.422454 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-60dbb220-320e-4786-9d25-0ce5062d9c14 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:11.423288 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-60dbb220-320e-4786-9d25-0ce5062d9c14 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:11.429899 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-60dbb220-320e-4786-9d25-0ce5062d9c14 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:11.430334 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-60dbb220-320e-4786-9d25-0ce5062d9c14 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:11.431082 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-60dbb220-320e-4786-9d25-0ce5062d9c14 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:11.431512 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-60dbb220-320e-4786-9d25-0ce5062d9c14 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:11.460074 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-60dbb220-320e-4786-9d25-0ce5062d9c14 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041695 May 24 15:28:11.460642 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 609/1232] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:11 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:11.616409 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-a34d64cd-51d3-4648-b504-6fc538571dde tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:11.617335 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-a34d64cd-51d3-4648-b504-6fc538571dde tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:11.623350 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a34d64cd-51d3-4648-b504-6fc538571dde tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:11.623803 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a34d64cd-51d3-4648-b504-6fc538571dde tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:11.624593 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a34d64cd-51d3-4648-b504-6fc538571dde tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:11.625027 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a34d64cd-51d3-4648-b504-6fc538571dde tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:11.653192 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-a34d64cd-51d3-4648-b504-6fc538571dde tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041258 May 24 15:28:11.653730 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 624/1233] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:11 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:11.769617 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-3178e113-63f2-4b5d-8ef4-db1b870e1e4d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:11.770575 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-3178e113-63f2-4b5d-8ef4-db1b870e1e4d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:11.776603 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3178e113-63f2-4b5d-8ef4-db1b870e1e4d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:11.777052 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3178e113-63f2-4b5d-8ef4-db1b870e1e4d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:11.777810 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3178e113-63f2-4b5d-8ef4-db1b870e1e4d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:11.778246 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3178e113-63f2-4b5d-8ef4-db1b870e1e4d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:11.782651 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:28:11.808152 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-3178e113-63f2-4b5d-8ef4-db1b870e1e4d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042558 May 24 15:28:11.808734 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 610/1234] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:28:11 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:28:12.472067 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-f1f3af66-1e0c-4af0-9599-55f6f998dc13 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:12.473036 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-f1f3af66-1e0c-4af0-9599-55f6f998dc13 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:12.479537 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f1f3af66-1e0c-4af0-9599-55f6f998dc13 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:12.480015 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f1f3af66-1e0c-4af0-9599-55f6f998dc13 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:12.480809 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f1f3af66-1e0c-4af0-9599-55f6f998dc13 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:12.481247 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f1f3af66-1e0c-4af0-9599-55f6f998dc13 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:12.510035 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-f1f3af66-1e0c-4af0-9599-55f6f998dc13 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042546 May 24 15:28:12.510575 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 625/1235] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:12 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:12.665380 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-b6e4ce87-f522-4931-b3a8-96cafd7e4ef4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:12.666298 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-b6e4ce87-f522-4931-b3a8-96cafd7e4ef4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:12.672870 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b6e4ce87-f522-4931-b3a8-96cafd7e4ef4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:12.673309 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b6e4ce87-f522-4931-b3a8-96cafd7e4ef4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:12.674065 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b6e4ce87-f522-4931-b3a8-96cafd7e4ef4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:12.674568 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b6e4ce87-f522-4931-b3a8-96cafd7e4ef4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:12.702038 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-b6e4ce87-f522-4931-b3a8-96cafd7e4ef4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040642 May 24 15:28:12.702597 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 611/1236] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:12 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:12.819495 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-897e56fe-e9d2-47a7-8cb0-85cd14756047 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:12.820466 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-897e56fe-e9d2-47a7-8cb0-85cd14756047 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:12.826452 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-897e56fe-e9d2-47a7-8cb0-85cd14756047 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:12.826899 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-897e56fe-e9d2-47a7-8cb0-85cd14756047 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:12.827654 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-897e56fe-e9d2-47a7-8cb0-85cd14756047 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:12.828083 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-897e56fe-e9d2-47a7-8cb0-85cd14756047 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:12.856669 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-897e56fe-e9d2-47a7-8cb0-85cd14756047 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041116 May 24 15:28:12.857199 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 626/1237] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:28:12 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:28:13.521972 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-427c6cdc-2449-4445-8dea-e48c7100ba09 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:13.522945 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-427c6cdc-2449-4445-8dea-e48c7100ba09 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:13.528966 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-427c6cdc-2449-4445-8dea-e48c7100ba09 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:13.529412 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-427c6cdc-2449-4445-8dea-e48c7100ba09 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:13.530160 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-427c6cdc-2449-4445-8dea-e48c7100ba09 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:13.530587 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-427c6cdc-2449-4445-8dea-e48c7100ba09 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:13.559216 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-427c6cdc-2449-4445-8dea-e48c7100ba09 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041751 May 24 15:28:13.559781 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 612/1238] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:13 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:13.714128 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-b02991f3-04f8-4ae4-8ba3-a9fd0d9d073b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:13.715046 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-b02991f3-04f8-4ae4-8ba3-a9fd0d9d073b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:13.721540 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b02991f3-04f8-4ae4-8ba3-a9fd0d9d073b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:13.722021 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b02991f3-04f8-4ae4-8ba3-a9fd0d9d073b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:13.722778 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b02991f3-04f8-4ae4-8ba3-a9fd0d9d073b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:13.723208 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b02991f3-04f8-4ae4-8ba3-a9fd0d9d073b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:13.725545 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:28:13.753882 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-b02991f3-04f8-4ae4-8ba3-a9fd0d9d073b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043712 May 24 15:28:13.754428 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 627/1239] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:13 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:13.868970 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-2e8f7863-4c43-435e-adb2-e4b2be733203 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:13.869880 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-2e8f7863-4c43-435e-adb2-e4b2be733203 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:13.876378 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2e8f7863-4c43-435e-adb2-e4b2be733203 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:13.876819 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2e8f7863-4c43-435e-adb2-e4b2be733203 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:13.877597 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2e8f7863-4c43-435e-adb2-e4b2be733203 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:13.878023 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2e8f7863-4c43-435e-adb2-e4b2be733203 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:13.906921 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-2e8f7863-4c43-435e-adb2-e4b2be733203 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041880 May 24 15:28:13.907475 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 613/1240] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:28:13 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:28:14.571260 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e79b521a-63e4-4864-8cb4-43252c3e9f7d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:14.572168 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e79b521a-63e4-4864-8cb4-43252c3e9f7d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:14.578377 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e79b521a-63e4-4864-8cb4-43252c3e9f7d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:14.578826 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e79b521a-63e4-4864-8cb4-43252c3e9f7d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:14.579572 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e79b521a-63e4-4864-8cb4-43252c3e9f7d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:14.579998 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e79b521a-63e4-4864-8cb4-43252c3e9f7d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:14.608279 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e79b521a-63e4-4864-8cb4-43252c3e9f7d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040704 May 24 15:28:14.608785 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 628/1241] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:14 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:14.765336 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-c2a1b21f-c3d0-4be0-8a38-8aaf09166d13 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:14.766261 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-c2a1b21f-c3d0-4be0-8a38-8aaf09166d13 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:14.772941 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c2a1b21f-c3d0-4be0-8a38-8aaf09166d13 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:14.773387 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c2a1b21f-c3d0-4be0-8a38-8aaf09166d13 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:14.774143 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c2a1b21f-c3d0-4be0-8a38-8aaf09166d13 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:14.774574 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c2a1b21f-c3d0-4be0-8a38-8aaf09166d13 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:14.802111 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-c2a1b21f-c3d0-4be0-8a38-8aaf09166d13 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040688 May 24 15:28:14.802648 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 614/1242] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:14 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:14.918985 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-071e233e-4dff-414c-b5f5-958a6be193f3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:14.919891 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-071e233e-4dff-414c-b5f5-958a6be193f3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:14.926773 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-071e233e-4dff-414c-b5f5-958a6be193f3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:14.927210 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-071e233e-4dff-414c-b5f5-958a6be193f3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:14.927953 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-071e233e-4dff-414c-b5f5-958a6be193f3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:14.928451 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-071e233e-4dff-414c-b5f5-958a6be193f3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:14.956587 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-071e233e-4dff-414c-b5f5-958a6be193f3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041587 May 24 15:28:14.957124 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 629/1243] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:28:14 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:28:15.620324 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a1bac34f-b30b-4dcf-ab26-d0426c36e289 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:15.621257 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a1bac34f-b30b-4dcf-ab26-d0426c36e289 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:15.627810 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a1bac34f-b30b-4dcf-ab26-d0426c36e289 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:15.628257 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a1bac34f-b30b-4dcf-ab26-d0426c36e289 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:15.629049 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a1bac34f-b30b-4dcf-ab26-d0426c36e289 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:15.629484 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a1bac34f-b30b-4dcf-ab26-d0426c36e289 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:15.657865 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a1bac34f-b30b-4dcf-ab26-d0426c36e289 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041528 May 24 15:28:15.658450 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 615/1244] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:15 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:15.813518 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-780b1da7-732d-4c06-a937-7855352da9af tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:15.814387 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-780b1da7-732d-4c06-a937-7855352da9af tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:15.821105 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-780b1da7-732d-4c06-a937-7855352da9af tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:15.821547 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-780b1da7-732d-4c06-a937-7855352da9af tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:15.822304 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-780b1da7-732d-4c06-a937-7855352da9af tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:15.822731 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-780b1da7-732d-4c06-a937-7855352da9af tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:15.850031 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-780b1da7-732d-4c06-a937-7855352da9af tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040527 May 24 15:28:15.850574 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 630/1245] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:15 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:15.966948 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-eedbd247-84e6-4b30-95de-14f6fa04ba7d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:15.967874 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-eedbd247-84e6-4b30-95de-14f6fa04ba7d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:15.974356 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-eedbd247-84e6-4b30-95de-14f6fa04ba7d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:15.974804 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-eedbd247-84e6-4b30-95de-14f6fa04ba7d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:15.975564 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-eedbd247-84e6-4b30-95de-14f6fa04ba7d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:15.976000 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-eedbd247-84e6-4b30-95de-14f6fa04ba7d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:16.004965 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-eedbd247-84e6-4b30-95de-14f6fa04ba7d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041978 May 24 15:28:16.005505 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 616/1246] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:28:15 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:28:16.669868 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-3dd0b83d-38d9-47d1-8936-c838cbd34e1f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:16.670745 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-3dd0b83d-38d9-47d1-8936-c838cbd34e1f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:16.677753 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3dd0b83d-38d9-47d1-8936-c838cbd34e1f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:16.678215 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3dd0b83d-38d9-47d1-8936-c838cbd34e1f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:16.678963 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3dd0b83d-38d9-47d1-8936-c838cbd34e1f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:16.679388 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3dd0b83d-38d9-47d1-8936-c838cbd34e1f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:16.707913 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-3dd0b83d-38d9-47d1-8936-c838cbd34e1f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041994 May 24 15:28:16.708585 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 631/1247] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:16 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:16.862240 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-6931c1c3-bbdf-4974-b0d0-5e0d26403f23 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:16.863842 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-6931c1c3-bbdf-4974-b0d0-5e0d26403f23 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:16.870023 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6931c1c3-bbdf-4974-b0d0-5e0d26403f23 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:16.870466 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6931c1c3-bbdf-4974-b0d0-5e0d26403f23 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:16.871215 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6931c1c3-bbdf-4974-b0d0-5e0d26403f23 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:16.871642 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6931c1c3-bbdf-4974-b0d0-5e0d26403f23 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:16.898893 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-6931c1c3-bbdf-4974-b0d0-5e0d26403f23 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040950 May 24 15:28:16.899433 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 617/1248] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:16 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:17.016363 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-5f8295fb-01ba-4ebc-a8ce-4116d04de47c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:17.017304 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-5f8295fb-01ba-4ebc-a8ce-4116d04de47c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:17.023402 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5f8295fb-01ba-4ebc-a8ce-4116d04de47c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:17.024450 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5f8295fb-01ba-4ebc-a8ce-4116d04de47c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:17.024688 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5f8295fb-01ba-4ebc-a8ce-4116d04de47c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:17.025121 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5f8295fb-01ba-4ebc-a8ce-4116d04de47c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:17.054019 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-5f8295fb-01ba-4ebc-a8ce-4116d04de47c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041661 May 24 15:28:17.054562 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 632/1249] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:28:17 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 15:28:17.719126 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a03f4e26-d359-461f-b956-d0bdfab2a328 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:17.720052 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a03f4e26-d359-461f-b956-d0bdfab2a328 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:17.726627 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a03f4e26-d359-461f-b956-d0bdfab2a328 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:17.727077 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a03f4e26-d359-461f-b956-d0bdfab2a328 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:17.727832 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a03f4e26-d359-461f-b956-d0bdfab2a328 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:17.728266 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a03f4e26-d359-461f-b956-d0bdfab2a328 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:17.756913 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a03f4e26-d359-461f-b956-d0bdfab2a328 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041771 May 24 15:28:17.757452 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 618/1250] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:17 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:17.910912 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-1d821bf8-d5d5-49ad-9c51-671996073d80 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:17.911832 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-1d821bf8-d5d5-49ad-9c51-671996073d80 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:17.918288 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1d821bf8-d5d5-49ad-9c51-671996073d80 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:17.918725 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1d821bf8-d5d5-49ad-9c51-671996073d80 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:17.919468 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1d821bf8-d5d5-49ad-9c51-671996073d80 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:17.919892 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1d821bf8-d5d5-49ad-9c51-671996073d80 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:17.947383 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-1d821bf8-d5d5-49ad-9c51-671996073d80 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040963 May 24 15:28:17.947944 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 633/1251] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:17 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:18.065461 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-b0ae9003-bfdf-4af8-8fd5-55c730a5e241 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:18.066425 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-b0ae9003-bfdf-4af8-8fd5-55c730a5e241 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:18.072999 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b0ae9003-bfdf-4af8-8fd5-55c730a5e241 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:18.073454 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b0ae9003-bfdf-4af8-8fd5-55c730a5e241 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:18.074228 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b0ae9003-bfdf-4af8-8fd5-55c730a5e241 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:18.074666 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b0ae9003-bfdf-4af8-8fd5-55c730a5e241 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:18.104367 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-b0ae9003-bfdf-4af8-8fd5-55c730a5e241 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042849 May 24 15:28:18.104921 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 619/1252] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:28:18 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 15:28:18.768744 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e3510f08-14be-436d-8de8-6b1cee4143ab tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:18.769717 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e3510f08-14be-436d-8de8-6b1cee4143ab tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:18.775707 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e3510f08-14be-436d-8de8-6b1cee4143ab tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:18.776148 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e3510f08-14be-436d-8de8-6b1cee4143ab tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:18.776932 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e3510f08-14be-436d-8de8-6b1cee4143ab tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:18.777355 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e3510f08-14be-436d-8de8-6b1cee4143ab tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:18.805335 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e3510f08-14be-436d-8de8-6b1cee4143ab tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040627 May 24 15:28:18.805866 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 634/1253] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:18 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:18.959034 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-7601be4c-6547-4e51-89f8-50cea050bac0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:18.959906 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-7601be4c-6547-4e51-89f8-50cea050bac0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:18.965971 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7601be4c-6547-4e51-89f8-50cea050bac0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:18.966411 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7601be4c-6547-4e51-89f8-50cea050bac0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:18.967161 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7601be4c-6547-4e51-89f8-50cea050bac0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:18.967589 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7601be4c-6547-4e51-89f8-50cea050bac0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:18.996723 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-7601be4c-6547-4e51-89f8-50cea050bac0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041689 May 24 15:28:18.997265 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 620/1254] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:18 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:19.116879 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-939cef6f-ac86-41ac-928d-d7e8d236c2c7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:19.117807 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-939cef6f-ac86-41ac-928d-d7e8d236c2c7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:19.124244 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-939cef6f-ac86-41ac-928d-d7e8d236c2c7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:19.124723 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-939cef6f-ac86-41ac-928d-d7e8d236c2c7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:19.125478 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-939cef6f-ac86-41ac-928d-d7e8d236c2c7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:19.125906 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-939cef6f-ac86-41ac-928d-d7e8d236c2c7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:19.153644 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-939cef6f-ac86-41ac-928d-d7e8d236c2c7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041408 May 24 15:28:19.154183 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 635/1255] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:28:19 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:28:19.816755 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-5a585a9e-1bbf-4888-99be-0472c408f1c2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:19.817686 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-5a585a9e-1bbf-4888-99be-0472c408f1c2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:19.824195 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5a585a9e-1bbf-4888-99be-0472c408f1c2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:19.824687 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5a585a9e-1bbf-4888-99be-0472c408f1c2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:19.825462 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5a585a9e-1bbf-4888-99be-0472c408f1c2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:19.825901 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5a585a9e-1bbf-4888-99be-0472c408f1c2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:19.868566 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-5a585a9e-1bbf-4888-99be-0472c408f1c2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055709 May 24 15:28:19.869107 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 621/1256] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:19 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:20.008319 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-3e4716aa-4bfa-4345-8508-02d3d4bcd81b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:20.009237 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-3e4716aa-4bfa-4345-8508-02d3d4bcd81b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:20.015255 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3e4716aa-4bfa-4345-8508-02d3d4bcd81b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:20.015696 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3e4716aa-4bfa-4345-8508-02d3d4bcd81b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:20.016478 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3e4716aa-4bfa-4345-8508-02d3d4bcd81b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:20.016905 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3e4716aa-4bfa-4345-8508-02d3d4bcd81b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:20.044550 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-3e4716aa-4bfa-4345-8508-02d3d4bcd81b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040331 May 24 15:28:20.045081 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 636/1257] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:20 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:20.166103 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-2c26c489-6a33-4808-a2ee-7d913866b554 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:20.167028 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-2c26c489-6a33-4808-a2ee-7d913866b554 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:20.173113 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2c26c489-6a33-4808-a2ee-7d913866b554 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:20.173557 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2c26c489-6a33-4808-a2ee-7d913866b554 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:20.174321 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2c26c489-6a33-4808-a2ee-7d913866b554 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:20.174750 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2c26c489-6a33-4808-a2ee-7d913866b554 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:20.202338 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-2c26c489-6a33-4808-a2ee-7d913866b554 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040381 May 24 15:28:20.202881 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 622/1258] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:28:20 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:28:20.880833 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-95910938-b7be-4598-9231-761b7b2fdcb7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:20.881690 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-95910938-b7be-4598-9231-761b7b2fdcb7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:20.887700 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-95910938-b7be-4598-9231-761b7b2fdcb7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:20.888145 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-95910938-b7be-4598-9231-761b7b2fdcb7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:20.888940 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-95910938-b7be-4598-9231-761b7b2fdcb7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:20.889380 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-95910938-b7be-4598-9231-761b7b2fdcb7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:20.918896 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-95910938-b7be-4598-9231-761b7b2fdcb7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042062 May 24 15:28:20.919542 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 637/1259] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:20 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:21.055445 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-0a0e7833-a058-4aaf-bf98-9a339e44c4a5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:21.056513 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-0a0e7833-a058-4aaf-bf98-9a339e44c4a5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:21.063002 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0a0e7833-a058-4aaf-bf98-9a339e44c4a5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:21.063439 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0a0e7833-a058-4aaf-bf98-9a339e44c4a5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:21.064190 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0a0e7833-a058-4aaf-bf98-9a339e44c4a5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:21.064648 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0a0e7833-a058-4aaf-bf98-9a339e44c4a5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:21.093073 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-0a0e7833-a058-4aaf-bf98-9a339e44c4a5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041549 May 24 15:28:21.093615 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 623/1260] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:21 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:28:21.215232 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-cd2d68ee-23d4-429b-aefa-cfe3ed49cccf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:21.216181 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-cd2d68ee-23d4-429b-aefa-cfe3ed49cccf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:21.223440 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cd2d68ee-23d4-429b-aefa-cfe3ed49cccf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:21.223871 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cd2d68ee-23d4-429b-aefa-cfe3ed49cccf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:21.224655 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cd2d68ee-23d4-429b-aefa-cfe3ed49cccf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:21.225082 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cd2d68ee-23d4-429b-aefa-cfe3ed49cccf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:21.253020 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-cd2d68ee-23d4-429b-aefa-cfe3ed49cccf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042983 May 24 15:28:21.253560 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 638/1261] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:28:21 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:28:21.930029 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-8a5e07b6-2870-46d8-a087-ddd6bb0deb3b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:21.930953 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-8a5e07b6-2870-46d8-a087-ddd6bb0deb3b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:21.936982 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8a5e07b6-2870-46d8-a087-ddd6bb0deb3b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:21.937438 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8a5e07b6-2870-46d8-a087-ddd6bb0deb3b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:21.938193 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8a5e07b6-2870-46d8-a087-ddd6bb0deb3b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:21.938627 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8a5e07b6-2870-46d8-a087-ddd6bb0deb3b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:21.967480 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-8a5e07b6-2870-46d8-a087-ddd6bb0deb3b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041453 May 24 15:28:21.968025 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 624/1262] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:21 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:22.104590 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-4269567f-b087-4781-a6ad-a89379bac0d7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:22.105531 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-4269567f-b087-4781-a6ad-a89379bac0d7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:22.111725 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4269567f-b087-4781-a6ad-a89379bac0d7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:22.112168 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4269567f-b087-4781-a6ad-a89379bac0d7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:22.112955 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4269567f-b087-4781-a6ad-a89379bac0d7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:22.113382 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4269567f-b087-4781-a6ad-a89379bac0d7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:22.141141 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-4269567f-b087-4781-a6ad-a89379bac0d7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040534 May 24 15:28:22.141679 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 639/1263] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:22 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:22.265158 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-adb2d7d1-8f2d-4553-94f8-e66a9946f4f3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:22.266078 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-adb2d7d1-8f2d-4553-94f8-e66a9946f4f3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:22.273149 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-adb2d7d1-8f2d-4553-94f8-e66a9946f4f3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:22.273593 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-adb2d7d1-8f2d-4553-94f8-e66a9946f4f3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:22.274349 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-adb2d7d1-8f2d-4553-94f8-e66a9946f4f3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:22.274781 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-adb2d7d1-8f2d-4553-94f8-e66a9946f4f3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:22.302527 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-adb2d7d1-8f2d-4553-94f8-e66a9946f4f3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041384 May 24 15:28:22.303060 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 625/1264] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:28:22 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:28:22.979439 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-2f7bd6ea-97cb-4c4c-8b4a-8fe26e0ce84f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:22.980464 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-2f7bd6ea-97cb-4c4c-8b4a-8fe26e0ce84f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:22.987217 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2f7bd6ea-97cb-4c4c-8b4a-8fe26e0ce84f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:22.987671 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2f7bd6ea-97cb-4c4c-8b4a-8fe26e0ce84f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:22.989062 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2f7bd6ea-97cb-4c4c-8b4a-8fe26e0ce84f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:22.989496 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2f7bd6ea-97cb-4c4c-8b4a-8fe26e0ce84f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:23.017714 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-2f7bd6ea-97cb-4c4c-8b4a-8fe26e0ce84f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042265 May 24 15:28:23.018254 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 640/1265] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:22 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:23.153146 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-48990375-9c50-43d6-a6bb-4a844eccb8f6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:23.154100 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-48990375-9c50-43d6-a6bb-4a844eccb8f6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:23.160189 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-48990375-9c50-43d6-a6bb-4a844eccb8f6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:23.160655 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-48990375-9c50-43d6-a6bb-4a844eccb8f6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:23.161403 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-48990375-9c50-43d6-a6bb-4a844eccb8f6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:23.161831 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-48990375-9c50-43d6-a6bb-4a844eccb8f6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:23.186631 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:28:23.192533 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-48990375-9c50-43d6-a6bb-4a844eccb8f6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043261 May 24 15:28:23.193097 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 626/1266] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:23 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:23.314087 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-5fd1d71d-4ede-4cfe-8a01-e125197738a3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:23.314999 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-5fd1d71d-4ede-4cfe-8a01-e125197738a3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:23.321620 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5fd1d71d-4ede-4cfe-8a01-e125197738a3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:23.322066 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5fd1d71d-4ede-4cfe-8a01-e125197738a3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:23.322821 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5fd1d71d-4ede-4cfe-8a01-e125197738a3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:23.323256 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5fd1d71d-4ede-4cfe-8a01-e125197738a3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:23.350920 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-5fd1d71d-4ede-4cfe-8a01-e125197738a3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040892 May 24 15:28:23.351460 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 641/1267] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:28:23 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:28:24.029968 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-dde7c189-c179-43d1-b69f-c2c4539facf8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:24.030898 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-dde7c189-c179-43d1-b69f-c2c4539facf8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:24.038279 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dde7c189-c179-43d1-b69f-c2c4539facf8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:24.038674 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dde7c189-c179-43d1-b69f-c2c4539facf8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:24.039434 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dde7c189-c179-43d1-b69f-c2c4539facf8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:24.039868 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dde7c189-c179-43d1-b69f-c2c4539facf8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:24.067943 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-dde7c189-c179-43d1-b69f-c2c4539facf8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041963 May 24 15:28:24.068525 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 627/1268] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:24 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:24.204164 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-70715574-3d19-465b-b6b2-46a5eb3e3308 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:24.205098 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-70715574-3d19-465b-b6b2-46a5eb3e3308 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:24.212016 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-70715574-3d19-465b-b6b2-46a5eb3e3308 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:24.212488 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-70715574-3d19-465b-b6b2-46a5eb3e3308 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:24.213238 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-70715574-3d19-465b-b6b2-46a5eb3e3308 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:24.213665 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-70715574-3d19-465b-b6b2-46a5eb3e3308 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:24.242486 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-70715574-3d19-465b-b6b2-46a5eb3e3308 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042309 May 24 15:28:24.243029 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 642/1269] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:24 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:24.362691 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-c6aec3f7-8dc1-4747-ac82-d0a682d1372a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:24.363654 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-c6aec3f7-8dc1-4747-ac82-d0a682d1372a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:24.369632 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c6aec3f7-8dc1-4747-ac82-d0a682d1372a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:24.370080 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c6aec3f7-8dc1-4747-ac82-d0a682d1372a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:24.370834 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c6aec3f7-8dc1-4747-ac82-d0a682d1372a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:24.371268 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c6aec3f7-8dc1-4747-ac82-d0a682d1372a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:24.400469 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-c6aec3f7-8dc1-4747-ac82-d0a682d1372a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042023 May 24 15:28:24.401019 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 628/1270] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:28:24 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:28:25.079165 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-86898a38-38a0-4e25-99d1-75b176c3de15 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:25.080124 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-86898a38-38a0-4e25-99d1-75b176c3de15 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:25.086821 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-86898a38-38a0-4e25-99d1-75b176c3de15 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:25.087274 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-86898a38-38a0-4e25-99d1-75b176c3de15 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:25.088041 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-86898a38-38a0-4e25-99d1-75b176c3de15 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:25.088512 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-86898a38-38a0-4e25-99d1-75b176c3de15 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:25.113343 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:28:25.118377 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-86898a38-38a0-4e25-99d1-75b176c3de15 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043268 May 24 15:28:25.118928 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 643/1271] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:25 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:25.254545 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-8154a82b-f7ba-44e4-b007-efcea45979d3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:25.255465 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-8154a82b-f7ba-44e4-b007-efcea45979d3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:25.261909 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8154a82b-f7ba-44e4-b007-efcea45979d3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:25.262348 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8154a82b-f7ba-44e4-b007-efcea45979d3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:25.263099 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8154a82b-f7ba-44e4-b007-efcea45979d3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:25.263532 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8154a82b-f7ba-44e4-b007-efcea45979d3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:25.291628 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-8154a82b-f7ba-44e4-b007-efcea45979d3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041631 May 24 15:28:25.292164 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 629/1272] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:25 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:25.410985 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-5c6bfa3e-6590-472f-a570-8821100bff48 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:25.411898 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-5c6bfa3e-6590-472f-a570-8821100bff48 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:25.418505 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5c6bfa3e-6590-472f-a570-8821100bff48 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:25.418949 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5c6bfa3e-6590-472f-a570-8821100bff48 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:25.419700 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5c6bfa3e-6590-472f-a570-8821100bff48 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:25.420131 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5c6bfa3e-6590-472f-a570-8821100bff48 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:25.448772 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-5c6bfa3e-6590-472f-a570-8821100bff48 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041735 May 24 15:28:25.449305 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 644/1273] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:28:25 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:28:26.129928 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-cf747eb6-8cd5-45e7-b48b-62e684c364b0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:26.130860 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-cf747eb6-8cd5-45e7-b48b-62e684c364b0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:26.136993 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cf747eb6-8cd5-45e7-b48b-62e684c364b0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:26.137439 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cf747eb6-8cd5-45e7-b48b-62e684c364b0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:26.138192 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cf747eb6-8cd5-45e7-b48b-62e684c364b0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:26.138629 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cf747eb6-8cd5-45e7-b48b-62e684c364b0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:26.167517 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-cf747eb6-8cd5-45e7-b48b-62e684c364b0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041542 May 24 15:28:26.168054 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 630/1274] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:26 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:26.303128 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-1b900475-ccd1-4ea8-8722-6ff9451f094e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:26.304063 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-1b900475-ccd1-4ea8-8722-6ff9451f094e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:26.310029 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1b900475-ccd1-4ea8-8722-6ff9451f094e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:26.310470 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1b900475-ccd1-4ea8-8722-6ff9451f094e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:26.311215 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1b900475-ccd1-4ea8-8722-6ff9451f094e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:26.311639 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1b900475-ccd1-4ea8-8722-6ff9451f094e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:26.339560 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-1b900475-ccd1-4ea8-8722-6ff9451f094e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040530 May 24 15:28:26.340027 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 645/1275] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:26 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:26.460666 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-03249608-0f15-4355-8842-bd99f8ae52be tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:26.461615 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-03249608-0f15-4355-8842-bd99f8ae52be tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:26.468035 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-03249608-0f15-4355-8842-bd99f8ae52be tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:26.468524 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-03249608-0f15-4355-8842-bd99f8ae52be tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:26.469280 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-03249608-0f15-4355-8842-bd99f8ae52be tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:26.469713 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-03249608-0f15-4355-8842-bd99f8ae52be tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:26.498435 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-03249608-0f15-4355-8842-bd99f8ae52be tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042225 May 24 15:28:26.498968 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 631/1276] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:28:26 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:28:27.179896 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-f11676e8-9973-48e5-8864-884df36b258c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:27.180844 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-f11676e8-9973-48e5-8864-884df36b258c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:27.187330 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f11676e8-9973-48e5-8864-884df36b258c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:27.187776 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f11676e8-9973-48e5-8864-884df36b258c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:27.188563 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f11676e8-9973-48e5-8864-884df36b258c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:27.188997 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f11676e8-9973-48e5-8864-884df36b258c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:27.218349 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-f11676e8-9973-48e5-8864-884df36b258c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043315 May 24 15:28:27.218895 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 646/1277] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:27 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:27.351388 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-6dd2023b-005e-4aa4-85b9-2b853858ffb2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:27.352244 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-6dd2023b-005e-4aa4-85b9-2b853858ffb2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:27.358491 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6dd2023b-005e-4aa4-85b9-2b853858ffb2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:27.358942 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6dd2023b-005e-4aa4-85b9-2b853858ffb2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:27.359694 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6dd2023b-005e-4aa4-85b9-2b853858ffb2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:27.360155 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6dd2023b-005e-4aa4-85b9-2b853858ffb2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:27.388230 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-6dd2023b-005e-4aa4-85b9-2b853858ffb2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041327 May 24 15:28:27.388805 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 632/1278] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:27 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:27.509806 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-824a55ae-6298-45fc-a661-b635996719fc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:27.510728 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-824a55ae-6298-45fc-a661-b635996719fc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:27.517091 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-824a55ae-6298-45fc-a661-b635996719fc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:27.517536 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-824a55ae-6298-45fc-a661-b635996719fc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:27.518293 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-824a55ae-6298-45fc-a661-b635996719fc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:27.518729 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-824a55ae-6298-45fc-a661-b635996719fc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:27.549998 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-824a55ae-6298-45fc-a661-b635996719fc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044100 May 24 15:28:27.550690 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 647/1279] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:28:27 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:28:28.229837 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-fb02573e-c45d-4bf8-abf2-2a33e24c9939 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:28.230795 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-fb02573e-c45d-4bf8-abf2-2a33e24c9939 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:28.237648 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fb02573e-c45d-4bf8-abf2-2a33e24c9939 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:28.238096 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fb02573e-c45d-4bf8-abf2-2a33e24c9939 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:28.238853 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fb02573e-c45d-4bf8-abf2-2a33e24c9939 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:28.239289 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fb02573e-c45d-4bf8-abf2-2a33e24c9939 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:28.267226 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-fb02573e-c45d-4bf8-abf2-2a33e24c9939 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041400 May 24 15:28:28.267769 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 633/1280] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:28 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:28.399003 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-17d1d082-57f3-4bae-bc27-17f99d0f3010 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:28.399951 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-17d1d082-57f3-4bae-bc27-17f99d0f3010 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:28.406419 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-17d1d082-57f3-4bae-bc27-17f99d0f3010 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:28.406856 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-17d1d082-57f3-4bae-bc27-17f99d0f3010 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:28.407605 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-17d1d082-57f3-4bae-bc27-17f99d0f3010 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:28.408031 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-17d1d082-57f3-4bae-bc27-17f99d0f3010 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:28.435987 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-17d1d082-57f3-4bae-bc27-17f99d0f3010 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040894 May 24 15:28:28.436563 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 648/1281] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:28 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:28.562001 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-af198a56-c179-449e-8c5f-c5fde7da8345 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:28.562924 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-af198a56-c179-449e-8c5f-c5fde7da8345 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:28.569558 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-af198a56-c179-449e-8c5f-c5fde7da8345 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:28.570004 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-af198a56-c179-449e-8c5f-c5fde7da8345 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:28.570759 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-af198a56-c179-449e-8c5f-c5fde7da8345 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:28.571192 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-af198a56-c179-449e-8c5f-c5fde7da8345 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:28.599146 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-af198a56-c179-449e-8c5f-c5fde7da8345 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041073 May 24 15:28:28.599627 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 634/1282] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:28:28 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:28:29.279138 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-bd20defd-e24d-480d-8e21-9c3207f1409d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:29.280054 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-bd20defd-e24d-480d-8e21-9c3207f1409d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:29.286178 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bd20defd-e24d-480d-8e21-9c3207f1409d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:29.286626 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bd20defd-e24d-480d-8e21-9c3207f1409d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:29.287382 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bd20defd-e24d-480d-8e21-9c3207f1409d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:29.287812 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bd20defd-e24d-480d-8e21-9c3207f1409d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:29.315855 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-bd20defd-e24d-480d-8e21-9c3207f1409d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040641 May 24 15:28:29.317139 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 649/1283] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:29 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:29.448418 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-7152aee7-c0ab-4230-a831-31146329e089 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:29.449270 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-7152aee7-c0ab-4230-a831-31146329e089 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:29.451549 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_api:SELECT=88 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:28:29.456874 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7152aee7-c0ab-4230-a831-31146329e089 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:29.457306 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7152aee7-c0ab-4230-a831-31146329e089 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:29.458071 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7152aee7-c0ab-4230-a831-31146329e089 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:29.458506 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7152aee7-c0ab-4230-a831-31146329e089 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:29.486902 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-7152aee7-c0ab-4230-a831-31146329e089 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042653 May 24 15:28:29.487448 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 635/1284] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:29 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:29.610319 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-cba0caf7-88df-4851-84ef-eb905f8128d6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:29.611231 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-cba0caf7-88df-4851-84ef-eb905f8128d6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:29.618417 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cba0caf7-88df-4851-84ef-eb905f8128d6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:29.618859 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cba0caf7-88df-4851-84ef-eb905f8128d6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:29.619611 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cba0caf7-88df-4851-84ef-eb905f8128d6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:29.620040 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cba0caf7-88df-4851-84ef-eb905f8128d6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:29.647425 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-cba0caf7-88df-4851-84ef-eb905f8128d6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041350 May 24 15:28:29.647961 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 650/1285] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:28:29 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:28:30.085679 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 15:28:30.085936 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Tue May 24 15:28:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 15:28:30.327279 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-eb8b5469-9aff-4f45-9e71-fa84d63fbbc0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:30.328129 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-eb8b5469-9aff-4f45-9e71-fa84d63fbbc0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:30.334240 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-eb8b5469-9aff-4f45-9e71-fa84d63fbbc0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:30.335315 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-eb8b5469-9aff-4f45-9e71-fa84d63fbbc0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:30.336069 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-eb8b5469-9aff-4f45-9e71-fa84d63fbbc0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:30.336529 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-eb8b5469-9aff-4f45-9e71-fa84d63fbbc0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:30.365248 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-eb8b5469-9aff-4f45-9e71-fa84d63fbbc0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042061 May 24 15:28:30.365833 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 636/1286] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:30 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:30.498889 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-92be465d-2512-4d4f-b4e2-8f22489c3812 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:30.499810 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-92be465d-2512-4d4f-b4e2-8f22489c3812 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:30.505890 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-92be465d-2512-4d4f-b4e2-8f22489c3812 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:30.506839 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-92be465d-2512-4d4f-b4e2-8f22489c3812 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:30.507593 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-92be465d-2512-4d4f-b4e2-8f22489c3812 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:30.508026 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-92be465d-2512-4d4f-b4e2-8f22489c3812 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:30.535932 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-92be465d-2512-4d4f-b4e2-8f22489c3812 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041039 May 24 15:28:30.536827 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 651/1287] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:30 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:30.658911 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f437d78e-4bad-498e-8675-d9e5f9263f0d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:30.659863 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f437d78e-4bad-498e-8675-d9e5f9263f0d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:30.666295 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f437d78e-4bad-498e-8675-d9e5f9263f0d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:30.666744 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f437d78e-4bad-498e-8675-d9e5f9263f0d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:30.667497 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f437d78e-4bad-498e-8675-d9e5f9263f0d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:30.667933 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f437d78e-4bad-498e-8675-d9e5f9263f0d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:30.696838 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f437d78e-4bad-498e-8675-d9e5f9263f0d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041960 May 24 15:28:30.697378 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 637/1288] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:28:30 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:28:31.376999 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-03f75fd5-3dc7-4435-8391-f84cbbb1e7cf tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:31.377844 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-03f75fd5-3dc7-4435-8391-f84cbbb1e7cf tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:31.384443 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-03f75fd5-3dc7-4435-8391-f84cbbb1e7cf tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:31.384894 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-03f75fd5-3dc7-4435-8391-f84cbbb1e7cf tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:31.385649 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-03f75fd5-3dc7-4435-8391-f84cbbb1e7cf tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:31.386082 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-03f75fd5-3dc7-4435-8391-f84cbbb1e7cf tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:31.415221 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-03f75fd5-3dc7-4435-8391-f84cbbb1e7cf tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042266 May 24 15:28:31.415757 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 652/1289] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:31 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:31.547206 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e41322ea-7ad7-452b-acdf-a3e4e720ed13 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:31.548168 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-e41322ea-7ad7-452b-acdf-a3e4e720ed13 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:31.554128 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e41322ea-7ad7-452b-acdf-a3e4e720ed13 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:31.554571 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e41322ea-7ad7-452b-acdf-a3e4e720ed13 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:31.555316 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e41322ea-7ad7-452b-acdf-a3e4e720ed13 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:31.555743 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e41322ea-7ad7-452b-acdf-a3e4e720ed13 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:31.583103 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-e41322ea-7ad7-452b-acdf-a3e4e720ed13 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039763 May 24 15:28:31.583978 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 638/1290] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:31 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:31.708393 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-8705b7a7-aabf-4aaf-8b9c-01ac56f66edc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:31.710033 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-8705b7a7-aabf-4aaf-8b9c-01ac56f66edc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:31.716534 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8705b7a7-aabf-4aaf-8b9c-01ac56f66edc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:31.716983 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8705b7a7-aabf-4aaf-8b9c-01ac56f66edc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:31.717742 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8705b7a7-aabf-4aaf-8b9c-01ac56f66edc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:31.718171 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8705b7a7-aabf-4aaf-8b9c-01ac56f66edc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:31.746253 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-8705b7a7-aabf-4aaf-8b9c-01ac56f66edc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041844 May 24 15:28:31.746791 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 653/1291] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:28:31 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:28:32.426029 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-dd1399d0-6251-421d-a78b-ba56df9c4c30 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:32.426875 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-dd1399d0-6251-421d-a78b-ba56df9c4c30 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:32.433377 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dd1399d0-6251-421d-a78b-ba56df9c4c30 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:32.433820 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dd1399d0-6251-421d-a78b-ba56df9c4c30 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:32.434564 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dd1399d0-6251-421d-a78b-ba56df9c4c30 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:32.434991 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dd1399d0-6251-421d-a78b-ba56df9c4c30 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:32.463907 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-dd1399d0-6251-421d-a78b-ba56df9c4c30 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041945 May 24 15:28:32.464468 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 639/1292] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:32 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:32.595090 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-ab6abfed-8470-40d0-bb12-4a3298a65e60 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:32.596041 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-ab6abfed-8470-40d0-bb12-4a3298a65e60 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:32.602505 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ab6abfed-8470-40d0-bb12-4a3298a65e60 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:32.602951 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ab6abfed-8470-40d0-bb12-4a3298a65e60 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:32.603707 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ab6abfed-8470-40d0-bb12-4a3298a65e60 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:32.604142 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ab6abfed-8470-40d0-bb12-4a3298a65e60 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:32.632363 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-ab6abfed-8470-40d0-bb12-4a3298a65e60 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041200 May 24 15:28:32.633420 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 654/1293] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:32 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:32.758413 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-22b2b04b-5d8d-4e48-85c9-d55e72ccf907 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:32.759342 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-22b2b04b-5d8d-4e48-85c9-d55e72ccf907 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:32.765356 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-22b2b04b-5d8d-4e48-85c9-d55e72ccf907 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:32.765799 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-22b2b04b-5d8d-4e48-85c9-d55e72ccf907 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:32.766556 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-22b2b04b-5d8d-4e48-85c9-d55e72ccf907 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:32.766990 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-22b2b04b-5d8d-4e48-85c9-d55e72ccf907 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:32.795667 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-22b2b04b-5d8d-4e48-85c9-d55e72ccf907 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041770 May 24 15:28:32.796218 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 640/1294] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:28:32 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:28:33.475005 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-893354c3-a6f0-4c8b-ba77-63c0bb5a0009 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:33.475923 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-893354c3-a6f0-4c8b-ba77-63c0bb5a0009 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:33.482402 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-893354c3-a6f0-4c8b-ba77-63c0bb5a0009 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:33.482847 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-893354c3-a6f0-4c8b-ba77-63c0bb5a0009 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:33.483860 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-893354c3-a6f0-4c8b-ba77-63c0bb5a0009 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:33.484289 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-893354c3-a6f0-4c8b-ba77-63c0bb5a0009 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:33.513247 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-893354c3-a6f0-4c8b-ba77-63c0bb5a0009 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042171 May 24 15:28:33.513777 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 655/1295] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:33 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:33.643917 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-98c170da-3042-4797-8bf1-95461472dc74 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:33.644871 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-98c170da-3042-4797-8bf1-95461472dc74 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:33.651798 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-98c170da-3042-4797-8bf1-95461472dc74 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:33.652245 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-98c170da-3042-4797-8bf1-95461472dc74 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:33.653030 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-98c170da-3042-4797-8bf1-95461472dc74 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:33.653467 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-98c170da-3042-4797-8bf1-95461472dc74 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:33.682155 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-98c170da-3042-4797-8bf1-95461472dc74 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042145 May 24 15:28:33.682711 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 641/1296] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:33 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:33.807010 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-dbac4a43-04d1-4ef4-99a5-c68a77190c5b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:33.807913 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-dbac4a43-04d1-4ef4-99a5-c68a77190c5b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:33.814280 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dbac4a43-04d1-4ef4-99a5-c68a77190c5b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:33.814729 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dbac4a43-04d1-4ef4-99a5-c68a77190c5b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:33.815471 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dbac4a43-04d1-4ef4-99a5-c68a77190c5b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:33.815898 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dbac4a43-04d1-4ef4-99a5-c68a77190c5b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:33.844039 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-dbac4a43-04d1-4ef4-99a5-c68a77190c5b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040970 May 24 15:28:33.844609 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 656/1297] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:28:33 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:28:34.524848 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-03bff74d-59c0-4db9-b221-2d9ce457a864 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:34.525798 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-03bff74d-59c0-4db9-b221-2d9ce457a864 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:34.531860 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-03bff74d-59c0-4db9-b221-2d9ce457a864 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:34.532322 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-03bff74d-59c0-4db9-b221-2d9ce457a864 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:34.533090 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-03bff74d-59c0-4db9-b221-2d9ce457a864 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:34.533521 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-03bff74d-59c0-4db9-b221-2d9ce457a864 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:34.562498 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-03bff74d-59c0-4db9-b221-2d9ce457a864 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041595 May 24 15:28:34.563051 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 642/1298] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:34 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:34.693628 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-677998aa-1673-4805-9b62-cf4a8eca369d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:34.694542 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-677998aa-1673-4805-9b62-cf4a8eca369d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:34.700541 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-677998aa-1673-4805-9b62-cf4a8eca369d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:34.700983 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-677998aa-1673-4805-9b62-cf4a8eca369d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:34.701725 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-677998aa-1673-4805-9b62-cf4a8eca369d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:34.702149 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-677998aa-1673-4805-9b62-cf4a8eca369d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:34.730149 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-677998aa-1673-4805-9b62-cf4a8eca369d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040433 May 24 15:28:34.730648 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 657/1299] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:34 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:34.857010 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-1dfb3de3-c85a-40f5-83bb-085ac3e59af1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:34.857936 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-1dfb3de3-c85a-40f5-83bb-085ac3e59af1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:34.864838 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1dfb3de3-c85a-40f5-83bb-085ac3e59af1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:34.865280 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1dfb3de3-c85a-40f5-83bb-085ac3e59af1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:34.866036 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1dfb3de3-c85a-40f5-83bb-085ac3e59af1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:34.866464 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1dfb3de3-c85a-40f5-83bb-085ac3e59af1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:34.883232 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:28:34.896115 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-1dfb3de3-c85a-40f5-83bb-085ac3e59af1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045060 May 24 15:28:34.896703 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 643/1300] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:28:34 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:28:35.574559 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-1778e101-e60a-4021-ae4a-43913a50b060 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:35.575500 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-1778e101-e60a-4021-ae4a-43913a50b060 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:35.581957 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1778e101-e60a-4021-ae4a-43913a50b060 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:35.582402 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1778e101-e60a-4021-ae4a-43913a50b060 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:35.583159 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1778e101-e60a-4021-ae4a-43913a50b060 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:35.583593 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1778e101-e60a-4021-ae4a-43913a50b060 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:35.612028 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-1778e101-e60a-4021-ae4a-43913a50b060 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041994 May 24 15:28:35.612593 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 658/1301] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:35 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:35.741689 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-1f65201c-bc8a-4760-a1e8-1f5e342142d1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:35.742648 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-1f65201c-bc8a-4760-a1e8-1f5e342142d1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:35.748765 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1f65201c-bc8a-4760-a1e8-1f5e342142d1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:35.749212 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1f65201c-bc8a-4760-a1e8-1f5e342142d1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:35.749976 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1f65201c-bc8a-4760-a1e8-1f5e342142d1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:35.750413 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1f65201c-bc8a-4760-a1e8-1f5e342142d1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:35.779431 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-1f65201c-bc8a-4760-a1e8-1f5e342142d1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041631 May 24 15:28:35.779989 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 644/1302] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:35 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:35.906951 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-942bc93b-36c6-4f8c-ba3d-7951519c6bad tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:35.907895 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-942bc93b-36c6-4f8c-ba3d-7951519c6bad tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:35.913840 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-942bc93b-36c6-4f8c-ba3d-7951519c6bad tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:35.914287 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-942bc93b-36c6-4f8c-ba3d-7951519c6bad tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:35.915040 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-942bc93b-36c6-4f8c-ba3d-7951519c6bad tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:35.915471 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-942bc93b-36c6-4f8c-ba3d-7951519c6bad tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:35.943614 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-942bc93b-36c6-4f8c-ba3d-7951519c6bad tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040637 May 24 15:28:35.944147 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 659/1303] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:28:35 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:28:36.623484 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-6ee47851-856a-46b6-9f8f-a2c76a32279c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:36.624418 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-6ee47851-856a-46b6-9f8f-a2c76a32279c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:36.631079 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6ee47851-856a-46b6-9f8f-a2c76a32279c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:36.631521 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6ee47851-856a-46b6-9f8f-a2c76a32279c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:36.632294 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6ee47851-856a-46b6-9f8f-a2c76a32279c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:36.632743 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6ee47851-856a-46b6-9f8f-a2c76a32279c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:36.660994 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-6ee47851-856a-46b6-9f8f-a2c76a32279c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041501 May 24 15:28:36.661528 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 645/1304] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:36 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:28:36.791074 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-28f9c882-9abc-4d5d-979d-bf617b7535db tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:36.791993 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-28f9c882-9abc-4d5d-979d-bf617b7535db tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:36.798585 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-28f9c882-9abc-4d5d-979d-bf617b7535db tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:36.799030 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-28f9c882-9abc-4d5d-979d-bf617b7535db tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:36.799781 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-28f9c882-9abc-4d5d-979d-bf617b7535db tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:36.800215 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-28f9c882-9abc-4d5d-979d-bf617b7535db tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:36.813631 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:28:36.833201 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-28f9c882-9abc-4d5d-979d-bf617b7535db tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046670 May 24 15:28:36.833761 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 660/1305] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:36 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:36.956083 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-af40ed7d-4ba0-4fd4-8563-29e9b8fd5620 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:36.957048 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-af40ed7d-4ba0-4fd4-8563-29e9b8fd5620 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:36.963721 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-af40ed7d-4ba0-4fd4-8563-29e9b8fd5620 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:36.964164 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-af40ed7d-4ba0-4fd4-8563-29e9b8fd5620 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:36.964942 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-af40ed7d-4ba0-4fd4-8563-29e9b8fd5620 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:36.965374 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-af40ed7d-4ba0-4fd4-8563-29e9b8fd5620 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:36.993209 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-af40ed7d-4ba0-4fd4-8563-29e9b8fd5620 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041171 May 24 15:28:36.993753 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 646/1306] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:28:36 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:28:37.673177 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-aa8b0610-d2e0-41a6-9ce1-da4681bc94c1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:37.674242 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-aa8b0610-d2e0-41a6-9ce1-da4681bc94c1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:37.680979 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-aa8b0610-d2e0-41a6-9ce1-da4681bc94c1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:37.681431 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-aa8b0610-d2e0-41a6-9ce1-da4681bc94c1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:37.682194 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-aa8b0610-d2e0-41a6-9ce1-da4681bc94c1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:37.682633 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-aa8b0610-d2e0-41a6-9ce1-da4681bc94c1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:37.710615 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-aa8b0610-d2e0-41a6-9ce1-da4681bc94c1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041472 May 24 15:28:37.711156 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 661/1307] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:37 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:37.845659 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-faebcf45-6a68-4714-a4e5-1c3f53e1ee36 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:37.846576 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-faebcf45-6a68-4714-a4e5-1c3f53e1ee36 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:37.853063 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-faebcf45-6a68-4714-a4e5-1c3f53e1ee36 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:37.853505 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-faebcf45-6a68-4714-a4e5-1c3f53e1ee36 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:37.854253 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-faebcf45-6a68-4714-a4e5-1c3f53e1ee36 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:37.854679 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-faebcf45-6a68-4714-a4e5-1c3f53e1ee36 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:37.883686 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-faebcf45-6a68-4714-a4e5-1c3f53e1ee36 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042123 May 24 15:28:37.884268 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 647/1308] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:37 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:38.004624 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-58b0d8b8-7695-4991-9244-ae6801bc53ce tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:38.005546 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-58b0d8b8-7695-4991-9244-ae6801bc53ce tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:38.012037 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-58b0d8b8-7695-4991-9244-ae6801bc53ce tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:38.012530 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-58b0d8b8-7695-4991-9244-ae6801bc53ce tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:38.013296 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-58b0d8b8-7695-4991-9244-ae6801bc53ce tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:38.013729 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-58b0d8b8-7695-4991-9244-ae6801bc53ce tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:38.042782 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-58b0d8b8-7695-4991-9244-ae6801bc53ce tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042162 May 24 15:28:38.043324 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 662/1309] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:28:37 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:28:38.722010 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-0e56c73f-42a9-461f-8c5f-340fc70faa04 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:38.722952 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-0e56c73f-42a9-461f-8c5f-340fc70faa04 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:38.729130 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0e56c73f-42a9-461f-8c5f-340fc70faa04 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:38.729580 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0e56c73f-42a9-461f-8c5f-340fc70faa04 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:38.730340 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0e56c73f-42a9-461f-8c5f-340fc70faa04 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:38.730775 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0e56c73f-42a9-461f-8c5f-340fc70faa04 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:38.760013 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-0e56c73f-42a9-461f-8c5f-340fc70faa04 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041974 May 24 15:28:38.760585 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 648/1310] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:38 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:38.894840 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-6094d0ff-933f-4453-b409-e7afb97de0f9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:38.895717 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-6094d0ff-933f-4453-b409-e7afb97de0f9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:38.897588 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_api:SELECT=88 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:28:38.902726 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6094d0ff-933f-4453-b409-e7afb97de0f9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:38.903166 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6094d0ff-933f-4453-b409-e7afb97de0f9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:38.903912 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6094d0ff-933f-4453-b409-e7afb97de0f9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:38.904375 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6094d0ff-933f-4453-b409-e7afb97de0f9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:38.932749 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-6094d0ff-933f-4453-b409-e7afb97de0f9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041901 May 24 15:28:38.933313 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 663/1311] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:38 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:39.054181 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-ea5f27ea-dcb3-4424-82b7-ef50a8964616 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:39.055592 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-ea5f27ea-dcb3-4424-82b7-ef50a8964616 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:39.062275 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ea5f27ea-dcb3-4424-82b7-ef50a8964616 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:39.062722 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ea5f27ea-dcb3-4424-82b7-ef50a8964616 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:39.063481 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ea5f27ea-dcb3-4424-82b7-ef50a8964616 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:39.063928 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ea5f27ea-dcb3-4424-82b7-ef50a8964616 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:39.093834 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-ea5f27ea-dcb3-4424-82b7-ef50a8964616 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043482 May 24 15:28:39.094395 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 649/1312] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:28:39 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:28:39.771356 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-21d3b044-681c-48aa-ac0b-9765d8671a65 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:39.772268 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-21d3b044-681c-48aa-ac0b-9765d8671a65 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:39.779258 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-21d3b044-681c-48aa-ac0b-9765d8671a65 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:39.779696 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-21d3b044-681c-48aa-ac0b-9765d8671a65 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:39.780473 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-21d3b044-681c-48aa-ac0b-9765d8671a65 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:39.780902 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-21d3b044-681c-48aa-ac0b-9765d8671a65 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:39.809234 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-21d3b044-681c-48aa-ac0b-9765d8671a65 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041832 May 24 15:28:39.809772 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 664/1313] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:39 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:39.943283 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-74f4b30a-e776-4e53-b2de-60776984be95 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:39.944214 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-74f4b30a-e776-4e53-b2de-60776984be95 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:39.951260 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-74f4b30a-e776-4e53-b2de-60776984be95 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:39.951707 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-74f4b30a-e776-4e53-b2de-60776984be95 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:39.952491 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-74f4b30a-e776-4e53-b2de-60776984be95 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:39.952921 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-74f4b30a-e776-4e53-b2de-60776984be95 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:39.981767 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-74f4b30a-e776-4e53-b2de-60776984be95 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042415 May 24 15:28:39.982318 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 650/1314] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:39 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:40.105756 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-b06e82c2-17eb-496b-8315-13f71eb07428 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:40.106672 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-b06e82c2-17eb-496b-8315-13f71eb07428 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:40.112841 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b06e82c2-17eb-496b-8315-13f71eb07428 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:40.113282 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b06e82c2-17eb-496b-8315-13f71eb07428 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:40.114033 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b06e82c2-17eb-496b-8315-13f71eb07428 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:40.114453 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b06e82c2-17eb-496b-8315-13f71eb07428 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:40.143000 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-b06e82c2-17eb-496b-8315-13f71eb07428 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041276 May 24 15:28:40.143543 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 665/1315] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:28:40 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:28:40.821444 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-9bf86bb0-bcdb-40f0-a1c1-5c24a7ef65e4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:40.822377 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-9bf86bb0-bcdb-40f0-a1c1-5c24a7ef65e4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:40.829050 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9bf86bb0-bcdb-40f0-a1c1-5c24a7ef65e4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:40.829511 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9bf86bb0-bcdb-40f0-a1c1-5c24a7ef65e4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:40.830300 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9bf86bb0-bcdb-40f0-a1c1-5c24a7ef65e4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:40.830744 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9bf86bb0-bcdb-40f0-a1c1-5c24a7ef65e4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:40.860571 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-9bf86bb0-bcdb-40f0-a1c1-5c24a7ef65e4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043042 May 24 15:28:40.861127 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 651/1316] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:40 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:40.994141 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-7a969556-c858-4dc0-8892-ba33f3c23c86 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:40.995060 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-7a969556-c858-4dc0-8892-ba33f3c23c86 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:41.001606 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7a969556-c858-4dc0-8892-ba33f3c23c86 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:41.002046 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7a969556-c858-4dc0-8892-ba33f3c23c86 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:41.002794 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7a969556-c858-4dc0-8892-ba33f3c23c86 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:41.003218 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7a969556-c858-4dc0-8892-ba33f3c23c86 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:41.032001 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-7a969556-c858-4dc0-8892-ba33f3c23c86 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042350 May 24 15:28:41.032756 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 666/1317] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:40 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:41.154642 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-42fd1dde-2699-4210-a24f-80c2f16cfca0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:41.155567 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-42fd1dde-2699-4210-a24f-80c2f16cfca0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:41.161671 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-42fd1dde-2699-4210-a24f-80c2f16cfca0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:41.162122 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-42fd1dde-2699-4210-a24f-80c2f16cfca0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:41.162882 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-42fd1dde-2699-4210-a24f-80c2f16cfca0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:41.163318 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-42fd1dde-2699-4210-a24f-80c2f16cfca0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:41.191577 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-42fd1dde-2699-4210-a24f-80c2f16cfca0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041022 May 24 15:28:41.192121 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 652/1318] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:28:41 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 15:28:41.872110 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-8c676003-ccc6-4b18-bc7a-3358dd23669e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:41.873050 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-8c676003-ccc6-4b18-bc7a-3358dd23669e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:41.879035 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8c676003-ccc6-4b18-bc7a-3358dd23669e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:41.879481 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8c676003-ccc6-4b18-bc7a-3358dd23669e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:41.880225 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8c676003-ccc6-4b18-bc7a-3358dd23669e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:41.880702 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8c676003-ccc6-4b18-bc7a-3358dd23669e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:41.909765 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-8c676003-ccc6-4b18-bc7a-3358dd23669e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041779 May 24 15:28:41.910344 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 667/1319] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:41 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:42.044724 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-fdeccf49-0579-4968-b3ae-75721632387e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:42.045757 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-fdeccf49-0579-4968-b3ae-75721632387e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:42.052241 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fdeccf49-0579-4968-b3ae-75721632387e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:42.052725 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fdeccf49-0579-4968-b3ae-75721632387e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:42.053498 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fdeccf49-0579-4968-b3ae-75721632387e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:42.053935 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fdeccf49-0579-4968-b3ae-75721632387e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:42.091189 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-fdeccf49-0579-4968-b3ae-75721632387e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052104 May 24 15:28:42.091766 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 653/1320] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:42 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:42.203661 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-aeeb396e-d379-4d16-98d0-ecc1f99ddd38 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:42.204634 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-aeeb396e-d379-4d16-98d0-ecc1f99ddd38 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:42.211640 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-aeeb396e-d379-4d16-98d0-ecc1f99ddd38 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:42.212110 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-aeeb396e-d379-4d16-98d0-ecc1f99ddd38 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:42.212963 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-aeeb396e-d379-4d16-98d0-ecc1f99ddd38 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:42.213394 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-aeeb396e-d379-4d16-98d0-ecc1f99ddd38 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:42.241412 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-aeeb396e-d379-4d16-98d0-ecc1f99ddd38 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041667 May 24 15:28:42.241950 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 668/1321] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:28:42 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:28:42.921339 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e5cab746-81f4-4db7-8942-180ca7ae0afb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:42.922192 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-e5cab746-81f4-4db7-8942-180ca7ae0afb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:42.928476 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e5cab746-81f4-4db7-8942-180ca7ae0afb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:42.928922 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e5cab746-81f4-4db7-8942-180ca7ae0afb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:42.930362 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e5cab746-81f4-4db7-8942-180ca7ae0afb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:42.930796 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e5cab746-81f4-4db7-8942-180ca7ae0afb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:42.958496 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-e5cab746-81f4-4db7-8942-180ca7ae0afb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041188 May 24 15:28:42.959030 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 654/1322] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:42 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:43.103278 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-7442c760-aae3-4361-8db7-9fc71295f13f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:43.104249 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-7442c760-aae3-4361-8db7-9fc71295f13f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:43.110461 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7442c760-aae3-4361-8db7-9fc71295f13f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:43.110904 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7442c760-aae3-4361-8db7-9fc71295f13f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:43.111651 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7442c760-aae3-4361-8db7-9fc71295f13f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:43.112075 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7442c760-aae3-4361-8db7-9fc71295f13f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:43.141255 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-7442c760-aae3-4361-8db7-9fc71295f13f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042402 May 24 15:28:43.141817 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 669/1323] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:43 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:43.253100 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-81995459-a3de-4127-b71f-209314d5d628 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:43.254016 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-81995459-a3de-4127-b71f-209314d5d628 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:43.260489 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-81995459-a3de-4127-b71f-209314d5d628 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:43.260929 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-81995459-a3de-4127-b71f-209314d5d628 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:43.261674 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-81995459-a3de-4127-b71f-209314d5d628 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:43.262099 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-81995459-a3de-4127-b71f-209314d5d628 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:43.290980 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-81995459-a3de-4127-b71f-209314d5d628 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041818 May 24 15:28:43.291524 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 655/1324] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:28:43 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:28:43.970089 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c751f11c-b4a9-430c-af97-614d8b80042a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:43.970999 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-c751f11c-b4a9-430c-af97-614d8b80042a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:43.977654 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c751f11c-b4a9-430c-af97-614d8b80042a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:43.978091 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c751f11c-b4a9-430c-af97-614d8b80042a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:43.978872 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c751f11c-b4a9-430c-af97-614d8b80042a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:43.979299 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c751f11c-b4a9-430c-af97-614d8b80042a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:44.007268 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-c751f11c-b4a9-430c-af97-614d8b80042a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041188 May 24 15:28:44.008341 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 670/1325] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:43 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:44.152763 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-6f458099-72d8-4564-957d-b1072976f5e0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:44.153690 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-6f458099-72d8-4564-957d-b1072976f5e0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:44.159726 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6f458099-72d8-4564-957d-b1072976f5e0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:44.160180 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6f458099-72d8-4564-957d-b1072976f5e0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:44.160971 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6f458099-72d8-4564-957d-b1072976f5e0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:44.161400 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6f458099-72d8-4564-957d-b1072976f5e0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:44.190545 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-6f458099-72d8-4564-957d-b1072976f5e0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041768 May 24 15:28:44.191106 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 656/1326] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:44 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:44.302474 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-4005dc33-20c6-45ec-8edc-eae10c7c1c7c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:44.303379 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-4005dc33-20c6-45ec-8edc-eae10c7c1c7c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:44.309827 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4005dc33-20c6-45ec-8edc-eae10c7c1c7c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:44.310263 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4005dc33-20c6-45ec-8edc-eae10c7c1c7c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:44.311118 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4005dc33-20c6-45ec-8edc-eae10c7c1c7c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:44.311541 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4005dc33-20c6-45ec-8edc-eae10c7c1c7c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:44.340070 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-4005dc33-20c6-45ec-8edc-eae10c7c1c7c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041476 May 24 15:28:44.340840 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 671/1327] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:28:44 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:28:45.019045 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-2f5ca711-1e05-4c1b-aa94-86d3029821da tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:45.020002 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-2f5ca711-1e05-4c1b-aa94-86d3029821da tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:45.026964 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2f5ca711-1e05-4c1b-aa94-86d3029821da tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:45.027406 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2f5ca711-1e05-4c1b-aa94-86d3029821da tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:45.028154 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2f5ca711-1e05-4c1b-aa94-86d3029821da tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:45.028610 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2f5ca711-1e05-4c1b-aa94-86d3029821da tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:45.056868 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-2f5ca711-1e05-4c1b-aa94-86d3029821da tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041775 May 24 15:28:45.057405 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 657/1328] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:45 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:45.202242 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-2670b943-439a-4291-9fc3-1d0b90d9ad50 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:45.203158 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-2670b943-439a-4291-9fc3-1d0b90d9ad50 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:45.209614 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2670b943-439a-4291-9fc3-1d0b90d9ad50 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:45.210064 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2670b943-439a-4291-9fc3-1d0b90d9ad50 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:45.210863 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2670b943-439a-4291-9fc3-1d0b90d9ad50 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:45.211294 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2670b943-439a-4291-9fc3-1d0b90d9ad50 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:45.241334 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-2670b943-439a-4291-9fc3-1d0b90d9ad50 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042483 May 24 15:28:45.241908 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 672/1329] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:45 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:45.351670 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-5c68e907-c63d-4b25-9f40-104e2fb077b6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:45.352554 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-5c68e907-c63d-4b25-9f40-104e2fb077b6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:45.358569 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5c68e907-c63d-4b25-9f40-104e2fb077b6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:45.359273 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5c68e907-c63d-4b25-9f40-104e2fb077b6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:45.360043 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5c68e907-c63d-4b25-9f40-104e2fb077b6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:45.360498 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5c68e907-c63d-4b25-9f40-104e2fb077b6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:45.389044 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-5c68e907-c63d-4b25-9f40-104e2fb077b6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041497 May 24 15:28:45.389584 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 658/1330] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:28:45 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:28:46.068230 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-21a895e2-4c53-42a6-9e55-91b95ac0394b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:46.069171 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-21a895e2-4c53-42a6-9e55-91b95ac0394b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:46.075189 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-21a895e2-4c53-42a6-9e55-91b95ac0394b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:46.075636 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-21a895e2-4c53-42a6-9e55-91b95ac0394b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:46.076416 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-21a895e2-4c53-42a6-9e55-91b95ac0394b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:46.076848 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-21a895e2-4c53-42a6-9e55-91b95ac0394b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:46.105102 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-21a895e2-4c53-42a6-9e55-91b95ac0394b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040860 May 24 15:28:46.105646 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 673/1331] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:46 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:46.238451 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 15:28:46.239031 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Tue May 24 15:28:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 15:28:46.252695 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-c9fbdba1-916f-4e04-86d0-7acc29d99ff2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:46.253661 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-c9fbdba1-916f-4e04-86d0-7acc29d99ff2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:46.260261 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c9fbdba1-916f-4e04-86d0-7acc29d99ff2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:46.260746 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c9fbdba1-916f-4e04-86d0-7acc29d99ff2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:46.261523 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c9fbdba1-916f-4e04-86d0-7acc29d99ff2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:46.261961 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c9fbdba1-916f-4e04-86d0-7acc29d99ff2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:46.291394 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-c9fbdba1-916f-4e04-86d0-7acc29d99ff2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042636 May 24 15:28:46.291958 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 659/1332] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:46 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:46.400912 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-0190207f-93f5-46e7-b929-977c60b04176 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:46.401760 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-0190207f-93f5-46e7-b929-977c60b04176 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:46.408194 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0190207f-93f5-46e7-b929-977c60b04176 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:46.408668 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0190207f-93f5-46e7-b929-977c60b04176 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:46.409413 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0190207f-93f5-46e7-b929-977c60b04176 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:46.409838 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0190207f-93f5-46e7-b929-977c60b04176 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:46.438476 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-0190207f-93f5-46e7-b929-977c60b04176 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042064 May 24 15:28:46.439003 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 674/1333] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:28:46 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:28:47.117524 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d018c28a-1d03-4a76-9598-7ad7f4213226 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:47.118362 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d018c28a-1d03-4a76-9598-7ad7f4213226 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:47.124514 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d018c28a-1d03-4a76-9598-7ad7f4213226 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:47.124961 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d018c28a-1d03-4a76-9598-7ad7f4213226 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:47.125721 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d018c28a-1d03-4a76-9598-7ad7f4213226 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:47.126157 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d018c28a-1d03-4a76-9598-7ad7f4213226 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:47.129684 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:28:47.156060 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d018c28a-1d03-4a76-9598-7ad7f4213226 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043162 May 24 15:28:47.156667 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 660/1334] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:47 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:47.302008 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-034e4103-589b-4896-8db6-dc0772330734 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:47.302918 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-034e4103-589b-4896-8db6-dc0772330734 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:47.309449 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-034e4103-589b-4896-8db6-dc0772330734 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:47.309890 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-034e4103-589b-4896-8db6-dc0772330734 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:47.310642 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-034e4103-589b-4896-8db6-dc0772330734 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:47.311067 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-034e4103-589b-4896-8db6-dc0772330734 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:47.340173 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-034e4103-589b-4896-8db6-dc0772330734 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042081 May 24 15:28:47.340751 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 675/1335] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:47 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:47.450056 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-92dc9ab9-b62d-4a75-9af2-27880f7b190f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:47.450927 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-92dc9ab9-b62d-4a75-9af2-27880f7b190f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:47.457235 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-92dc9ab9-b62d-4a75-9af2-27880f7b190f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:47.457725 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-92dc9ab9-b62d-4a75-9af2-27880f7b190f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:47.458472 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-92dc9ab9-b62d-4a75-9af2-27880f7b190f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:47.458901 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-92dc9ab9-b62d-4a75-9af2-27880f7b190f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:47.487391 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-92dc9ab9-b62d-4a75-9af2-27880f7b190f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041396 May 24 15:28:47.487923 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 661/1336] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:28:47 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:28:48.166782 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d649764d-524d-4f42-981c-c77f8da830e3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:48.167697 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d649764d-524d-4f42-981c-c77f8da830e3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:48.174371 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d649764d-524d-4f42-981c-c77f8da830e3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:48.174817 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d649764d-524d-4f42-981c-c77f8da830e3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:48.175568 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d649764d-524d-4f42-981c-c77f8da830e3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:48.175995 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d649764d-524d-4f42-981c-c77f8da830e3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:48.204493 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d649764d-524d-4f42-981c-c77f8da830e3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041721 May 24 15:28:48.205022 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 676/1337] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:48 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:48.351111 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a147d7f9-414e-4f1c-992e-aa956e94b2ef tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:48.352039 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a147d7f9-414e-4f1c-992e-aa956e94b2ef tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:48.359899 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a147d7f9-414e-4f1c-992e-aa956e94b2ef tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:48.360381 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a147d7f9-414e-4f1c-992e-aa956e94b2ef tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:48.361154 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a147d7f9-414e-4f1c-992e-aa956e94b2ef tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:48.361585 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a147d7f9-414e-4f1c-992e-aa956e94b2ef tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:48.390607 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a147d7f9-414e-4f1c-992e-aa956e94b2ef tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043421 May 24 15:28:48.391171 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 662/1338] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:48 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:48.498775 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-3d3d258d-7564-4fa8-a6c5-0155f7e7b7f8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:48.499971 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-3d3d258d-7564-4fa8-a6c5-0155f7e7b7f8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:48.505918 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3d3d258d-7564-4fa8-a6c5-0155f7e7b7f8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:48.506361 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3d3d258d-7564-4fa8-a6c5-0155f7e7b7f8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:48.507103 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3d3d258d-7564-4fa8-a6c5-0155f7e7b7f8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:48.508053 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3d3d258d-7564-4fa8-a6c5-0155f7e7b7f8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:48.510346 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:28:48.537158 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-3d3d258d-7564-4fa8-a6c5-0155f7e7b7f8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042336 May 24 15:28:48.537688 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 677/1339] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:28:48 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:28:49.215092 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-8a976243-c883-4bb7-b55f-79a15f5ee087 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:49.216009 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-8a976243-c883-4bb7-b55f-79a15f5ee087 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:49.222574 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8a976243-c883-4bb7-b55f-79a15f5ee087 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:49.223015 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8a976243-c883-4bb7-b55f-79a15f5ee087 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:49.223763 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8a976243-c883-4bb7-b55f-79a15f5ee087 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:49.224190 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8a976243-c883-4bb7-b55f-79a15f5ee087 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:49.253342 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-8a976243-c883-4bb7-b55f-79a15f5ee087 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042205 May 24 15:28:49.253865 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 663/1340] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:49 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:49.402845 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-70ba9014-6040-4a44-9f11-28131870c46e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:49.403748 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-70ba9014-6040-4a44-9f11-28131870c46e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:49.410268 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-70ba9014-6040-4a44-9f11-28131870c46e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:49.410709 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-70ba9014-6040-4a44-9f11-28131870c46e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:49.411482 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-70ba9014-6040-4a44-9f11-28131870c46e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:49.411912 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-70ba9014-6040-4a44-9f11-28131870c46e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:49.441309 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-70ba9014-6040-4a44-9f11-28131870c46e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043030 May 24 15:28:49.442048 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 678/1341] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:49 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:49.548433 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-c074281c-6e61-4013-b33c-c787bb184399 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:49.549343 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-c074281c-6e61-4013-b33c-c787bb184399 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:49.555317 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c074281c-6e61-4013-b33c-c787bb184399 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:49.555758 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c074281c-6e61-4013-b33c-c787bb184399 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:49.559986 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c074281c-6e61-4013-b33c-c787bb184399 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:49.559986 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c074281c-6e61-4013-b33c-c787bb184399 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:49.585127 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-c074281c-6e61-4013-b33c-c787bb184399 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040606 May 24 15:28:49.586179 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 664/1342] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:28:49 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:28:50.264906 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-3a05dd48-e49e-4384-b1fa-52f2078fddfc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:50.265819 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-3a05dd48-e49e-4384-b1fa-52f2078fddfc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:50.272022 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3a05dd48-e49e-4384-b1fa-52f2078fddfc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:50.272533 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3a05dd48-e49e-4384-b1fa-52f2078fddfc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:50.273305 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3a05dd48-e49e-4384-b1fa-52f2078fddfc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:50.273732 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3a05dd48-e49e-4384-b1fa-52f2078fddfc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:50.301621 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-3a05dd48-e49e-4384-b1fa-52f2078fddfc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040673 May 24 15:28:50.302193 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 679/1343] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:50 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:50.452897 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-8cd45c14-d30c-43d4-8da3-a3a531791ad0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:50.453751 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-8cd45c14-d30c-43d4-8da3-a3a531791ad0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:50.460289 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8cd45c14-d30c-43d4-8da3-a3a531791ad0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:50.460767 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8cd45c14-d30c-43d4-8da3-a3a531791ad0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:50.461537 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8cd45c14-d30c-43d4-8da3-a3a531791ad0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:50.461979 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8cd45c14-d30c-43d4-8da3-a3a531791ad0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:50.491191 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-8cd45c14-d30c-43d4-8da3-a3a531791ad0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042222 May 24 15:28:50.492544 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 665/1344] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:50 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:50.597266 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-2c3e1788-3e8d-48de-b23d-7b7d3fdaa77c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:50.598176 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-2c3e1788-3e8d-48de-b23d-7b7d3fdaa77c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:50.604853 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2c3e1788-3e8d-48de-b23d-7b7d3fdaa77c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:50.605302 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2c3e1788-3e8d-48de-b23d-7b7d3fdaa77c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:50.606080 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2c3e1788-3e8d-48de-b23d-7b7d3fdaa77c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:50.606498 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2c3e1788-3e8d-48de-b23d-7b7d3fdaa77c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:50.635342 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-2c3e1788-3e8d-48de-b23d-7b7d3fdaa77c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042044 May 24 15:28:50.635878 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 680/1345] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:28:50 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:28:51.313313 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-48e58332-bd2a-470c-971f-2295e3c73153 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:51.314240 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-48e58332-bd2a-470c-971f-2295e3c73153 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:51.320930 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-48e58332-bd2a-470c-971f-2295e3c73153 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:51.321382 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-48e58332-bd2a-470c-971f-2295e3c73153 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:51.322148 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-48e58332-bd2a-470c-971f-2295e3c73153 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:51.322587 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-48e58332-bd2a-470c-971f-2295e3c73153 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:51.351402 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-48e58332-bd2a-470c-971f-2295e3c73153 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042003 May 24 15:28:51.351955 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 666/1346] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:51 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:51.503391 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-6adcabbe-8ab6-438f-a3c5-cdbfeda9481b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:51.504326 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-6adcabbe-8ab6-438f-a3c5-cdbfeda9481b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:51.511253 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6adcabbe-8ab6-438f-a3c5-cdbfeda9481b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:51.511695 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6adcabbe-8ab6-438f-a3c5-cdbfeda9481b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:51.512477 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6adcabbe-8ab6-438f-a3c5-cdbfeda9481b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:51.512905 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6adcabbe-8ab6-438f-a3c5-cdbfeda9481b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:51.541254 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-6adcabbe-8ab6-438f-a3c5-cdbfeda9481b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041788 May 24 15:28:51.541966 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 681/1347] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:51 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:51.646435 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-6190f756-e5c5-44d9-acc2-092c340b2252 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:51.647293 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-6190f756-e5c5-44d9-acc2-092c340b2252 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:51.653784 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6190f756-e5c5-44d9-acc2-092c340b2252 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:51.654230 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6190f756-e5c5-44d9-acc2-092c340b2252 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:51.654994 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6190f756-e5c5-44d9-acc2-092c340b2252 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:51.655430 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6190f756-e5c5-44d9-acc2-092c340b2252 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:51.684708 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-6190f756-e5c5-44d9-acc2-092c340b2252 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042198 May 24 15:28:51.685254 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 667/1348] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:28:51 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:28:52.363295 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-a2bd0729-d981-41a5-9bcb-e3ff7f7184f0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:52.364109 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-a2bd0729-d981-41a5-9bcb-e3ff7f7184f0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:52.370281 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a2bd0729-d981-41a5-9bcb-e3ff7f7184f0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:52.370729 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a2bd0729-d981-41a5-9bcb-e3ff7f7184f0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:52.371483 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a2bd0729-d981-41a5-9bcb-e3ff7f7184f0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:52.371948 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a2bd0729-d981-41a5-9bcb-e3ff7f7184f0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:52.400780 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-a2bd0729-d981-41a5-9bcb-e3ff7f7184f0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041798 May 24 15:28:52.401325 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 682/1349] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:52 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:52.552745 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f353291e-c7e8-4e06-ba05-c92f2dc5a9e4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:52.553674 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f353291e-c7e8-4e06-ba05-c92f2dc5a9e4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:52.559704 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f353291e-c7e8-4e06-ba05-c92f2dc5a9e4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:52.560152 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f353291e-c7e8-4e06-ba05-c92f2dc5a9e4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:52.560983 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f353291e-c7e8-4e06-ba05-c92f2dc5a9e4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:52.561416 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f353291e-c7e8-4e06-ba05-c92f2dc5a9e4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:52.590164 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f353291e-c7e8-4e06-ba05-c92f2dc5a9e4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041793 May 24 15:28:52.590890 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 668/1350] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:52 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:52.696322 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-b7559d24-85ac-4dc5-adbf-63a0dacf8d13 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:52.697234 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-b7559d24-85ac-4dc5-adbf-63a0dacf8d13 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:52.703596 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b7559d24-85ac-4dc5-adbf-63a0dacf8d13 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:52.704036 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b7559d24-85ac-4dc5-adbf-63a0dacf8d13 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:52.704811 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b7559d24-85ac-4dc5-adbf-63a0dacf8d13 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:52.705238 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b7559d24-85ac-4dc5-adbf-63a0dacf8d13 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:52.733360 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-b7559d24-85ac-4dc5-adbf-63a0dacf8d13 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041464 May 24 15:28:52.734129 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 683/1351] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:28:52 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:28:53.412459 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-fdeb6b5c-bd10-4f9b-b78f-145aa530df72 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:53.413315 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-fdeb6b5c-bd10-4f9b-b78f-145aa530df72 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:53.420406 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fdeb6b5c-bd10-4f9b-b78f-145aa530df72 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:53.420857 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fdeb6b5c-bd10-4f9b-b78f-145aa530df72 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:53.421620 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fdeb6b5c-bd10-4f9b-b78f-145aa530df72 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:53.422058 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fdeb6b5c-bd10-4f9b-b78f-145aa530df72 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:53.450858 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-fdeb6b5c-bd10-4f9b-b78f-145aa530df72 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042530 May 24 15:28:53.451408 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 669/1352] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:53 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:53.601989 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-00f18ea8-d3a0-42a3-9609-38801fc8f827 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:53.602905 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-00f18ea8-d3a0-42a3-9609-38801fc8f827 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:53.609365 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-00f18ea8-d3a0-42a3-9609-38801fc8f827 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:53.609823 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-00f18ea8-d3a0-42a3-9609-38801fc8f827 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:53.610587 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-00f18ea8-d3a0-42a3-9609-38801fc8f827 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:53.611025 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-00f18ea8-d3a0-42a3-9609-38801fc8f827 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:53.640420 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-00f18ea8-d3a0-42a3-9609-38801fc8f827 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042736 May 24 15:28:53.640979 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 684/1353] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:53 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:53.745842 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-1e6eb7b0-5111-4c8e-8d61-589238795ae4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:53.746779 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-1e6eb7b0-5111-4c8e-8d61-589238795ae4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:53.752745 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1e6eb7b0-5111-4c8e-8d61-589238795ae4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:53.753189 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1e6eb7b0-5111-4c8e-8d61-589238795ae4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:53.753947 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1e6eb7b0-5111-4c8e-8d61-589238795ae4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:53.754382 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1e6eb7b0-5111-4c8e-8d61-589238795ae4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:53.782488 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-1e6eb7b0-5111-4c8e-8d61-589238795ae4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041233 May 24 15:28:53.783026 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 670/1354] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:28:53 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:28:54.462250 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-764091b6-47c9-4db4-ad42-0debdd83b808 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:54.463095 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-764091b6-47c9-4db4-ad42-0debdd83b808 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:54.469513 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-764091b6-47c9-4db4-ad42-0debdd83b808 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:54.469957 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-764091b6-47c9-4db4-ad42-0debdd83b808 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:54.470704 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-764091b6-47c9-4db4-ad42-0debdd83b808 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:54.471130 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-764091b6-47c9-4db4-ad42-0debdd83b808 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:54.498969 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-764091b6-47c9-4db4-ad42-0debdd83b808 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041437 May 24 15:28:54.499496 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 685/1355] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:54 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:28:54.651063 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-94b1030a-6569-40bf-81b7-0c2280053916 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:54.651992 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-94b1030a-6569-40bf-81b7-0c2280053916 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:54.658519 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-94b1030a-6569-40bf-81b7-0c2280053916 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:54.658967 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-94b1030a-6569-40bf-81b7-0c2280053916 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:54.659733 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-94b1030a-6569-40bf-81b7-0c2280053916 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:54.660170 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-94b1030a-6569-40bf-81b7-0c2280053916 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:54.698077 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-94b1030a-6569-40bf-81b7-0c2280053916 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050853 May 24 15:28:54.698865 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 671/1356] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:54 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:54.793816 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-a0ceb572-3a87-4c24-a82c-66c6878653bd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:54.794839 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-a0ceb572-3a87-4c24-a82c-66c6878653bd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:54.800787 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a0ceb572-3a87-4c24-a82c-66c6878653bd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:54.801224 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a0ceb572-3a87-4c24-a82c-66c6878653bd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:54.801966 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a0ceb572-3a87-4c24-a82c-66c6878653bd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:54.802391 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a0ceb572-3a87-4c24-a82c-66c6878653bd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:54.831012 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-a0ceb572-3a87-4c24-a82c-66c6878653bd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041102 May 24 15:28:54.831544 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 686/1357] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:28:54 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:28:55.510158 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-3163bf96-d0a0-4dde-ae46-38abcd0ff871 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:55.511076 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-3163bf96-d0a0-4dde-ae46-38abcd0ff871 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:55.517141 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3163bf96-d0a0-4dde-ae46-38abcd0ff871 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:55.517583 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3163bf96-d0a0-4dde-ae46-38abcd0ff871 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:55.518333 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3163bf96-d0a0-4dde-ae46-38abcd0ff871 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:55.518770 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3163bf96-d0a0-4dde-ae46-38abcd0ff871 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:55.553238 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-3163bf96-d0a0-4dde-ae46-38abcd0ff871 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047091 May 24 15:28:55.553778 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 672/1358] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:55 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:55.709335 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c4004c64-9e4e-4911-8473-1fbc4fe8a7f4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:55.710250 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-c4004c64-9e4e-4911-8473-1fbc4fe8a7f4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:55.717342 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c4004c64-9e4e-4911-8473-1fbc4fe8a7f4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:55.717995 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c4004c64-9e4e-4911-8473-1fbc4fe8a7f4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:55.718525 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c4004c64-9e4e-4911-8473-1fbc4fe8a7f4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:55.718948 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c4004c64-9e4e-4911-8473-1fbc4fe8a7f4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:55.747708 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-c4004c64-9e4e-4911-8473-1fbc4fe8a7f4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042449 May 24 15:28:55.748515 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 687/1359] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:55 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:55.842749 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-af63ac21-7f46-45ec-a9c5-4f2943281947 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:55.843604 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-af63ac21-7f46-45ec-a9c5-4f2943281947 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:55.850077 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-af63ac21-7f46-45ec-a9c5-4f2943281947 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:55.850521 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-af63ac21-7f46-45ec-a9c5-4f2943281947 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:55.851279 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-af63ac21-7f46-45ec-a9c5-4f2943281947 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:55.851708 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-af63ac21-7f46-45ec-a9c5-4f2943281947 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:55.881876 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-af63ac21-7f46-45ec-a9c5-4f2943281947 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043133 May 24 15:28:55.882917 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 673/1360] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:28:55 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:28:56.563940 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-91c44f47-674e-40e2-8e52-653bdfad3e40 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:56.564886 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-91c44f47-674e-40e2-8e52-653bdfad3e40 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:56.570930 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-91c44f47-674e-40e2-8e52-653bdfad3e40 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:56.571379 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-91c44f47-674e-40e2-8e52-653bdfad3e40 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:56.572136 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-91c44f47-674e-40e2-8e52-653bdfad3e40 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:56.572595 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-91c44f47-674e-40e2-8e52-653bdfad3e40 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:56.599959 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-91c44f47-674e-40e2-8e52-653bdfad3e40 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040011 May 24 15:28:56.600532 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 688/1361] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:56 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:56.758866 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-8170a783-a641-40c8-a38c-9d62daefbbe1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:56.760105 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-8170a783-a641-40c8-a38c-9d62daefbbe1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:56.766091 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8170a783-a641-40c8-a38c-9d62daefbbe1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:56.766532 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8170a783-a641-40c8-a38c-9d62daefbbe1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:56.767290 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8170a783-a641-40c8-a38c-9d62daefbbe1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:56.767718 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8170a783-a641-40c8-a38c-9d62daefbbe1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:56.797539 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-8170a783-a641-40c8-a38c-9d62daefbbe1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042515 May 24 15:28:56.798088 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 674/1362] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:56 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:56.894056 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-9c38f422-1e6c-4254-a1f2-e54e20cc2a16 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:56.894976 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-9c38f422-1e6c-4254-a1f2-e54e20cc2a16 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:56.901912 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9c38f422-1e6c-4254-a1f2-e54e20cc2a16 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:56.902361 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9c38f422-1e6c-4254-a1f2-e54e20cc2a16 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:56.903113 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9c38f422-1e6c-4254-a1f2-e54e20cc2a16 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:56.903543 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9c38f422-1e6c-4254-a1f2-e54e20cc2a16 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:56.931952 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-9c38f422-1e6c-4254-a1f2-e54e20cc2a16 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041919 May 24 15:28:56.932518 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 689/1363] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:28:56 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:28:57.612134 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-dd56bc1d-9657-40c0-b562-de5bc22ddcaa tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:57.613073 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-dd56bc1d-9657-40c0-b562-de5bc22ddcaa tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:57.620092 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dd56bc1d-9657-40c0-b562-de5bc22ddcaa tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:57.620569 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dd56bc1d-9657-40c0-b562-de5bc22ddcaa tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:57.621318 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dd56bc1d-9657-40c0-b562-de5bc22ddcaa tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:57.621751 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dd56bc1d-9657-40c0-b562-de5bc22ddcaa tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:57.650418 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-dd56bc1d-9657-40c0-b562-de5bc22ddcaa tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042549 May 24 15:28:57.650948 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 675/1364] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:57 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:57.809374 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-1772dbdd-58c3-43af-b238-fa2e06719207 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:57.810293 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-1772dbdd-58c3-43af-b238-fa2e06719207 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:57.816343 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1772dbdd-58c3-43af-b238-fa2e06719207 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:57.816791 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1772dbdd-58c3-43af-b238-fa2e06719207 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:57.817551 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1772dbdd-58c3-43af-b238-fa2e06719207 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:57.817984 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1772dbdd-58c3-43af-b238-fa2e06719207 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:57.855577 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-1772dbdd-58c3-43af-b238-fa2e06719207 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050004 May 24 15:28:57.856117 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 690/1365] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:57 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:57.943530 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-6e11fb25-8177-489f-96b2-5d4f5d19aff8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:57.944388 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-6e11fb25-8177-489f-96b2-5d4f5d19aff8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:57.950262 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6e11fb25-8177-489f-96b2-5d4f5d19aff8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:57.950703 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6e11fb25-8177-489f-96b2-5d4f5d19aff8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:57.951452 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6e11fb25-8177-489f-96b2-5d4f5d19aff8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:57.951879 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6e11fb25-8177-489f-96b2-5d4f5d19aff8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:57.975429 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:28:57.980819 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-6e11fb25-8177-489f-96b2-5d4f5d19aff8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041291 May 24 15:28:57.981355 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 676/1366] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:28:57 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:28:58.661863 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-3bd058e6-b0ec-4dc9-9882-e17709ff4a25 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:58.662785 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-3bd058e6-b0ec-4dc9-9882-e17709ff4a25 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:58.669288 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3bd058e6-b0ec-4dc9-9882-e17709ff4a25 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:58.669738 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3bd058e6-b0ec-4dc9-9882-e17709ff4a25 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:58.670492 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3bd058e6-b0ec-4dc9-9882-e17709ff4a25 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:58.670925 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3bd058e6-b0ec-4dc9-9882-e17709ff4a25 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:58.699169 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-3bd058e6-b0ec-4dc9-9882-e17709ff4a25 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041230 May 24 15:28:58.699709 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 691/1367] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:58 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:58.867067 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d7ac0792-b337-4185-acf6-d7248ab973f1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:58.867983 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d7ac0792-b337-4185-acf6-d7248ab973f1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:58.874583 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d7ac0792-b337-4185-acf6-d7248ab973f1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:58.875039 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d7ac0792-b337-4185-acf6-d7248ab973f1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:58.875777 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d7ac0792-b337-4185-acf6-d7248ab973f1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:58.876204 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d7ac0792-b337-4185-acf6-d7248ab973f1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:58.906265 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d7ac0792-b337-4185-acf6-d7248ab973f1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043288 May 24 15:28:58.906823 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 677/1368] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:58 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:58.993047 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-b7b5ed18-472b-432c-9596-796b65d0f167 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:58.993992 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-b7b5ed18-472b-432c-9596-796b65d0f167 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:58.999925 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b7b5ed18-472b-432c-9596-796b65d0f167 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:59.000404 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b7b5ed18-472b-432c-9596-796b65d0f167 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:59.001154 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b7b5ed18-472b-432c-9596-796b65d0f167 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:59.001586 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b7b5ed18-472b-432c-9596-796b65d0f167 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:59.031012 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-b7b5ed18-472b-432c-9596-796b65d0f167 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041984 May 24 15:28:59.031551 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 692/1369] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:28:58 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 15:28:59.710699 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-3e54a453-32d9-4f4c-8c3c-065cfed16b04 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:59.711667 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-3e54a453-32d9-4f4c-8c3c-065cfed16b04 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:59.713582 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_api:SELECT=86 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:28:59.718771 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3e54a453-32d9-4f4c-8c3c-065cfed16b04 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:59.719209 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3e54a453-32d9-4f4c-8c3c-065cfed16b04 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:59.719955 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3e54a453-32d9-4f4c-8c3c-065cfed16b04 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:59.720417 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3e54a453-32d9-4f4c-8c3c-065cfed16b04 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:59.749644 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-3e54a453-32d9-4f4c-8c3c-065cfed16b04 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042988 May 24 15:28:59.750185 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 678/1370] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:59 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:28:59.917820 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-3ab1ea17-539a-41b0-9de5-9aeb90c28035 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:28:59.918739 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-3ab1ea17-539a-41b0-9de5-9aeb90c28035 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:28:59.925357 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3ab1ea17-539a-41b0-9de5-9aeb90c28035 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:59.925808 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3ab1ea17-539a-41b0-9de5-9aeb90c28035 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:59.926709 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3ab1ea17-539a-41b0-9de5-9aeb90c28035 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:28:59.927150 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3ab1ea17-539a-41b0-9de5-9aeb90c28035 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:28:59.950582 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:28:59.957565 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-3ab1ea17-539a-41b0-9de5-9aeb90c28035 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044240 May 24 15:28:59.958117 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 693/1371] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:28:59 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:00.043176 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-35c33ba2-644e-492f-8e43-b2b58828a25c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:00.044099 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-35c33ba2-644e-492f-8e43-b2b58828a25c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:00.050697 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-35c33ba2-644e-492f-8e43-b2b58828a25c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:00.051150 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-35c33ba2-644e-492f-8e43-b2b58828a25c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:00.051955 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-35c33ba2-644e-492f-8e43-b2b58828a25c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:00.052422 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-35c33ba2-644e-492f-8e43-b2b58828a25c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:00.082275 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-35c33ba2-644e-492f-8e43-b2b58828a25c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043679 May 24 15:29:00.082860 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 679/1372] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:29:00 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:29:00.761954 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-75111280-6edf-4eda-8fdf-c19caa8b4396 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:00.762874 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-75111280-6edf-4eda-8fdf-c19caa8b4396 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:00.768909 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-75111280-6edf-4eda-8fdf-c19caa8b4396 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:00.769362 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-75111280-6edf-4eda-8fdf-c19caa8b4396 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:00.770119 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-75111280-6edf-4eda-8fdf-c19caa8b4396 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:00.770552 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-75111280-6edf-4eda-8fdf-c19caa8b4396 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:00.798830 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-75111280-6edf-4eda-8fdf-c19caa8b4396 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041650 May 24 15:29:00.799369 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 694/1373] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:00 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:00.969572 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-075fc85d-4798-4dec-ad1a-f0224ea60a4b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:00.970484 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-075fc85d-4798-4dec-ad1a-f0224ea60a4b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:00.977087 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-075fc85d-4798-4dec-ad1a-f0224ea60a4b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:00.977548 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-075fc85d-4798-4dec-ad1a-f0224ea60a4b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:00.978297 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-075fc85d-4798-4dec-ad1a-f0224ea60a4b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:00.978724 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-075fc85d-4798-4dec-ad1a-f0224ea60a4b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:01.008293 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-075fc85d-4798-4dec-ad1a-f0224ea60a4b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042610 May 24 15:29:01.008856 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 680/1374] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:00 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:01.094354 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-f544266e-47e5-4481-9413-c57674294e42 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:01.095262 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-f544266e-47e5-4481-9413-c57674294e42 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:01.102168 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f544266e-47e5-4481-9413-c57674294e42 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:01.102608 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f544266e-47e5-4481-9413-c57674294e42 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:01.103353 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f544266e-47e5-4481-9413-c57674294e42 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:01.103776 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f544266e-47e5-4481-9413-c57674294e42 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:01.132862 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-f544266e-47e5-4481-9413-c57674294e42 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042521 May 24 15:29:01.133404 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 695/1375] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:29:01 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:29:01.810376 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d001a7b0-883f-4ad4-a12b-ae86e87563b3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:01.811299 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d001a7b0-883f-4ad4-a12b-ae86e87563b3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:01.817777 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d001a7b0-883f-4ad4-a12b-ae86e87563b3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:01.818240 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d001a7b0-883f-4ad4-a12b-ae86e87563b3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:01.818980 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d001a7b0-883f-4ad4-a12b-ae86e87563b3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:01.819411 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d001a7b0-883f-4ad4-a12b-ae86e87563b3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:01.848445 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d001a7b0-883f-4ad4-a12b-ae86e87563b3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042100 May 24 15:29:01.848984 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 681/1376] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:01 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:02.018782 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-51216e63-b9d8-406c-826f-025bc6eb1607 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:02.019708 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-51216e63-b9d8-406c-826f-025bc6eb1607 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:02.026354 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-51216e63-b9d8-406c-826f-025bc6eb1607 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:02.026829 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-51216e63-b9d8-406c-826f-025bc6eb1607 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:02.027590 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-51216e63-b9d8-406c-826f-025bc6eb1607 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:02.028024 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-51216e63-b9d8-406c-826f-025bc6eb1607 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:02.056935 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-51216e63-b9d8-406c-826f-025bc6eb1607 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042019 May 24 15:29:02.057508 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 696/1377] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:02 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:02.144367 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-89165df8-30a9-4377-b76d-e9e004a92943 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:02.145292 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-89165df8-30a9-4377-b76d-e9e004a92943 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:02.151278 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-89165df8-30a9-4377-b76d-e9e004a92943 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:02.151723 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-89165df8-30a9-4377-b76d-e9e004a92943 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:02.152512 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-89165df8-30a9-4377-b76d-e9e004a92943 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:02.152946 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-89165df8-30a9-4377-b76d-e9e004a92943 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:02.180998 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-89165df8-30a9-4377-b76d-e9e004a92943 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040678 May 24 15:29:02.181530 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 682/1378] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:29:02 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:29:02.860623 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-afa5430d-b657-413c-869d-5a9804f7dbd6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:02.861549 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-afa5430d-b657-413c-869d-5a9804f7dbd6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:02.868053 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-afa5430d-b657-413c-869d-5a9804f7dbd6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:02.868542 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-afa5430d-b657-413c-869d-5a9804f7dbd6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:02.869305 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-afa5430d-b657-413c-869d-5a9804f7dbd6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:02.869742 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-afa5430d-b657-413c-869d-5a9804f7dbd6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:02.897533 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-afa5430d-b657-413c-869d-5a9804f7dbd6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041228 May 24 15:29:02.898506 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 697/1379] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:02 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:03.068159 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e75e3ba8-e712-4ef4-9b27-67605b7b46ee tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:03.069128 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-e75e3ba8-e712-4ef4-9b27-67605b7b46ee tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:03.075302 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e75e3ba8-e712-4ef4-9b27-67605b7b46ee tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:03.075745 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e75e3ba8-e712-4ef4-9b27-67605b7b46ee tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:03.076612 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e75e3ba8-e712-4ef4-9b27-67605b7b46ee tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:03.077043 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e75e3ba8-e712-4ef4-9b27-67605b7b46ee tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:03.114710 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-e75e3ba8-e712-4ef4-9b27-67605b7b46ee tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050330 May 24 15:29:03.115256 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 683/1380] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:03 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:03.192082 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-1dc842da-e03f-40fd-a91b-0106004ec542 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:03.192950 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-1dc842da-e03f-40fd-a91b-0106004ec542 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:03.199464 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1dc842da-e03f-40fd-a91b-0106004ec542 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:03.199903 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1dc842da-e03f-40fd-a91b-0106004ec542 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:03.200683 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1dc842da-e03f-40fd-a91b-0106004ec542 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:03.201137 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1dc842da-e03f-40fd-a91b-0106004ec542 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:03.229503 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-1dc842da-e03f-40fd-a91b-0106004ec542 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041398 May 24 15:29:03.230044 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 698/1381] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:29:03 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:29:03.910452 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a29e4d85-6614-4c08-bcd9-ce1f284ff4a0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:03.911408 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a29e4d85-6614-4c08-bcd9-ce1f284ff4a0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:03.917970 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a29e4d85-6614-4c08-bcd9-ce1f284ff4a0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:03.918425 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a29e4d85-6614-4c08-bcd9-ce1f284ff4a0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:03.919178 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a29e4d85-6614-4c08-bcd9-ce1f284ff4a0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:03.919610 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a29e4d85-6614-4c08-bcd9-ce1f284ff4a0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:03.955419 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a29e4d85-6614-4c08-bcd9-ce1f284ff4a0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049049 May 24 15:29:03.956482 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 684/1382] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:03 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:04.125906 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-60d1c80d-b76c-476b-a703-21077b9776f7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:04.126826 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-60d1c80d-b76c-476b-a703-21077b9776f7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:04.133332 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-60d1c80d-b76c-476b-a703-21077b9776f7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:04.133771 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-60d1c80d-b76c-476b-a703-21077b9776f7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:04.134523 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-60d1c80d-b76c-476b-a703-21077b9776f7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:04.134986 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-60d1c80d-b76c-476b-a703-21077b9776f7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:04.162623 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-60d1c80d-b76c-476b-a703-21077b9776f7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040487 May 24 15:29:04.163099 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 699/1383] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:04 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:04.240936 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-3c6883a2-f0bb-4c0f-8264-7be7fe7116cb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:04.242562 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-3c6883a2-f0bb-4c0f-8264-7be7fe7116cb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:04.249333 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3c6883a2-f0bb-4c0f-8264-7be7fe7116cb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:04.249768 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3c6883a2-f0bb-4c0f-8264-7be7fe7116cb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:04.250519 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3c6883a2-f0bb-4c0f-8264-7be7fe7116cb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:04.250954 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3c6883a2-f0bb-4c0f-8264-7be7fe7116cb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:04.280803 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-3c6883a2-f0bb-4c0f-8264-7be7fe7116cb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043738 May 24 15:29:04.281356 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 685/1384] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:29:04 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:29:04.967638 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d9020d25-3de0-468d-9c7a-6b0ea941b446 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:04.968593 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d9020d25-3de0-468d-9c7a-6b0ea941b446 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:04.974622 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d9020d25-3de0-468d-9c7a-6b0ea941b446 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:04.975066 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d9020d25-3de0-468d-9c7a-6b0ea941b446 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:04.975828 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d9020d25-3de0-468d-9c7a-6b0ea941b446 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:04.976268 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d9020d25-3de0-468d-9c7a-6b0ea941b446 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:05.004350 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d9020d25-3de0-468d-9c7a-6b0ea941b446 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040698 May 24 15:29:05.004894 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 700/1385] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:04 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:05.174320 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a298ac41-6b35-46fa-9a22-2b8fa202d7a6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:05.175289 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a298ac41-6b35-46fa-9a22-2b8fa202d7a6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:05.182038 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a298ac41-6b35-46fa-9a22-2b8fa202d7a6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:05.182590 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a298ac41-6b35-46fa-9a22-2b8fa202d7a6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:05.183228 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a298ac41-6b35-46fa-9a22-2b8fa202d7a6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:05.183656 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a298ac41-6b35-46fa-9a22-2b8fa202d7a6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:05.213204 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a298ac41-6b35-46fa-9a22-2b8fa202d7a6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042748 May 24 15:29:05.213763 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 686/1386] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:05 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:05.292498 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-5e39a695-fc8f-4768-b286-1998ea828653 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:05.293369 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-5e39a695-fc8f-4768-b286-1998ea828653 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:05.299854 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5e39a695-fc8f-4768-b286-1998ea828653 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:05.300325 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5e39a695-fc8f-4768-b286-1998ea828653 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:05.301078 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5e39a695-fc8f-4768-b286-1998ea828653 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:05.301508 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5e39a695-fc8f-4768-b286-1998ea828653 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:05.330579 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-5e39a695-fc8f-4768-b286-1998ea828653 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042131 May 24 15:29:05.331119 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 701/1387] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:29:05 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:29:06.016454 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-6b378239-b5e1-43d9-a36e-2584347d1bd2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:06.017382 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-6b378239-b5e1-43d9-a36e-2584347d1bd2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:06.024327 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6b378239-b5e1-43d9-a36e-2584347d1bd2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:06.024803 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6b378239-b5e1-43d9-a36e-2584347d1bd2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:06.025567 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6b378239-b5e1-43d9-a36e-2584347d1bd2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:06.026008 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6b378239-b5e1-43d9-a36e-2584347d1bd2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:06.058048 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-6b378239-b5e1-43d9-a36e-2584347d1bd2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045526 May 24 15:29:06.058619 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 687/1388] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:06 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:06.223870 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-204e1685-dcf7-4893-b2a5-054b0d83050e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:06.224842 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-204e1685-dcf7-4893-b2a5-054b0d83050e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:06.230864 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-204e1685-dcf7-4893-b2a5-054b0d83050e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:06.231311 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-204e1685-dcf7-4893-b2a5-054b0d83050e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:06.232072 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-204e1685-dcf7-4893-b2a5-054b0d83050e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:06.232532 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-204e1685-dcf7-4893-b2a5-054b0d83050e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:06.264208 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-204e1685-dcf7-4893-b2a5-054b0d83050e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044157 May 24 15:29:06.264788 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 702/1389] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:06 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:06.342536 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-2080fc83-2c95-4af4-8c60-da2496a18d10 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:06.343429 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-2080fc83-2c95-4af4-8c60-da2496a18d10 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:06.349430 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2080fc83-2c95-4af4-8c60-da2496a18d10 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:06.349877 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2080fc83-2c95-4af4-8c60-da2496a18d10 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:06.350637 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2080fc83-2c95-4af4-8c60-da2496a18d10 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:06.351209 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2080fc83-2c95-4af4-8c60-da2496a18d10 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:06.379981 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-2080fc83-2c95-4af4-8c60-da2496a18d10 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041545 May 24 15:29:06.380553 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 688/1390] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:29:06 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:29:07.069716 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-2b4435df-d204-4501-a218-523e02353c72 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:07.070754 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-2b4435df-d204-4501-a218-523e02353c72 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:07.077294 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2b4435df-d204-4501-a218-523e02353c72 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:07.077742 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2b4435df-d204-4501-a218-523e02353c72 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:07.078504 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2b4435df-d204-4501-a218-523e02353c72 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:07.078937 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2b4435df-d204-4501-a218-523e02353c72 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:07.107457 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-2b4435df-d204-4501-a218-523e02353c72 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041726 May 24 15:29:07.108009 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 703/1391] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:07 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:07.275884 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-6e6dd4ac-1917-42e8-afc1-66cc8ba291ee tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:07.276832 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-6e6dd4ac-1917-42e8-afc1-66cc8ba291ee tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:07.286738 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6e6dd4ac-1917-42e8-afc1-66cc8ba291ee tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:07.287196 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6e6dd4ac-1917-42e8-afc1-66cc8ba291ee tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:07.287976 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6e6dd4ac-1917-42e8-afc1-66cc8ba291ee tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:07.289060 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6e6dd4ac-1917-42e8-afc1-66cc8ba291ee tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:07.317215 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-6e6dd4ac-1917-42e8-afc1-66cc8ba291ee tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045828 May 24 15:29:07.317757 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 689/1392] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:07 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:07.392208 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-6d2a5992-aca3-4b95-aff6-1e75ae03da4a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:07.393093 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-6d2a5992-aca3-4b95-aff6-1e75ae03da4a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:07.399674 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6d2a5992-aca3-4b95-aff6-1e75ae03da4a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:07.400123 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6d2a5992-aca3-4b95-aff6-1e75ae03da4a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:07.400910 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6d2a5992-aca3-4b95-aff6-1e75ae03da4a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:07.401346 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6d2a5992-aca3-4b95-aff6-1e75ae03da4a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:07.429897 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-6d2a5992-aca3-4b95-aff6-1e75ae03da4a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041798 May 24 15:29:07.430437 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 704/1393] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:29:07 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:29:08.119560 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-803edee3-f355-47bb-83a4-4d9f6d242c52 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:08.120525 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-803edee3-f355-47bb-83a4-4d9f6d242c52 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:08.126632 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-803edee3-f355-47bb-83a4-4d9f6d242c52 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:08.127070 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-803edee3-f355-47bb-83a4-4d9f6d242c52 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:08.127819 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-803edee3-f355-47bb-83a4-4d9f6d242c52 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:08.128246 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-803edee3-f355-47bb-83a4-4d9f6d242c52 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:08.156638 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-803edee3-f355-47bb-83a4-4d9f6d242c52 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041505 May 24 15:29:08.157180 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 690/1394] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:08 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:08.327665 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-6dd47952-81de-4555-9ae9-4abc521565ea tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:08.328626 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-6dd47952-81de-4555-9ae9-4abc521565ea tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:08.335959 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6dd47952-81de-4555-9ae9-4abc521565ea tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:08.336448 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6dd47952-81de-4555-9ae9-4abc521565ea tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:08.337220 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6dd47952-81de-4555-9ae9-4abc521565ea tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:08.337652 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6dd47952-81de-4555-9ae9-4abc521565ea tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:08.365789 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-6dd47952-81de-4555-9ae9-4abc521565ea tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041974 May 24 15:29:08.366330 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 705/1395] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:08 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:08.441365 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-4c95c9f6-daa2-435e-afec-d5e4b0456115 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:08.442365 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-4c95c9f6-daa2-435e-afec-d5e4b0456115 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:08.448797 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4c95c9f6-daa2-435e-afec-d5e4b0456115 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:08.449236 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4c95c9f6-daa2-435e-afec-d5e4b0456115 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:08.449991 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4c95c9f6-daa2-435e-afec-d5e4b0456115 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:08.450418 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4c95c9f6-daa2-435e-afec-d5e4b0456115 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:08.478446 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-4c95c9f6-daa2-435e-afec-d5e4b0456115 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041050 May 24 15:29:08.478982 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 691/1396] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:29:08 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:29:09.167998 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-416260e9-3f68-4b41-b1c2-27f30edd28ac tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:09.168946 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-416260e9-3f68-4b41-b1c2-27f30edd28ac tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:09.170869 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_api:SELECT=86 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:29:09.176136 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-416260e9-3f68-4b41-b1c2-27f30edd28ac tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:09.176599 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-416260e9-3f68-4b41-b1c2-27f30edd28ac tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:09.177345 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-416260e9-3f68-4b41-b1c2-27f30edd28ac tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:09.177770 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-416260e9-3f68-4b41-b1c2-27f30edd28ac tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:09.206412 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-416260e9-3f68-4b41-b1c2-27f30edd28ac tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042377 May 24 15:29:09.206955 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 706/1397] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:09 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:09.377668 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-4931cae0-ccef-4b2c-9d0f-20aebdad3db6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:09.378697 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-4931cae0-ccef-4b2c-9d0f-20aebdad3db6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:09.385321 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4931cae0-ccef-4b2c-9d0f-20aebdad3db6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:09.385772 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4931cae0-ccef-4b2c-9d0f-20aebdad3db6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:09.386698 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4931cae0-ccef-4b2c-9d0f-20aebdad3db6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:09.387131 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4931cae0-ccef-4b2c-9d0f-20aebdad3db6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:09.416169 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-4931cae0-ccef-4b2c-9d0f-20aebdad3db6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042476 May 24 15:29:09.416756 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 692/1398] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:09 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:09.490209 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e5b8efb1-100f-410d-99c2-7bfe2dcfeca0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:09.491119 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e5b8efb1-100f-410d-99c2-7bfe2dcfeca0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:09.497597 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e5b8efb1-100f-410d-99c2-7bfe2dcfeca0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:09.498036 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e5b8efb1-100f-410d-99c2-7bfe2dcfeca0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:09.498787 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e5b8efb1-100f-410d-99c2-7bfe2dcfeca0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:09.499210 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e5b8efb1-100f-410d-99c2-7bfe2dcfeca0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:09.528038 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e5b8efb1-100f-410d-99c2-7bfe2dcfeca0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041734 May 24 15:29:09.528599 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 707/1399] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:29:09 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:29:10.217558 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-5248127e-b12a-456f-a7e6-3166eda72c97 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:10.218481 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-5248127e-b12a-456f-a7e6-3166eda72c97 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:10.225001 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5248127e-b12a-456f-a7e6-3166eda72c97 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:10.225445 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5248127e-b12a-456f-a7e6-3166eda72c97 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:10.226693 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5248127e-b12a-456f-a7e6-3166eda72c97 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:10.227124 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5248127e-b12a-456f-a7e6-3166eda72c97 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:10.244247 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:29:10.259064 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-5248127e-b12a-456f-a7e6-3166eda72c97 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045465 May 24 15:29:10.259604 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 693/1400] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:10 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:10.427611 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-a616eb3a-0788-4db2-988d-12e82d32e191 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:10.428574 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-a616eb3a-0788-4db2-988d-12e82d32e191 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:10.434510 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a616eb3a-0788-4db2-988d-12e82d32e191 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:10.434958 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a616eb3a-0788-4db2-988d-12e82d32e191 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:10.435717 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a616eb3a-0788-4db2-988d-12e82d32e191 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:10.436155 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a616eb3a-0788-4db2-988d-12e82d32e191 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:10.465842 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-a616eb3a-0788-4db2-988d-12e82d32e191 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042413 May 24 15:29:10.466382 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 708/1401] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:10 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:29:10.539616 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-29718109-d86b-4ccb-9f2c-e14c488dff7c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:10.540565 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-29718109-d86b-4ccb-9f2c-e14c488dff7c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:10.546709 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-29718109-d86b-4ccb-9f2c-e14c488dff7c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:10.547161 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-29718109-d86b-4ccb-9f2c-e14c488dff7c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:10.547925 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-29718109-d86b-4ccb-9f2c-e14c488dff7c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:10.548391 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-29718109-d86b-4ccb-9f2c-e14c488dff7c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:10.576391 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-29718109-d86b-4ccb-9f2c-e14c488dff7c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041291 May 24 15:29:10.576935 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 694/1402] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:29:10 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:29:11.270651 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-759a845e-36ab-435e-a650-c8e96814ca5c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:11.271563 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-759a845e-36ab-435e-a650-c8e96814ca5c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:11.278050 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-759a845e-36ab-435e-a650-c8e96814ca5c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:11.278488 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-759a845e-36ab-435e-a650-c8e96814ca5c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:11.279235 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-759a845e-36ab-435e-a650-c8e96814ca5c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:11.279661 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-759a845e-36ab-435e-a650-c8e96814ca5c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:11.307877 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-759a845e-36ab-435e-a650-c8e96814ca5c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041261 May 24 15:29:11.308372 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 709/1403] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:11 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:11.478068 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e4612b5d-7c8a-445e-bff7-89ae59ead137 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:11.479226 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-e4612b5d-7c8a-445e-bff7-89ae59ead137 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:11.485891 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e4612b5d-7c8a-445e-bff7-89ae59ead137 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:11.486338 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e4612b5d-7c8a-445e-bff7-89ae59ead137 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:11.487105 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e4612b5d-7c8a-445e-bff7-89ae59ead137 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:11.487542 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e4612b5d-7c8a-445e-bff7-89ae59ead137 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:11.516157 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-e4612b5d-7c8a-445e-bff7-89ae59ead137 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042731 May 24 15:29:11.516720 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 695/1404] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:11 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:11.588007 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-a21c2ab1-99c0-4c4e-85fb-fa6293169d21 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:11.588865 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-a21c2ab1-99c0-4c4e-85fb-fa6293169d21 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:11.594814 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a21c2ab1-99c0-4c4e-85fb-fa6293169d21 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:11.595254 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a21c2ab1-99c0-4c4e-85fb-fa6293169d21 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:11.595999 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a21c2ab1-99c0-4c4e-85fb-fa6293169d21 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:11.596454 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a21c2ab1-99c0-4c4e-85fb-fa6293169d21 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:11.610397 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:29:11.626064 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-a21c2ab1-99c0-4c4e-85fb-fa6293169d21 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042158 May 24 15:29:11.626599 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 710/1405] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:29:11 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:29:12.319044 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d77660e7-b2e3-4069-8ee3-95b96b313830 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:12.320496 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d77660e7-b2e3-4069-8ee3-95b96b313830 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:12.326436 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d77660e7-b2e3-4069-8ee3-95b96b313830 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:12.326878 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d77660e7-b2e3-4069-8ee3-95b96b313830 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:12.327628 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d77660e7-b2e3-4069-8ee3-95b96b313830 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:12.328066 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d77660e7-b2e3-4069-8ee3-95b96b313830 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:12.356780 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d77660e7-b2e3-4069-8ee3-95b96b313830 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041602 May 24 15:29:12.357253 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 696/1406] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:12 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:12.527537 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-0317a754-117c-4cee-84ff-c7f7912c4f23 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:12.528495 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-0317a754-117c-4cee-84ff-c7f7912c4f23 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:12.535196 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0317a754-117c-4cee-84ff-c7f7912c4f23 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:12.535647 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0317a754-117c-4cee-84ff-c7f7912c4f23 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:12.536458 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0317a754-117c-4cee-84ff-c7f7912c4f23 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:12.540765 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0317a754-117c-4cee-84ff-c7f7912c4f23 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:12.569081 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-0317a754-117c-4cee-84ff-c7f7912c4f23 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046173 May 24 15:29:12.570268 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 711/1407] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:12 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:12.637558 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-b8f58ebc-8414-4990-8b3d-8139ef29efea tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:12.638411 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-b8f58ebc-8414-4990-8b3d-8139ef29efea tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:12.644786 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b8f58ebc-8414-4990-8b3d-8139ef29efea tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:12.645223 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b8f58ebc-8414-4990-8b3d-8139ef29efea tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:12.645967 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b8f58ebc-8414-4990-8b3d-8139ef29efea tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:12.646400 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b8f58ebc-8414-4990-8b3d-8139ef29efea tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:12.674850 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-b8f58ebc-8414-4990-8b3d-8139ef29efea tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041218 May 24 15:29:12.675689 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 697/1408] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:29:12 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:29:13.368315 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-2cbd6b06-ee66-48dc-8059-7fd3d08dfe6e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:13.369180 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-2cbd6b06-ee66-48dc-8059-7fd3d08dfe6e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:13.375162 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2cbd6b06-ee66-48dc-8059-7fd3d08dfe6e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:13.375604 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2cbd6b06-ee66-48dc-8059-7fd3d08dfe6e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:13.376376 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2cbd6b06-ee66-48dc-8059-7fd3d08dfe6e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:13.376808 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2cbd6b06-ee66-48dc-8059-7fd3d08dfe6e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:13.404925 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-2cbd6b06-ee66-48dc-8059-7fd3d08dfe6e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040687 May 24 15:29:13.405457 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 712/1409] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:13 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:13.581104 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-ab5b071d-7c96-4cab-becb-59f420f214b8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:13.582180 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-ab5b071d-7c96-4cab-becb-59f420f214b8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:13.589034 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ab5b071d-7c96-4cab-becb-59f420f214b8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:13.589474 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ab5b071d-7c96-4cab-becb-59f420f214b8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:13.590225 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ab5b071d-7c96-4cab-becb-59f420f214b8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:13.590654 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ab5b071d-7c96-4cab-becb-59f420f214b8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:13.619015 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-ab5b071d-7c96-4cab-becb-59f420f214b8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041765 May 24 15:29:13.619491 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 698/1410] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:13 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:13.687393 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-602fd5eb-3de4-4d4e-9e50-e5df3845bfbd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:13.688327 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-602fd5eb-3de4-4d4e-9e50-e5df3845bfbd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:13.695193 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-602fd5eb-3de4-4d4e-9e50-e5df3845bfbd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:13.695639 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-602fd5eb-3de4-4d4e-9e50-e5df3845bfbd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:13.696423 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-602fd5eb-3de4-4d4e-9e50-e5df3845bfbd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:13.696855 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-602fd5eb-3de4-4d4e-9e50-e5df3845bfbd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:13.725779 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-602fd5eb-3de4-4d4e-9e50-e5df3845bfbd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042438 May 24 15:29:13.726370 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 713/1411] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:29:13 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:29:14.416855 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-5133ac5c-c38a-4ada-8bc0-1f30140d00cb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:14.417776 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-5133ac5c-c38a-4ada-8bc0-1f30140d00cb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:14.424474 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5133ac5c-c38a-4ada-8bc0-1f30140d00cb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:14.424917 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5133ac5c-c38a-4ada-8bc0-1f30140d00cb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:14.425663 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5133ac5c-c38a-4ada-8bc0-1f30140d00cb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:14.426088 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5133ac5c-c38a-4ada-8bc0-1f30140d00cb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:14.454499 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-5133ac5c-c38a-4ada-8bc0-1f30140d00cb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042152 May 24 15:29:14.455037 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 699/1412] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:14 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:14.630285 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-5f132c13-c502-4485-9e88-231edd2b3bcc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:14.631204 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-5f132c13-c502-4485-9e88-231edd2b3bcc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:14.637203 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5f132c13-c502-4485-9e88-231edd2b3bcc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:14.637651 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5f132c13-c502-4485-9e88-231edd2b3bcc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:14.638403 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5f132c13-c502-4485-9e88-231edd2b3bcc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:14.638828 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5f132c13-c502-4485-9e88-231edd2b3bcc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:14.667232 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-5f132c13-c502-4485-9e88-231edd2b3bcc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040880 May 24 15:29:14.667770 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 714/1413] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:14 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:14.737590 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d96e6319-45d9-421a-bca5-b74a4fca9dfd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:14.738525 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d96e6319-45d9-421a-bca5-b74a4fca9dfd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:14.745313 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d96e6319-45d9-421a-bca5-b74a4fca9dfd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:14.745762 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d96e6319-45d9-421a-bca5-b74a4fca9dfd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:14.746523 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d96e6319-45d9-421a-bca5-b74a4fca9dfd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:14.746960 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d96e6319-45d9-421a-bca5-b74a4fca9dfd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:14.775251 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d96e6319-45d9-421a-bca5-b74a4fca9dfd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041956 May 24 15:29:14.775795 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 700/1414] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:29:14 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:29:15.466604 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c89154ad-0704-432f-adcf-6a7b3d38d94e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:15.467527 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-c89154ad-0704-432f-adcf-6a7b3d38d94e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:15.474020 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c89154ad-0704-432f-adcf-6a7b3d38d94e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:15.474468 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c89154ad-0704-432f-adcf-6a7b3d38d94e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:15.475228 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c89154ad-0704-432f-adcf-6a7b3d38d94e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:15.475661 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c89154ad-0704-432f-adcf-6a7b3d38d94e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:15.503565 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-c89154ad-0704-432f-adcf-6a7b3d38d94e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040949 May 24 15:29:15.504112 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 715/1415] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:15 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:15.678607 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-540480de-a4d9-447f-8580-e84ec26c1b6d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:15.680028 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-540480de-a4d9-447f-8580-e84ec26c1b6d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:15.686535 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-540480de-a4d9-447f-8580-e84ec26c1b6d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:15.686986 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-540480de-a4d9-447f-8580-e84ec26c1b6d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:15.687746 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-540480de-a4d9-447f-8580-e84ec26c1b6d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:15.688176 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-540480de-a4d9-447f-8580-e84ec26c1b6d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:15.716218 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-540480de-a4d9-447f-8580-e84ec26c1b6d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041601 May 24 15:29:15.717011 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 701/1416] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:15 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:15.786652 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-29499fd7-e824-46ce-a0c4-7bcd6129c5c4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:15.787569 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-29499fd7-e824-46ce-a0c4-7bcd6129c5c4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:15.793840 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-29499fd7-e824-46ce-a0c4-7bcd6129c5c4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:15.794286 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-29499fd7-e824-46ce-a0c4-7bcd6129c5c4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:15.795030 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-29499fd7-e824-46ce-a0c4-7bcd6129c5c4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:15.795455 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-29499fd7-e824-46ce-a0c4-7bcd6129c5c4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:15.824742 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-29499fd7-e824-46ce-a0c4-7bcd6129c5c4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041988 May 24 15:29:15.825288 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 716/1417] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:29:15 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:29:16.515440 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-2f9fe847-5e98-4f64-ad00-e53a1148d95b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:16.516402 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-2f9fe847-5e98-4f64-ad00-e53a1148d95b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:16.522400 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2f9fe847-5e98-4f64-ad00-e53a1148d95b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:16.523345 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2f9fe847-5e98-4f64-ad00-e53a1148d95b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:16.524114 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2f9fe847-5e98-4f64-ad00-e53a1148d95b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:16.524573 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2f9fe847-5e98-4f64-ad00-e53a1148d95b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:16.553064 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-2f9fe847-5e98-4f64-ad00-e53a1148d95b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041663 May 24 15:29:16.553605 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 702/1418] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:16 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:16.726917 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-9e7cf8c6-3984-4d38-80ae-3baf6684f9f2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:16.727843 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-9e7cf8c6-3984-4d38-80ae-3baf6684f9f2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:16.734537 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9e7cf8c6-3984-4d38-80ae-3baf6684f9f2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:16.734987 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9e7cf8c6-3984-4d38-80ae-3baf6684f9f2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:16.735745 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9e7cf8c6-3984-4d38-80ae-3baf6684f9f2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:16.736180 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9e7cf8c6-3984-4d38-80ae-3baf6684f9f2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:16.764141 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-9e7cf8c6-3984-4d38-80ae-3baf6684f9f2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041116 May 24 15:29:16.764727 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 717/1419] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:16 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:16.836971 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-918cdec6-083d-45a9-be5b-ccbae1676a31 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:16.837851 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-918cdec6-083d-45a9-be5b-ccbae1676a31 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:16.844200 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-918cdec6-083d-45a9-be5b-ccbae1676a31 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:16.844675 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-918cdec6-083d-45a9-be5b-ccbae1676a31 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:16.845428 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-918cdec6-083d-45a9-be5b-ccbae1676a31 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:16.845854 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-918cdec6-083d-45a9-be5b-ccbae1676a31 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:16.875293 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-918cdec6-083d-45a9-be5b-ccbae1676a31 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042899 May 24 15:29:16.875848 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 703/1420] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:29:16 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:29:17.564697 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-7895d2d9-e122-43c6-bd12-7cd83bece0be tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:17.565651 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-7895d2d9-e122-43c6-bd12-7cd83bece0be tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:17.571709 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7895d2d9-e122-43c6-bd12-7cd83bece0be tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:17.572155 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7895d2d9-e122-43c6-bd12-7cd83bece0be tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:17.572949 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7895d2d9-e122-43c6-bd12-7cd83bece0be tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:17.573384 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7895d2d9-e122-43c6-bd12-7cd83bece0be tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:17.601611 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-7895d2d9-e122-43c6-bd12-7cd83bece0be tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040404 May 24 15:29:17.602144 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 718/1421] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:17 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:17.775355 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-df29b820-d30b-44da-9802-2e8948b87f03 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:17.776278 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-df29b820-d30b-44da-9802-2e8948b87f03 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:17.782318 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-df29b820-d30b-44da-9802-2e8948b87f03 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:17.782759 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-df29b820-d30b-44da-9802-2e8948b87f03 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:17.783507 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-df29b820-d30b-44da-9802-2e8948b87f03 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:17.783927 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-df29b820-d30b-44da-9802-2e8948b87f03 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:17.812379 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-df29b820-d30b-44da-9802-2e8948b87f03 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041365 May 24 15:29:17.812934 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 704/1422] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:17 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:17.886862 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-7000b9f3-e17b-45af-a712-029aacce4c71 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:17.887809 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-7000b9f3-e17b-45af-a712-029aacce4c71 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:17.894227 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7000b9f3-e17b-45af-a712-029aacce4c71 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:17.894668 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7000b9f3-e17b-45af-a712-029aacce4c71 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:17.895415 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7000b9f3-e17b-45af-a712-029aacce4c71 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:17.895844 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7000b9f3-e17b-45af-a712-029aacce4c71 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:17.924715 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-7000b9f3-e17b-45af-a712-029aacce4c71 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041785 May 24 15:29:17.925256 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 719/1423] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:29:17 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:29:18.613426 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-439696f3-22c0-4c91-bf5d-9919edd43fc8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:18.614281 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-439696f3-22c0-4c91-bf5d-9919edd43fc8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:18.621401 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-439696f3-22c0-4c91-bf5d-9919edd43fc8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:18.621846 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-439696f3-22c0-4c91-bf5d-9919edd43fc8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:18.622606 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-439696f3-22c0-4c91-bf5d-9919edd43fc8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:18.623036 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-439696f3-22c0-4c91-bf5d-9919edd43fc8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:18.651871 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-439696f3-22c0-4c91-bf5d-9919edd43fc8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042758 May 24 15:29:18.652432 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 705/1424] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:18 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:18.823717 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-5e931c68-a66c-4eb1-8549-b81d0973dab5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:18.824737 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-5e931c68-a66c-4eb1-8549-b81d0973dab5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:18.830647 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5e931c68-a66c-4eb1-8549-b81d0973dab5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:18.831085 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5e931c68-a66c-4eb1-8549-b81d0973dab5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:18.831827 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5e931c68-a66c-4eb1-8549-b81d0973dab5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:18.832252 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5e931c68-a66c-4eb1-8549-b81d0973dab5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:18.859716 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-5e931c68-a66c-4eb1-8549-b81d0973dab5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040513 May 24 15:29:18.860252 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 720/1425] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:18 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:18.936441 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-85d4b916-1e9c-466e-af1f-f024ba2caece tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:18.937329 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-85d4b916-1e9c-466e-af1f-f024ba2caece tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:18.943336 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-85d4b916-1e9c-466e-af1f-f024ba2caece tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:18.943781 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-85d4b916-1e9c-466e-af1f-f024ba2caece tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:18.944558 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-85d4b916-1e9c-466e-af1f-f024ba2caece tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:18.944991 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-85d4b916-1e9c-466e-af1f-f024ba2caece tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:18.972647 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-85d4b916-1e9c-466e-af1f-f024ba2caece tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040313 May 24 15:29:18.973187 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 706/1426] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:29:18 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:29:19.663516 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-bc28dfba-3d92-42bd-902f-7d7d05f1ad43 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:19.664391 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-bc28dfba-3d92-42bd-902f-7d7d05f1ad43 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:19.670934 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bc28dfba-3d92-42bd-902f-7d7d05f1ad43 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:19.671385 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bc28dfba-3d92-42bd-902f-7d7d05f1ad43 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:19.672140 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bc28dfba-3d92-42bd-902f-7d7d05f1ad43 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:19.672606 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bc28dfba-3d92-42bd-902f-7d7d05f1ad43 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:19.700598 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-bc28dfba-3d92-42bd-902f-7d7d05f1ad43 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041119 May 24 15:29:19.701137 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 721/1427] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:19 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:19.871197 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-6476d696-1a2d-4cf5-b6bb-b22b139e8e83 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:19.872114 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-6476d696-1a2d-4cf5-b6bb-b22b139e8e83 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:19.878609 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6476d696-1a2d-4cf5-b6bb-b22b139e8e83 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:19.879042 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6476d696-1a2d-4cf5-b6bb-b22b139e8e83 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:19.879791 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6476d696-1a2d-4cf5-b6bb-b22b139e8e83 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:19.880215 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6476d696-1a2d-4cf5-b6bb-b22b139e8e83 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:19.911341 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-6476d696-1a2d-4cf5-b6bb-b22b139e8e83 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044035 May 24 15:29:19.911887 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 707/1428] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:19 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:19.985161 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-8dd47185-173c-456f-a52b-b9e6caa82626 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:19.986143 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-8dd47185-173c-456f-a52b-b9e6caa82626 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:19.992123 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8dd47185-173c-456f-a52b-b9e6caa82626 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:19.992598 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8dd47185-173c-456f-a52b-b9e6caa82626 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:19.993352 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8dd47185-173c-456f-a52b-b9e6caa82626 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:19.993786 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8dd47185-173c-456f-a52b-b9e6caa82626 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:20.021999 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-8dd47185-173c-456f-a52b-b9e6caa82626 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041330 May 24 15:29:20.023168 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 722/1429] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:29:19 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:29:20.711029 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a9dda177-0aa2-45d0-85a5-2bb01317cba4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:20.711946 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a9dda177-0aa2-45d0-85a5-2bb01317cba4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:20.717982 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a9dda177-0aa2-45d0-85a5-2bb01317cba4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:20.718450 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a9dda177-0aa2-45d0-85a5-2bb01317cba4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:20.719201 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a9dda177-0aa2-45d0-85a5-2bb01317cba4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:20.719629 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a9dda177-0aa2-45d0-85a5-2bb01317cba4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:20.750257 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a9dda177-0aa2-45d0-85a5-2bb01317cba4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043198 May 24 15:29:20.750812 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 708/1430] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:20 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:20.922225 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-0b89122e-6a07-49b5-a075-2409c563d0c5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:20.923235 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-0b89122e-6a07-49b5-a075-2409c563d0c5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:20.929271 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0b89122e-6a07-49b5-a075-2409c563d0c5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:20.929709 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0b89122e-6a07-49b5-a075-2409c563d0c5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:20.930478 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0b89122e-6a07-49b5-a075-2409c563d0c5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:20.930907 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0b89122e-6a07-49b5-a075-2409c563d0c5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:20.960870 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-0b89122e-6a07-49b5-a075-2409c563d0c5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041970 May 24 15:29:20.961434 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 723/1431] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:20 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:21.033766 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-1cdb662c-30e2-49b7-8b35-268a2a3e1a36 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:21.034709 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-1cdb662c-30e2-49b7-8b35-268a2a3e1a36 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:21.041687 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1cdb662c-30e2-49b7-8b35-268a2a3e1a36 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:21.042124 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1cdb662c-30e2-49b7-8b35-268a2a3e1a36 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:21.042875 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1cdb662c-30e2-49b7-8b35-268a2a3e1a36 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:21.043299 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1cdb662c-30e2-49b7-8b35-268a2a3e1a36 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:21.072706 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-1cdb662c-30e2-49b7-8b35-268a2a3e1a36 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042831 May 24 15:29:21.073270 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 709/1432] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:29:21 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:29:21.762357 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-1a900fa2-ffed-4233-8040-d97091b3b3c3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:21.763317 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-1a900fa2-ffed-4233-8040-d97091b3b3c3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:21.770054 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1a900fa2-ffed-4233-8040-d97091b3b3c3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:21.770491 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1a900fa2-ffed-4233-8040-d97091b3b3c3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:21.771237 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1a900fa2-ffed-4233-8040-d97091b3b3c3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:21.771661 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1a900fa2-ffed-4233-8040-d97091b3b3c3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:21.800877 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-1a900fa2-ffed-4233-8040-d97091b3b3c3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042273 May 24 15:29:21.801721 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 724/1433] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:21 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:21.972249 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-4b1d8837-5a64-4c54-9564-9dc7f125f684 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:21.973205 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-4b1d8837-5a64-4c54-9564-9dc7f125f684 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:21.979734 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4b1d8837-5a64-4c54-9564-9dc7f125f684 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:21.980177 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4b1d8837-5a64-4c54-9564-9dc7f125f684 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:21.980964 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4b1d8837-5a64-4c54-9564-9dc7f125f684 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:21.981398 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4b1d8837-5a64-4c54-9564-9dc7f125f684 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:21.985205 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:29:22.010650 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-4b1d8837-5a64-4c54-9564-9dc7f125f684 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042304 May 24 15:29:22.011193 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 710/1434] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:21 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:22.083264 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-a5acc6fb-ecf3-4767-bfcb-d810a629fb78 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:22.084218 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-a5acc6fb-ecf3-4767-bfcb-d810a629fb78 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:22.090265 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a5acc6fb-ecf3-4767-bfcb-d810a629fb78 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:22.090708 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a5acc6fb-ecf3-4767-bfcb-d810a629fb78 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:22.091461 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a5acc6fb-ecf3-4767-bfcb-d810a629fb78 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:22.091892 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a5acc6fb-ecf3-4767-bfcb-d810a629fb78 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:22.121251 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-a5acc6fb-ecf3-4767-bfcb-d810a629fb78 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041996 May 24 15:29:22.121795 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 725/1435] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:29:22 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:29:22.813196 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-6161b7f9-4c30-46f2-bb96-86287c588fa8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:22.814127 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-6161b7f9-4c30-46f2-bb96-86287c588fa8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:22.821406 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6161b7f9-4c30-46f2-bb96-86287c588fa8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:22.821847 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6161b7f9-4c30-46f2-bb96-86287c588fa8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:22.822652 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6161b7f9-4c30-46f2-bb96-86287c588fa8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:22.823080 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6161b7f9-4c30-46f2-bb96-86287c588fa8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:22.851723 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-6161b7f9-4c30-46f2-bb96-86287c588fa8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042542 May 24 15:29:22.852261 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 711/1436] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:22 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:23.022026 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-15cd9b6f-7a2c-4d5a-a1ad-1d550cf4d946 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:23.023584 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-15cd9b6f-7a2c-4d5a-a1ad-1d550cf4d946 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:23.030000 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-15cd9b6f-7a2c-4d5a-a1ad-1d550cf4d946 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:23.030442 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-15cd9b6f-7a2c-4d5a-a1ad-1d550cf4d946 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:23.031189 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-15cd9b6f-7a2c-4d5a-a1ad-1d550cf4d946 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:23.031616 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-15cd9b6f-7a2c-4d5a-a1ad-1d550cf4d946 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:23.059789 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-15cd9b6f-7a2c-4d5a-a1ad-1d550cf4d946 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041711 May 24 15:29:23.060341 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 726/1437] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:23 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:23.133002 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-129c5f98-69e1-425d-a352-985cada7bd8a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:23.133955 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-129c5f98-69e1-425d-a352-985cada7bd8a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:23.139949 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-129c5f98-69e1-425d-a352-985cada7bd8a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:23.140430 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-129c5f98-69e1-425d-a352-985cada7bd8a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:23.141191 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-129c5f98-69e1-425d-a352-985cada7bd8a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:23.141625 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-129c5f98-69e1-425d-a352-985cada7bd8a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:23.169374 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-129c5f98-69e1-425d-a352-985cada7bd8a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041001 May 24 15:29:23.169911 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 712/1438] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:29:23 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:29:23.862840 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e0f10b50-a7dc-421a-bcf3-7da949876b4c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:23.863756 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e0f10b50-a7dc-421a-bcf3-7da949876b4c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:23.869688 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e0f10b50-a7dc-421a-bcf3-7da949876b4c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:23.870132 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e0f10b50-a7dc-421a-bcf3-7da949876b4c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:23.870877 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e0f10b50-a7dc-421a-bcf3-7da949876b4c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:23.871303 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e0f10b50-a7dc-421a-bcf3-7da949876b4c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:23.875961 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:29:23.902545 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e0f10b50-a7dc-421a-bcf3-7da949876b4c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043996 May 24 15:29:23.903088 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 727/1439] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:23 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:24.070931 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-34f9a195-4e7f-4eb8-b643-a76b03b9f81b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:24.071863 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-34f9a195-4e7f-4eb8-b643-a76b03b9f81b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:24.078474 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-34f9a195-4e7f-4eb8-b643-a76b03b9f81b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:24.078922 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-34f9a195-4e7f-4eb8-b643-a76b03b9f81b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:24.079691 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-34f9a195-4e7f-4eb8-b643-a76b03b9f81b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:24.080129 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-34f9a195-4e7f-4eb8-b643-a76b03b9f81b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:24.109105 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-34f9a195-4e7f-4eb8-b643-a76b03b9f81b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042068 May 24 15:29:24.109912 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 713/1440] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:24 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:24.180900 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-17c94948-383d-4512-80c0-5321510bd6cc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:24.181776 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-17c94948-383d-4512-80c0-5321510bd6cc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:24.188116 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-17c94948-383d-4512-80c0-5321510bd6cc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:24.188595 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-17c94948-383d-4512-80c0-5321510bd6cc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:24.189337 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-17c94948-383d-4512-80c0-5321510bd6cc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:24.189765 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-17c94948-383d-4512-80c0-5321510bd6cc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:24.218167 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-17c94948-383d-4512-80c0-5321510bd6cc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041424 May 24 15:29:24.218695 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 728/1441] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:29:24 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:29:24.914326 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-4ecd4b9b-8f57-476e-b161-439f246695be tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:24.915216 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-4ecd4b9b-8f57-476e-b161-439f246695be tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:24.921348 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4ecd4b9b-8f57-476e-b161-439f246695be tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:24.921821 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4ecd4b9b-8f57-476e-b161-439f246695be tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:24.922570 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4ecd4b9b-8f57-476e-b161-439f246695be tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:24.922995 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4ecd4b9b-8f57-476e-b161-439f246695be tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:24.951368 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-4ecd4b9b-8f57-476e-b161-439f246695be tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041513 May 24 15:29:24.951910 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 714/1442] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:24 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:25.121405 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-cb03b124-0754-4f06-a332-f2e74bd28974 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:25.122405 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-cb03b124-0754-4f06-a332-f2e74bd28974 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:25.128348 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cb03b124-0754-4f06-a332-f2e74bd28974 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:25.128791 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cb03b124-0754-4f06-a332-f2e74bd28974 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:25.129538 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cb03b124-0754-4f06-a332-f2e74bd28974 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:25.129968 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cb03b124-0754-4f06-a332-f2e74bd28974 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:25.157013 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-cb03b124-0754-4f06-a332-f2e74bd28974 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039506 May 24 15:29:25.157555 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 729/1443] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:25 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:25.230102 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-c1c526dc-adbb-48c2-8be6-65897b000b5e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:25.231089 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-c1c526dc-adbb-48c2-8be6-65897b000b5e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:25.237760 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c1c526dc-adbb-48c2-8be6-65897b000b5e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:25.238204 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c1c526dc-adbb-48c2-8be6-65897b000b5e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:25.238962 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c1c526dc-adbb-48c2-8be6-65897b000b5e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:25.239397 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c1c526dc-adbb-48c2-8be6-65897b000b5e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:25.268305 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-c1c526dc-adbb-48c2-8be6-65897b000b5e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042612 May 24 15:29:25.268878 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 715/1444] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:29:25 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:29:25.963503 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d4ef0925-23a3-4df1-8006-ac346d0256f4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:25.964478 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d4ef0925-23a3-4df1-8006-ac346d0256f4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:25.970871 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d4ef0925-23a3-4df1-8006-ac346d0256f4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:25.971312 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d4ef0925-23a3-4df1-8006-ac346d0256f4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:25.972065 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d4ef0925-23a3-4df1-8006-ac346d0256f4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:25.972539 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d4ef0925-23a3-4df1-8006-ac346d0256f4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:26.000149 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d4ef0925-23a3-4df1-8006-ac346d0256f4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041347 May 24 15:29:26.000715 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 730/1445] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:25 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:26.167714 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d6bc47ef-21a3-46c1-800e-867dde950610 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:26.168688 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d6bc47ef-21a3-46c1-800e-867dde950610 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:26.174651 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d6bc47ef-21a3-46c1-800e-867dde950610 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:26.175094 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d6bc47ef-21a3-46c1-800e-867dde950610 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:26.175843 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d6bc47ef-21a3-46c1-800e-867dde950610 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:26.176270 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d6bc47ef-21a3-46c1-800e-867dde950610 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:26.204695 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d6bc47ef-21a3-46c1-800e-867dde950610 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040956 May 24 15:29:26.205234 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 716/1446] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:26 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:26.279031 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-f7dd9124-5c6b-454f-bab2-415b54e458a2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:26.279988 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-f7dd9124-5c6b-454f-bab2-415b54e458a2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:26.286022 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f7dd9124-5c6b-454f-bab2-415b54e458a2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:26.286471 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f7dd9124-5c6b-454f-bab2-415b54e458a2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:26.287224 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f7dd9124-5c6b-454f-bab2-415b54e458a2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:26.287658 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f7dd9124-5c6b-454f-bab2-415b54e458a2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:26.316046 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-f7dd9124-5c6b-454f-bab2-415b54e458a2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040951 May 24 15:29:26.316635 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 731/1447] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:29:26 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:29:27.011181 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a8183fc7-a046-4309-bb84-c6263dbcbe50 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:27.012133 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a8183fc7-a046-4309-bb84-c6263dbcbe50 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:27.018883 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a8183fc7-a046-4309-bb84-c6263dbcbe50 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:27.019321 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a8183fc7-a046-4309-bb84-c6263dbcbe50 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:27.020074 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a8183fc7-a046-4309-bb84-c6263dbcbe50 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:27.020547 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a8183fc7-a046-4309-bb84-c6263dbcbe50 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:27.049468 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a8183fc7-a046-4309-bb84-c6263dbcbe50 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042293 May 24 15:29:27.050015 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 717/1448] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:27 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:27.215510 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-a41a9fbb-2759-4fa3-88f9-2c0ace556cfc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:27.216460 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-a41a9fbb-2759-4fa3-88f9-2c0ace556cfc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:27.223134 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a41a9fbb-2759-4fa3-88f9-2c0ace556cfc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:27.223582 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a41a9fbb-2759-4fa3-88f9-2c0ace556cfc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:27.224365 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a41a9fbb-2759-4fa3-88f9-2c0ace556cfc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:27.224812 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a41a9fbb-2759-4fa3-88f9-2c0ace556cfc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:27.252655 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-a41a9fbb-2759-4fa3-88f9-2c0ace556cfc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040892 May 24 15:29:27.253458 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 732/1449] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:27 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:27.327437 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-150c4edd-c26d-4145-a840-4ed9e3327d76 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:27.328282 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-150c4edd-c26d-4145-a840-4ed9e3327d76 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:27.334218 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-150c4edd-c26d-4145-a840-4ed9e3327d76 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:27.334651 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-150c4edd-c26d-4145-a840-4ed9e3327d76 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:27.336066 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-150c4edd-c26d-4145-a840-4ed9e3327d76 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:27.336524 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-150c4edd-c26d-4145-a840-4ed9e3327d76 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:27.365199 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-150c4edd-c26d-4145-a840-4ed9e3327d76 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041804 May 24 15:29:27.365749 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 718/1450] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:29:27 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:29:28.061103 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-a3320780-667d-43c1-9afd-eace13cd0359 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:28.062053 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-a3320780-667d-43c1-9afd-eace13cd0359 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:28.068096 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a3320780-667d-43c1-9afd-eace13cd0359 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:28.068578 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a3320780-667d-43c1-9afd-eace13cd0359 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:28.069837 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a3320780-667d-43c1-9afd-eace13cd0359 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:28.070272 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a3320780-667d-43c1-9afd-eace13cd0359 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:28.099298 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-a3320780-667d-43c1-9afd-eace13cd0359 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042176 May 24 15:29:28.099844 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 733/1451] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:28 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:28.264234 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-9a78ff4d-c23c-4a7e-922a-32407decfe5a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:28.265194 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-9a78ff4d-c23c-4a7e-922a-32407decfe5a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:28.271623 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9a78ff4d-c23c-4a7e-922a-32407decfe5a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:28.272074 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9a78ff4d-c23c-4a7e-922a-32407decfe5a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:28.273545 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9a78ff4d-c23c-4a7e-922a-32407decfe5a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:28.273982 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9a78ff4d-c23c-4a7e-922a-32407decfe5a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:28.302412 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-9a78ff4d-c23c-4a7e-922a-32407decfe5a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042152 May 24 15:29:28.302957 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 719/1452] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:28 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:28.376763 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-31224f04-3f86-4956-b411-94358ea09fbc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:28.377708 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-31224f04-3f86-4956-b411-94358ea09fbc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:28.384764 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-31224f04-3f86-4956-b411-94358ea09fbc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:28.385239 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-31224f04-3f86-4956-b411-94358ea09fbc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:28.385999 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-31224f04-3f86-4956-b411-94358ea09fbc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:28.386429 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-31224f04-3f86-4956-b411-94358ea09fbc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:28.415364 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-31224f04-3f86-4956-b411-94358ea09fbc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042644 May 24 15:29:28.415889 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 734/1453] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:29:28 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:29:29.111020 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-be03e381-2107-4bcf-a000-5e9dc2985e6a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:29.111933 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-be03e381-2107-4bcf-a000-5e9dc2985e6a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:29.118101 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-be03e381-2107-4bcf-a000-5e9dc2985e6a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:29.118543 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-be03e381-2107-4bcf-a000-5e9dc2985e6a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:29.119293 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-be03e381-2107-4bcf-a000-5e9dc2985e6a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:29.119730 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-be03e381-2107-4bcf-a000-5e9dc2985e6a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:29.148708 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-be03e381-2107-4bcf-a000-5e9dc2985e6a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041916 May 24 15:29:29.149241 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 720/1454] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:29 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:29.313910 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c5db980c-4b8f-4831-9625-7d7665b8a926 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:29.314832 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-c5db980c-4b8f-4831-9625-7d7665b8a926 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:29.320912 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c5db980c-4b8f-4831-9625-7d7665b8a926 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:29.321306 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c5db980c-4b8f-4831-9625-7d7665b8a926 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:29.322058 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c5db980c-4b8f-4831-9625-7d7665b8a926 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:29.322490 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c5db980c-4b8f-4831-9625-7d7665b8a926 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:29.350375 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-c5db980c-4b8f-4831-9625-7d7665b8a926 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040303 May 24 15:29:29.351649 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 735/1455] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:29 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:29.426897 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f917b122-7fdd-4462-aed0-694c827b68cc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:29.427841 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f917b122-7fdd-4462-aed0-694c827b68cc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:29.434246 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f917b122-7fdd-4462-aed0-694c827b68cc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:29.434686 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f917b122-7fdd-4462-aed0-694c827b68cc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:29.435434 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f917b122-7fdd-4462-aed0-694c827b68cc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:29.436094 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f917b122-7fdd-4462-aed0-694c827b68cc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:29.465209 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f917b122-7fdd-4462-aed0-694c827b68cc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042274 May 24 15:29:29.465749 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 721/1456] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:29:29 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:29:30.160310 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-5b6b5fff-0059-449c-9247-2485b3fc4b80 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:30.161251 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-5b6b5fff-0059-449c-9247-2485b3fc4b80 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:30.168213 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5b6b5fff-0059-449c-9247-2485b3fc4b80 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:30.168694 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5b6b5fff-0059-449c-9247-2485b3fc4b80 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:30.169453 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5b6b5fff-0059-449c-9247-2485b3fc4b80 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:30.169888 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5b6b5fff-0059-449c-9247-2485b3fc4b80 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:30.198248 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-5b6b5fff-0059-449c-9247-2485b3fc4b80 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041968 May 24 15:29:30.198786 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 736/1457] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:30 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:30.362620 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-10ff97b9-4000-400a-9d13-78f0fbff3830 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:30.363580 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-10ff97b9-4000-400a-9d13-78f0fbff3830 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:30.365465 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_api:SELECT=88 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:29:30.371284 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-10ff97b9-4000-400a-9d13-78f0fbff3830 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:30.371731 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-10ff97b9-4000-400a-9d13-78f0fbff3830 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:30.372535 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-10ff97b9-4000-400a-9d13-78f0fbff3830 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:30.372972 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-10ff97b9-4000-400a-9d13-78f0fbff3830 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:30.401048 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-10ff97b9-4000-400a-9d13-78f0fbff3830 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042561 May 24 15:29:30.401600 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 722/1458] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:30 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:30.477077 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-f32e2264-7a8f-4bb6-ae80-ba5109d6f5f3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:30.477984 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-f32e2264-7a8f-4bb6-ae80-ba5109d6f5f3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:30.483862 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f32e2264-7a8f-4bb6-ae80-ba5109d6f5f3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:30.484322 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f32e2264-7a8f-4bb6-ae80-ba5109d6f5f3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:30.485338 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f32e2264-7a8f-4bb6-ae80-ba5109d6f5f3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:30.485762 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f32e2264-7a8f-4bb6-ae80-ba5109d6f5f3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:30.514183 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-f32e2264-7a8f-4bb6-ae80-ba5109d6f5f3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041538 May 24 15:29:30.514720 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 737/1459] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:29:30 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:29:31.209715 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-6a76a4b2-d0f8-4907-96d8-bdb35f8c9645 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:31.211277 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-6a76a4b2-d0f8-4907-96d8-bdb35f8c9645 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:31.217753 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6a76a4b2-d0f8-4907-96d8-bdb35f8c9645 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:31.218199 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6a76a4b2-d0f8-4907-96d8-bdb35f8c9645 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:31.218956 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6a76a4b2-d0f8-4907-96d8-bdb35f8c9645 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:31.219387 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6a76a4b2-d0f8-4907-96d8-bdb35f8c9645 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:31.248122 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-6a76a4b2-d0f8-4907-96d8-bdb35f8c9645 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042398 May 24 15:29:31.248710 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 723/1460] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:31 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:31.412404 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-52ef45cf-666a-4bb5-ac28-b3bc6b900d7f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:31.413350 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-52ef45cf-666a-4bb5-ac28-b3bc6b900d7f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:31.419703 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-52ef45cf-666a-4bb5-ac28-b3bc6b900d7f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:31.420143 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-52ef45cf-666a-4bb5-ac28-b3bc6b900d7f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:31.420943 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-52ef45cf-666a-4bb5-ac28-b3bc6b900d7f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:31.421374 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-52ef45cf-666a-4bb5-ac28-b3bc6b900d7f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:31.450586 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-52ef45cf-666a-4bb5-ac28-b3bc6b900d7f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042116 May 24 15:29:31.451138 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 738/1461] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:31 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:31.525676 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-9ab7db78-69d9-4561-9671-c7afa6cc0870 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:31.526598 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-9ab7db78-69d9-4561-9671-c7afa6cc0870 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:31.532595 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9ab7db78-69d9-4561-9671-c7afa6cc0870 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:31.533044 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9ab7db78-69d9-4561-9671-c7afa6cc0870 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:31.533803 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9ab7db78-69d9-4561-9671-c7afa6cc0870 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:31.534236 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9ab7db78-69d9-4561-9671-c7afa6cc0870 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:31.562470 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-9ab7db78-69d9-4561-9671-c7afa6cc0870 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040786 May 24 15:29:31.563009 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 724/1462] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:29:31 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:29:32.259900 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-a1ff14d8-8e21-4110-a31a-9239605bd3ab tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:32.260838 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-a1ff14d8-8e21-4110-a31a-9239605bd3ab tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:32.266897 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a1ff14d8-8e21-4110-a31a-9239605bd3ab tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:32.267346 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a1ff14d8-8e21-4110-a31a-9239605bd3ab tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:32.268089 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a1ff14d8-8e21-4110-a31a-9239605bd3ab tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:32.268541 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a1ff14d8-8e21-4110-a31a-9239605bd3ab tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:32.297873 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-a1ff14d8-8e21-4110-a31a-9239605bd3ab tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042300 May 24 15:29:32.298410 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 739/1463] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:32 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:32.462135 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-abe6a903-b690-46fd-8e8b-09cec273e9a0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:32.463058 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-abe6a903-b690-46fd-8e8b-09cec273e9a0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:32.469476 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-abe6a903-b690-46fd-8e8b-09cec273e9a0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:32.469923 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-abe6a903-b690-46fd-8e8b-09cec273e9a0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:32.470682 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-abe6a903-b690-46fd-8e8b-09cec273e9a0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:32.471117 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-abe6a903-b690-46fd-8e8b-09cec273e9a0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:32.498971 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-abe6a903-b690-46fd-8e8b-09cec273e9a0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041433 May 24 15:29:32.499509 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 725/1464] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:32 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:32.574303 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e2de9ee3-5d1f-4610-a70f-e32f89dec072 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:32.575233 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e2de9ee3-5d1f-4610-a70f-e32f89dec072 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:32.581565 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e2de9ee3-5d1f-4610-a70f-e32f89dec072 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:32.582033 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e2de9ee3-5d1f-4610-a70f-e32f89dec072 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:32.582782 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e2de9ee3-5d1f-4610-a70f-e32f89dec072 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:32.583208 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e2de9ee3-5d1f-4610-a70f-e32f89dec072 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:32.611910 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e2de9ee3-5d1f-4610-a70f-e32f89dec072 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042363 May 24 15:29:32.612545 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 740/1465] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:29:32 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:29:33.309044 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a64c2e29-ba84-4298-9a1b-dbe7bd1d7828 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:33.309962 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a64c2e29-ba84-4298-9a1b-dbe7bd1d7828 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:33.315964 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a64c2e29-ba84-4298-9a1b-dbe7bd1d7828 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:33.316440 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a64c2e29-ba84-4298-9a1b-dbe7bd1d7828 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:33.317191 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a64c2e29-ba84-4298-9a1b-dbe7bd1d7828 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:33.317619 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a64c2e29-ba84-4298-9a1b-dbe7bd1d7828 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:33.341513 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:29:33.346271 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a64c2e29-ba84-4298-9a1b-dbe7bd1d7828 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041223 May 24 15:29:33.346824 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 726/1466] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:33 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:33.510292 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-14a507c4-5822-4f76-9b47-7a998bfb1529 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:33.511207 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-14a507c4-5822-4f76-9b47-7a998bfb1529 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:33.517168 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-14a507c4-5822-4f76-9b47-7a998bfb1529 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:33.517607 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-14a507c4-5822-4f76-9b47-7a998bfb1529 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:33.518354 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-14a507c4-5822-4f76-9b47-7a998bfb1529 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:33.518781 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-14a507c4-5822-4f76-9b47-7a998bfb1529 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:33.547044 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-14a507c4-5822-4f76-9b47-7a998bfb1529 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040680 May 24 15:29:33.547576 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 741/1467] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:33 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:33.623437 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f3532ce7-f848-4f81-ac7c-d6b3378a14e1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:33.624293 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f3532ce7-f848-4f81-ac7c-d6b3378a14e1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:33.630853 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f3532ce7-f848-4f81-ac7c-d6b3378a14e1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:33.631298 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f3532ce7-f848-4f81-ac7c-d6b3378a14e1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:33.632051 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f3532ce7-f848-4f81-ac7c-d6b3378a14e1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:33.632518 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f3532ce7-f848-4f81-ac7c-d6b3378a14e1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:33.660885 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f3532ce7-f848-4f81-ac7c-d6b3378a14e1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041470 May 24 15:29:33.661425 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 727/1468] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:29:33 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:29:34.357507 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-dd239cdd-1e9c-4a41-95b9-d3d7485aa3ff tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:34.358354 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-dd239cdd-1e9c-4a41-95b9-d3d7485aa3ff tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:34.365161 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dd239cdd-1e9c-4a41-95b9-d3d7485aa3ff tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:34.365600 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dd239cdd-1e9c-4a41-95b9-d3d7485aa3ff tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:34.366888 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dd239cdd-1e9c-4a41-95b9-d3d7485aa3ff tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:34.367325 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dd239cdd-1e9c-4a41-95b9-d3d7485aa3ff tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:34.395961 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-dd239cdd-1e9c-4a41-95b9-d3d7485aa3ff tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042572 May 24 15:29:34.396542 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 742/1469] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:34 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:34.558938 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f46ab31b-31de-45da-824a-b64ba040aa6e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:34.559867 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f46ab31b-31de-45da-824a-b64ba040aa6e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:34.565868 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f46ab31b-31de-45da-824a-b64ba040aa6e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:34.566314 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f46ab31b-31de-45da-824a-b64ba040aa6e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:34.567071 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f46ab31b-31de-45da-824a-b64ba040aa6e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:34.567508 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f46ab31b-31de-45da-824a-b64ba040aa6e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:34.595613 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f46ab31b-31de-45da-824a-b64ba040aa6e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040566 May 24 15:29:34.596162 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 728/1470] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:34 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:34.673075 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-a795b62a-3bef-49f2-9fda-fe0d3f1b29a3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:34.673998 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-a795b62a-3bef-49f2-9fda-fe0d3f1b29a3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:34.680613 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a795b62a-3bef-49f2-9fda-fe0d3f1b29a3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:34.681060 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a795b62a-3bef-49f2-9fda-fe0d3f1b29a3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:34.681815 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a795b62a-3bef-49f2-9fda-fe0d3f1b29a3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:34.682251 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a795b62a-3bef-49f2-9fda-fe0d3f1b29a3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:34.705792 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:29:34.710681 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-a795b62a-3bef-49f2-9fda-fe0d3f1b29a3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041604 May 24 15:29:34.711231 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 743/1471] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:29:34 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:29:35.407360 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-3dc2cb6d-af86-4ee8-a1f0-c21de29b7d35 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:35.408200 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-3dc2cb6d-af86-4ee8-a1f0-c21de29b7d35 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:35.414778 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3dc2cb6d-af86-4ee8-a1f0-c21de29b7d35 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:35.415219 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3dc2cb6d-af86-4ee8-a1f0-c21de29b7d35 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:35.415968 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3dc2cb6d-af86-4ee8-a1f0-c21de29b7d35 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:35.416429 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3dc2cb6d-af86-4ee8-a1f0-c21de29b7d35 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:35.444828 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-3dc2cb6d-af86-4ee8-a1f0-c21de29b7d35 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041102 May 24 15:29:35.445367 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 729/1472] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:35 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:35.607010 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-519f53c5-6bb6-48dc-9456-7ebb30ffcfcf tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:35.607929 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-519f53c5-6bb6-48dc-9456-7ebb30ffcfcf tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:35.614867 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-519f53c5-6bb6-48dc-9456-7ebb30ffcfcf tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:35.615310 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-519f53c5-6bb6-48dc-9456-7ebb30ffcfcf tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:35.616089 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-519f53c5-6bb6-48dc-9456-7ebb30ffcfcf tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:35.616552 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-519f53c5-6bb6-48dc-9456-7ebb30ffcfcf tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:35.645972 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-519f53c5-6bb6-48dc-9456-7ebb30ffcfcf tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042794 May 24 15:29:35.646847 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 744/1473] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:35 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:35.722342 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-bf4d8762-2f4b-4f73-a5ce-0f3444119afe tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:35.723319 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-bf4d8762-2f4b-4f73-a5ce-0f3444119afe tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:35.729640 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bf4d8762-2f4b-4f73-a5ce-0f3444119afe tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:35.730089 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bf4d8762-2f4b-4f73-a5ce-0f3444119afe tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:35.730848 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bf4d8762-2f4b-4f73-a5ce-0f3444119afe tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:35.731280 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bf4d8762-2f4b-4f73-a5ce-0f3444119afe tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:35.760838 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-bf4d8762-2f4b-4f73-a5ce-0f3444119afe tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042520 May 24 15:29:35.764815 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 730/1474] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:29:35 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:29:36.456269 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d8253947-067a-4a5f-8925-2da36c64e32b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:36.457132 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d8253947-067a-4a5f-8925-2da36c64e32b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:36.463143 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d8253947-067a-4a5f-8925-2da36c64e32b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:36.463585 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d8253947-067a-4a5f-8925-2da36c64e32b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:36.464357 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d8253947-067a-4a5f-8925-2da36c64e32b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:36.464789 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d8253947-067a-4a5f-8925-2da36c64e32b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:36.494079 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d8253947-067a-4a5f-8925-2da36c64e32b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041825 May 24 15:29:36.494608 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 745/1475] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:36 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:36.658003 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-46098933-6d76-40c5-8223-cb00bb948428 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:36.658913 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-46098933-6d76-40c5-8223-cb00bb948428 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:36.665985 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-46098933-6d76-40c5-8223-cb00bb948428 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:36.666425 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-46098933-6d76-40c5-8223-cb00bb948428 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:36.667176 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-46098933-6d76-40c5-8223-cb00bb948428 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:36.667603 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-46098933-6d76-40c5-8223-cb00bb948428 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:36.694947 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-46098933-6d76-40c5-8223-cb00bb948428 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040812 May 24 15:29:36.695488 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 731/1476] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:36 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:36.772238 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-0027c006-c75b-4cff-97ba-bd82f4771314 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:36.773727 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-0027c006-c75b-4cff-97ba-bd82f4771314 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:36.780117 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0027c006-c75b-4cff-97ba-bd82f4771314 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:36.780593 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0027c006-c75b-4cff-97ba-bd82f4771314 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:36.781349 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0027c006-c75b-4cff-97ba-bd82f4771314 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:36.781780 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0027c006-c75b-4cff-97ba-bd82f4771314 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:36.810117 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-0027c006-c75b-4cff-97ba-bd82f4771314 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041851 May 24 15:29:36.810649 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 746/1477] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:29:36 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:29:37.505470 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-ce0edbce-5202-4fe3-8d4e-bd82e1740356 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:37.506387 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-ce0edbce-5202-4fe3-8d4e-bd82e1740356 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:37.513418 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ce0edbce-5202-4fe3-8d4e-bd82e1740356 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:37.513873 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ce0edbce-5202-4fe3-8d4e-bd82e1740356 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:37.514646 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ce0edbce-5202-4fe3-8d4e-bd82e1740356 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:37.515083 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ce0edbce-5202-4fe3-8d4e-bd82e1740356 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:37.543791 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-ce0edbce-5202-4fe3-8d4e-bd82e1740356 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042439 May 24 15:29:37.544357 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 732/1478] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:37 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:37.706372 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-cee110c5-95f8-4687-9cf4-67d83e6250d3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:37.707301 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-cee110c5-95f8-4687-9cf4-67d83e6250d3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:37.713947 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cee110c5-95f8-4687-9cf4-67d83e6250d3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:37.714395 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cee110c5-95f8-4687-9cf4-67d83e6250d3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:37.715156 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cee110c5-95f8-4687-9cf4-67d83e6250d3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:37.715591 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cee110c5-95f8-4687-9cf4-67d83e6250d3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:37.743354 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-cee110c5-95f8-4687-9cf4-67d83e6250d3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040905 May 24 15:29:37.743899 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 747/1479] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:37 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:37.822180 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-2648aa27-10e8-44c8-8eb0-2ae65ad39733 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:37.823040 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-2648aa27-10e8-44c8-8eb0-2ae65ad39733 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:37.829024 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2648aa27-10e8-44c8-8eb0-2ae65ad39733 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:37.829474 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2648aa27-10e8-44c8-8eb0-2ae65ad39733 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:37.830236 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2648aa27-10e8-44c8-8eb0-2ae65ad39733 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:37.830674 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2648aa27-10e8-44c8-8eb0-2ae65ad39733 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:37.859034 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-2648aa27-10e8-44c8-8eb0-2ae65ad39733 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041393 May 24 15:29:37.859823 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 733/1480] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:29:37 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:29:38.555962 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-92ebea79-44fc-4a8a-b566-eb5e40913722 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:38.556911 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-92ebea79-44fc-4a8a-b566-eb5e40913722 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:38.563419 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-92ebea79-44fc-4a8a-b566-eb5e40913722 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:38.563859 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-92ebea79-44fc-4a8a-b566-eb5e40913722 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:38.564638 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-92ebea79-44fc-4a8a-b566-eb5e40913722 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:38.565070 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-92ebea79-44fc-4a8a-b566-eb5e40913722 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:38.592811 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-92ebea79-44fc-4a8a-b566-eb5e40913722 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041473 May 24 15:29:38.593348 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 748/1481] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:38 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:29:38.754619 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-dafe3b85-da3f-4b2a-bc3a-10b53eb860cd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:38.755541 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-dafe3b85-da3f-4b2a-bc3a-10b53eb860cd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:38.762075 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dafe3b85-da3f-4b2a-bc3a-10b53eb860cd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:38.762518 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dafe3b85-da3f-4b2a-bc3a-10b53eb860cd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:38.763276 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dafe3b85-da3f-4b2a-bc3a-10b53eb860cd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:38.763704 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dafe3b85-da3f-4b2a-bc3a-10b53eb860cd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:38.792243 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-dafe3b85-da3f-4b2a-bc3a-10b53eb860cd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041537 May 24 15:29:38.792815 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 734/1482] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:38 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:38.870389 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d6139d36-dd30-4651-b2f0-ef7ab5226ee5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:38.871237 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d6139d36-dd30-4651-b2f0-ef7ab5226ee5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:38.877254 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d6139d36-dd30-4651-b2f0-ef7ab5226ee5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:38.877702 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d6139d36-dd30-4651-b2f0-ef7ab5226ee5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:38.878457 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d6139d36-dd30-4651-b2f0-ef7ab5226ee5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:38.878887 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d6139d36-dd30-4651-b2f0-ef7ab5226ee5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:38.906888 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d6139d36-dd30-4651-b2f0-ef7ab5226ee5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040494 May 24 15:29:38.907421 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 749/1483] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:29:38 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:29:39.604216 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-604706c4-f2ce-4b2e-b36c-662e2f4db549 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:39.605182 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-604706c4-f2ce-4b2e-b36c-662e2f4db549 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:39.611546 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-604706c4-f2ce-4b2e-b36c-662e2f4db549 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:39.611996 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-604706c4-f2ce-4b2e-b36c-662e2f4db549 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:39.612780 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-604706c4-f2ce-4b2e-b36c-662e2f4db549 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:39.613214 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-604706c4-f2ce-4b2e-b36c-662e2f4db549 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:39.642073 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-604706c4-f2ce-4b2e-b36c-662e2f4db549 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041863 May 24 15:29:39.642604 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 735/1484] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:39 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:39.803338 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-98be1704-2686-401a-beb8-4386f4f68851 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:39.804788 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-98be1704-2686-401a-beb8-4386f4f68851 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:39.807048 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_api:SELECT=88 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:29:39.812316 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-98be1704-2686-401a-beb8-4386f4f68851 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:39.812771 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-98be1704-2686-401a-beb8-4386f4f68851 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:39.813513 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-98be1704-2686-401a-beb8-4386f4f68851 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:39.813937 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-98be1704-2686-401a-beb8-4386f4f68851 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:39.842331 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-98be1704-2686-401a-beb8-4386f4f68851 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042903 May 24 15:29:39.842876 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 750/1485] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:39 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:39.918833 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-668dcac1-779a-4552-a92d-4c67c251e7c5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:39.919717 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-668dcac1-779a-4552-a92d-4c67c251e7c5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:39.926579 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-668dcac1-779a-4552-a92d-4c67c251e7c5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:39.927008 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-668dcac1-779a-4552-a92d-4c67c251e7c5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:39.927764 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-668dcac1-779a-4552-a92d-4c67c251e7c5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:39.928195 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-668dcac1-779a-4552-a92d-4c67c251e7c5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:39.956908 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-668dcac1-779a-4552-a92d-4c67c251e7c5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042183 May 24 15:29:39.957458 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 736/1486] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:29:39 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:29:40.653354 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-b75123f1-e5e3-4b21-a8a4-cf0074f00063 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:40.654265 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-b75123f1-e5e3-4b21-a8a4-cf0074f00063 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:40.660314 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b75123f1-e5e3-4b21-a8a4-cf0074f00063 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:40.660771 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b75123f1-e5e3-4b21-a8a4-cf0074f00063 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:40.661522 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b75123f1-e5e3-4b21-a8a4-cf0074f00063 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:40.661955 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b75123f1-e5e3-4b21-a8a4-cf0074f00063 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:40.689600 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-b75123f1-e5e3-4b21-a8a4-cf0074f00063 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040168 May 24 15:29:40.690151 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 751/1487] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:40 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:40.854004 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d98be260-13ff-4299-ae81-da0801e92f2b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:40.855042 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d98be260-13ff-4299-ae81-da0801e92f2b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:40.861427 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d98be260-13ff-4299-ae81-da0801e92f2b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:40.861869 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d98be260-13ff-4299-ae81-da0801e92f2b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:40.862626 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d98be260-13ff-4299-ae81-da0801e92f2b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:40.863059 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d98be260-13ff-4299-ae81-da0801e92f2b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:40.891078 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d98be260-13ff-4299-ae81-da0801e92f2b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041018 May 24 15:29:40.891622 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 737/1488] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:40 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:40.968467 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-26ff297b-1a6c-4b3e-904a-d4b839bf4e08 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:40.969377 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-26ff297b-1a6c-4b3e-904a-d4b839bf4e08 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:40.975734 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-26ff297b-1a6c-4b3e-904a-d4b839bf4e08 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:40.976177 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-26ff297b-1a6c-4b3e-904a-d4b839bf4e08 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:40.976964 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-26ff297b-1a6c-4b3e-904a-d4b839bf4e08 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:40.977387 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-26ff297b-1a6c-4b3e-904a-d4b839bf4e08 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:41.005256 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-26ff297b-1a6c-4b3e-904a-d4b839bf4e08 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040787 May 24 15:29:41.005797 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 752/1489] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:29:40 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:29:41.700477 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-43db7588-5306-49e3-8164-e5fa85410ee0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:41.701402 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-43db7588-5306-49e3-8164-e5fa85410ee0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:41.707893 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-43db7588-5306-49e3-8164-e5fa85410ee0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:41.708361 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-43db7588-5306-49e3-8164-e5fa85410ee0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:41.709124 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-43db7588-5306-49e3-8164-e5fa85410ee0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:41.709560 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-43db7588-5306-49e3-8164-e5fa85410ee0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:41.738268 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-43db7588-5306-49e3-8164-e5fa85410ee0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041869 May 24 15:29:41.738811 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 738/1490] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:41 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:41.903128 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-40aa023d-94c2-40ac-8a95-b52295828ebc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:41.904404 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-40aa023d-94c2-40ac-8a95-b52295828ebc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:41.911249 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-40aa023d-94c2-40ac-8a95-b52295828ebc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:41.911249 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-40aa023d-94c2-40ac-8a95-b52295828ebc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:41.911684 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-40aa023d-94c2-40ac-8a95-b52295828ebc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:41.912112 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-40aa023d-94c2-40ac-8a95-b52295828ebc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:41.940788 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-40aa023d-94c2-40ac-8a95-b52295828ebc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041682 May 24 15:29:41.941333 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 753/1491] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:41 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:42.017300 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-67ffc981-d126-43ae-b481-4cef1f6d6769 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:42.018213 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-67ffc981-d126-43ae-b481-4cef1f6d6769 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:42.024640 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-67ffc981-d126-43ae-b481-4cef1f6d6769 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:42.025083 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-67ffc981-d126-43ae-b481-4cef1f6d6769 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:42.025829 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-67ffc981-d126-43ae-b481-4cef1f6d6769 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:42.026257 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-67ffc981-d126-43ae-b481-4cef1f6d6769 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:42.054828 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-67ffc981-d126-43ae-b481-4cef1f6d6769 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041485 May 24 15:29:42.055591 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 739/1492] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:29:42 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:29:42.750224 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-3a3b2ed2-327b-4e89-bbd4-af9f0a3de433 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:42.751147 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-3a3b2ed2-327b-4e89-bbd4-af9f0a3de433 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:42.758333 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3a3b2ed2-327b-4e89-bbd4-af9f0a3de433 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:42.758786 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3a3b2ed2-327b-4e89-bbd4-af9f0a3de433 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:42.759548 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3a3b2ed2-327b-4e89-bbd4-af9f0a3de433 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:42.759989 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3a3b2ed2-327b-4e89-bbd4-af9f0a3de433 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:42.787768 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-3a3b2ed2-327b-4e89-bbd4-af9f0a3de433 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041522 May 24 15:29:42.788404 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 754/1493] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:42 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:42.951759 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-181d8fc3-ebb8-4746-99ba-4c9a16549cc4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:42.952733 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-181d8fc3-ebb8-4746-99ba-4c9a16549cc4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:42.959194 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-181d8fc3-ebb8-4746-99ba-4c9a16549cc4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:42.959639 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-181d8fc3-ebb8-4746-99ba-4c9a16549cc4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:42.960490 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-181d8fc3-ebb8-4746-99ba-4c9a16549cc4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:42.960925 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-181d8fc3-ebb8-4746-99ba-4c9a16549cc4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:42.988944 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-181d8fc3-ebb8-4746-99ba-4c9a16549cc4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041151 May 24 15:29:42.989486 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 740/1494] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:42 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:43.066595 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-53849693-18d7-4794-85a4-59096bc03aa6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:43.067601 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-53849693-18d7-4794-85a4-59096bc03aa6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:43.073630 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-53849693-18d7-4794-85a4-59096bc03aa6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:43.074085 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-53849693-18d7-4794-85a4-59096bc03aa6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:43.074892 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-53849693-18d7-4794-85a4-59096bc03aa6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:43.075332 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-53849693-18d7-4794-85a4-59096bc03aa6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:43.104176 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-53849693-18d7-4794-85a4-59096bc03aa6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041621 May 24 15:29:43.104762 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 755/1495] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:29:43 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:29:43.799134 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-750c6ae7-a0e6-4732-8c02-c00fec853955 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:43.800102 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-750c6ae7-a0e6-4732-8c02-c00fec853955 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:43.806134 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-750c6ae7-a0e6-4732-8c02-c00fec853955 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:43.806573 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-750c6ae7-a0e6-4732-8c02-c00fec853955 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:43.807328 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-750c6ae7-a0e6-4732-8c02-c00fec853955 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:43.807755 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-750c6ae7-a0e6-4732-8c02-c00fec853955 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:43.837516 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-750c6ae7-a0e6-4732-8c02-c00fec853955 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042453 May 24 15:29:43.838061 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 741/1496] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:43 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:44.000431 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-4dcf60fa-b9ea-4351-ada1-eb8f49481c5e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:44.001388 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-4dcf60fa-b9ea-4351-ada1-eb8f49481c5e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:44.008313 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4dcf60fa-b9ea-4351-ada1-eb8f49481c5e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:44.008783 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4dcf60fa-b9ea-4351-ada1-eb8f49481c5e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:44.009545 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4dcf60fa-b9ea-4351-ada1-eb8f49481c5e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:44.009992 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4dcf60fa-b9ea-4351-ada1-eb8f49481c5e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:44.038239 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-4dcf60fa-b9ea-4351-ada1-eb8f49481c5e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041742 May 24 15:29:44.038783 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 756/1497] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:43 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:44.115681 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-46a44945-e81f-4035-9e88-1ed3f42d4b47 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:44.117106 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-46a44945-e81f-4035-9e88-1ed3f42d4b47 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:44.123812 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-46a44945-e81f-4035-9e88-1ed3f42d4b47 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:44.124239 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-46a44945-e81f-4035-9e88-1ed3f42d4b47 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:44.125011 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-46a44945-e81f-4035-9e88-1ed3f42d4b47 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:44.125444 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-46a44945-e81f-4035-9e88-1ed3f42d4b47 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:44.154452 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-46a44945-e81f-4035-9e88-1ed3f42d4b47 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042741 May 24 15:29:44.154982 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 742/1498] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:29:44 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:29:44.848057 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-16e501fb-566d-4efa-8638-50ae90ba4a7a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:44.849006 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-16e501fb-566d-4efa-8638-50ae90ba4a7a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:44.855907 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-16e501fb-566d-4efa-8638-50ae90ba4a7a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:44.856383 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-16e501fb-566d-4efa-8638-50ae90ba4a7a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:44.857159 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-16e501fb-566d-4efa-8638-50ae90ba4a7a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:44.857589 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-16e501fb-566d-4efa-8638-50ae90ba4a7a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:44.885588 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-16e501fb-566d-4efa-8638-50ae90ba4a7a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041515 May 24 15:29:44.886128 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 757/1499] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:44 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:45.049542 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-980d0c8a-4c5f-4ebd-832a-249d7f133696 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:45.050458 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-980d0c8a-4c5f-4ebd-832a-249d7f133696 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:45.056442 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-980d0c8a-4c5f-4ebd-832a-249d7f133696 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:45.056879 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-980d0c8a-4c5f-4ebd-832a-249d7f133696 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:45.057629 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-980d0c8a-4c5f-4ebd-832a-249d7f133696 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:45.058055 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-980d0c8a-4c5f-4ebd-832a-249d7f133696 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:45.074266 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:29:45.087573 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-980d0c8a-4c5f-4ebd-832a-249d7f133696 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041879 May 24 15:29:45.088128 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 743/1500] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:45 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:45.165458 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-5ccad68d-72a9-49bd-b68a-20cec897eb19 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:45.166393 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-5ccad68d-72a9-49bd-b68a-20cec897eb19 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:45.172846 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5ccad68d-72a9-49bd-b68a-20cec897eb19 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:45.173288 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5ccad68d-72a9-49bd-b68a-20cec897eb19 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:45.174030 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5ccad68d-72a9-49bd-b68a-20cec897eb19 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:45.174457 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5ccad68d-72a9-49bd-b68a-20cec897eb19 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:45.202977 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-5ccad68d-72a9-49bd-b68a-20cec897eb19 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041515 May 24 15:29:45.203516 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 758/1501] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:29:45 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:29:45.897164 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-8cd329af-e323-4cb2-94e5-abafd86bb61f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:45.898010 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-8cd329af-e323-4cb2-94e5-abafd86bb61f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:45.904553 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8cd329af-e323-4cb2-94e5-abafd86bb61f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:45.904999 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8cd329af-e323-4cb2-94e5-abafd86bb61f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:45.905756 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8cd329af-e323-4cb2-94e5-abafd86bb61f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:45.906189 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8cd329af-e323-4cb2-94e5-abafd86bb61f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:45.935675 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-8cd329af-e323-4cb2-94e5-abafd86bb61f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042602 May 24 15:29:45.936221 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 744/1502] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:45 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:46.098077 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-660bf625-57b2-4545-a58e-eb4e1bdd391d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:46.099001 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-660bf625-57b2-4545-a58e-eb4e1bdd391d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:46.105585 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-660bf625-57b2-4545-a58e-eb4e1bdd391d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:46.106033 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-660bf625-57b2-4545-a58e-eb4e1bdd391d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:46.106792 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-660bf625-57b2-4545-a58e-eb4e1bdd391d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:46.107298 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-660bf625-57b2-4545-a58e-eb4e1bdd391d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:46.135593 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-660bf625-57b2-4545-a58e-eb4e1bdd391d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041540 May 24 15:29:46.136138 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 759/1503] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:46 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:46.214513 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-4846d4c4-fe1e-4c12-a6bf-865a228aeb0a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:46.215372 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-4846d4c4-fe1e-4c12-a6bf-865a228aeb0a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:46.221352 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4846d4c4-fe1e-4c12-a6bf-865a228aeb0a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:46.221794 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4846d4c4-fe1e-4c12-a6bf-865a228aeb0a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:46.222541 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4846d4c4-fe1e-4c12-a6bf-865a228aeb0a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:46.222970 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4846d4c4-fe1e-4c12-a6bf-865a228aeb0a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:46.252056 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-4846d4c4-fe1e-4c12-a6bf-865a228aeb0a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041567 May 24 15:29:46.252624 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 745/1504] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:29:46 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:29:46.947578 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-0a4f47a9-3732-41d7-b594-801e65366120 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:46.948442 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-0a4f47a9-3732-41d7-b594-801e65366120 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:46.954929 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0a4f47a9-3732-41d7-b594-801e65366120 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:46.955376 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0a4f47a9-3732-41d7-b594-801e65366120 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:46.956129 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0a4f47a9-3732-41d7-b594-801e65366120 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:46.956580 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0a4f47a9-3732-41d7-b594-801e65366120 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:46.970439 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:29:46.985716 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-0a4f47a9-3732-41d7-b594-801e65366120 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042829 May 24 15:29:46.986271 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 760/1505] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:46 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:47.146918 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-ea89d92c-2964-4032-870d-c61491c96477 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:47.148394 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-ea89d92c-2964-4032-870d-c61491c96477 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:47.154850 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ea89d92c-2964-4032-870d-c61491c96477 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:47.155304 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ea89d92c-2964-4032-870d-c61491c96477 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:47.156059 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ea89d92c-2964-4032-870d-c61491c96477 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:47.156524 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ea89d92c-2964-4032-870d-c61491c96477 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:47.185573 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-ea89d92c-2964-4032-870d-c61491c96477 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042590 May 24 15:29:47.186112 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 746/1506] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:47 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:47.263719 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-92b89acf-7ffd-403d-87cc-f395a3892c2b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:47.264647 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-92b89acf-7ffd-403d-87cc-f395a3892c2b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:47.270640 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-92b89acf-7ffd-403d-87cc-f395a3892c2b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:47.271078 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-92b89acf-7ffd-403d-87cc-f395a3892c2b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:47.271828 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-92b89acf-7ffd-403d-87cc-f395a3892c2b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:47.272800 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-92b89acf-7ffd-403d-87cc-f395a3892c2b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:47.301057 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-92b89acf-7ffd-403d-87cc-f395a3892c2b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041340 May 24 15:29:47.301597 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 761/1507] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:29:47 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:29:47.997821 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-76e6846f-1248-4fb0-ac15-c74ea203898d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:47.998742 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-76e6846f-1248-4fb0-ac15-c74ea203898d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:48.004856 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-76e6846f-1248-4fb0-ac15-c74ea203898d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:48.005305 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-76e6846f-1248-4fb0-ac15-c74ea203898d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:48.006062 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-76e6846f-1248-4fb0-ac15-c74ea203898d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:48.006494 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-76e6846f-1248-4fb0-ac15-c74ea203898d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:48.038253 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-76e6846f-1248-4fb0-ac15-c74ea203898d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044381 May 24 15:29:48.038800 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 747/1508] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:47 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:48.196360 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-59b0cc1c-1ae7-45fb-9124-9b958b3fca8e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:48.197280 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-59b0cc1c-1ae7-45fb-9124-9b958b3fca8e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:48.203609 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-59b0cc1c-1ae7-45fb-9124-9b958b3fca8e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:48.204052 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-59b0cc1c-1ae7-45fb-9124-9b958b3fca8e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:48.204833 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-59b0cc1c-1ae7-45fb-9124-9b958b3fca8e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:48.205261 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-59b0cc1c-1ae7-45fb-9124-9b958b3fca8e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:48.233399 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-59b0cc1c-1ae7-45fb-9124-9b958b3fca8e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041056 May 24 15:29:48.233933 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 762/1509] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:48 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:48.312644 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-6a265bc2-fc65-4433-b0e3-71cfb7f4361f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:48.313495 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-6a265bc2-fc65-4433-b0e3-71cfb7f4361f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:48.319929 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6a265bc2-fc65-4433-b0e3-71cfb7f4361f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:48.320410 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6a265bc2-fc65-4433-b0e3-71cfb7f4361f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:48.321171 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6a265bc2-fc65-4433-b0e3-71cfb7f4361f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:48.321609 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6a265bc2-fc65-4433-b0e3-71cfb7f4361f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:48.351919 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-6a265bc2-fc65-4433-b0e3-71cfb7f4361f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043152 May 24 15:29:48.352702 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 748/1510] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:29:48 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:29:49.049885 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-8faac92b-be07-40e8-be43-2d80fafaee4a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:49.050809 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-8faac92b-be07-40e8-be43-2d80fafaee4a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:49.057389 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8faac92b-be07-40e8-be43-2d80fafaee4a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:49.057863 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8faac92b-be07-40e8-be43-2d80fafaee4a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:49.058619 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8faac92b-be07-40e8-be43-2d80fafaee4a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:49.059052 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8faac92b-be07-40e8-be43-2d80fafaee4a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:49.087397 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-8faac92b-be07-40e8-be43-2d80fafaee4a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041461 May 24 15:29:49.088200 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 763/1511] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:49 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:49.246745 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e64f4021-3894-44fc-94ad-b3ebad430c50 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:49.247662 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-e64f4021-3894-44fc-94ad-b3ebad430c50 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:49.253822 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e64f4021-3894-44fc-94ad-b3ebad430c50 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:49.254265 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e64f4021-3894-44fc-94ad-b3ebad430c50 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:49.255024 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e64f4021-3894-44fc-94ad-b3ebad430c50 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:49.255457 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e64f4021-3894-44fc-94ad-b3ebad430c50 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:49.287091 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-e64f4021-3894-44fc-94ad-b3ebad430c50 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046011 May 24 15:29:49.287683 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 749/1512] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:49 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:49.364776 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-1cf00ac0-3e47-4b80-8126-5fd6365d162a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:49.365589 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-1cf00ac0-3e47-4b80-8126-5fd6365d162a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:49.374157 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1cf00ac0-3e47-4b80-8126-5fd6365d162a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:49.374756 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1cf00ac0-3e47-4b80-8126-5fd6365d162a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:49.375829 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1cf00ac0-3e47-4b80-8126-5fd6365d162a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:49.376454 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1cf00ac0-3e47-4b80-8126-5fd6365d162a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:49.405290 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-1cf00ac0-3e47-4b80-8126-5fd6365d162a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044579 May 24 15:29:49.405831 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 764/1513] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:29:49 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:29:50.100354 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-2b64198c-427d-4e6d-94cc-76138c606ecb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:50.101280 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-2b64198c-427d-4e6d-94cc-76138c606ecb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:50.107797 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2b64198c-427d-4e6d-94cc-76138c606ecb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:50.108239 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2b64198c-427d-4e6d-94cc-76138c606ecb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:50.109023 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2b64198c-427d-4e6d-94cc-76138c606ecb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:50.109452 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2b64198c-427d-4e6d-94cc-76138c606ecb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:50.139570 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-2b64198c-427d-4e6d-94cc-76138c606ecb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043146 May 24 15:29:50.140126 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 750/1514] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:50 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:50.299592 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-4aa7eeb9-71ce-48fa-a255-ee6b006f6d2e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:50.300531 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-4aa7eeb9-71ce-48fa-a255-ee6b006f6d2e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:50.307022 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4aa7eeb9-71ce-48fa-a255-ee6b006f6d2e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:50.307459 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4aa7eeb9-71ce-48fa-a255-ee6b006f6d2e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:50.308202 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4aa7eeb9-71ce-48fa-a255-ee6b006f6d2e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:50.308977 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4aa7eeb9-71ce-48fa-a255-ee6b006f6d2e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:50.337203 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-4aa7eeb9-71ce-48fa-a255-ee6b006f6d2e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041641 May 24 15:29:50.337675 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 765/1515] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:50 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:50.417419 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-7207819d-a8f4-4b5c-899b-bae3f0951f57 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:50.418421 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-7207819d-a8f4-4b5c-899b-bae3f0951f57 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:50.424399 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7207819d-a8f4-4b5c-899b-bae3f0951f57 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:50.424842 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7207819d-a8f4-4b5c-899b-bae3f0951f57 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:50.425588 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7207819d-a8f4-4b5c-899b-bae3f0951f57 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:50.426016 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7207819d-a8f4-4b5c-899b-bae3f0951f57 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:50.454138 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-7207819d-a8f4-4b5c-899b-bae3f0951f57 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041210 May 24 15:29:50.454669 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 751/1516] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:29:50 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:29:51.151695 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-ec1c7864-e2c5-4fb6-a7ae-0856cda4f389 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:51.152640 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-ec1c7864-e2c5-4fb6-a7ae-0856cda4f389 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:51.158689 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ec1c7864-e2c5-4fb6-a7ae-0856cda4f389 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:51.159132 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ec1c7864-e2c5-4fb6-a7ae-0856cda4f389 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:51.159884 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ec1c7864-e2c5-4fb6-a7ae-0856cda4f389 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:51.160334 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ec1c7864-e2c5-4fb6-a7ae-0856cda4f389 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:51.187859 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-ec1c7864-e2c5-4fb6-a7ae-0856cda4f389 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040756 May 24 15:29:51.188416 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 766/1517] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:51 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:51.348053 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-445f5b91-93bc-45bc-9e72-e28318064d62 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:51.349035 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-445f5b91-93bc-45bc-9e72-e28318064d62 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:51.355653 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-445f5b91-93bc-45bc-9e72-e28318064d62 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:51.356099 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-445f5b91-93bc-45bc-9e72-e28318064d62 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:51.356891 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-445f5b91-93bc-45bc-9e72-e28318064d62 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:51.357318 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-445f5b91-93bc-45bc-9e72-e28318064d62 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:51.387524 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-445f5b91-93bc-45bc-9e72-e28318064d62 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043404 May 24 15:29:51.388073 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 752/1518] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:51 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:51.466217 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-77f95e5d-9769-47f5-b4e6-f00dc2188c5b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:51.467124 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-77f95e5d-9769-47f5-b4e6-f00dc2188c5b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:51.473484 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-77f95e5d-9769-47f5-b4e6-f00dc2188c5b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:51.473926 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-77f95e5d-9769-47f5-b4e6-f00dc2188c5b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:51.474670 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-77f95e5d-9769-47f5-b4e6-f00dc2188c5b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:51.475128 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-77f95e5d-9769-47f5-b4e6-f00dc2188c5b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:51.502713 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-77f95e5d-9769-47f5-b4e6-f00dc2188c5b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040468 May 24 15:29:51.503251 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 767/1519] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:29:51 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:29:52.198629 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-6b9957f9-27b9-4215-8caf-cdcf0ded46bd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:52.199555 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-6b9957f9-27b9-4215-8caf-cdcf0ded46bd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:52.205673 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6b9957f9-27b9-4215-8caf-cdcf0ded46bd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:52.206130 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6b9957f9-27b9-4215-8caf-cdcf0ded46bd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:52.206889 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6b9957f9-27b9-4215-8caf-cdcf0ded46bd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:52.207326 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6b9957f9-27b9-4215-8caf-cdcf0ded46bd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:52.235995 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-6b9957f9-27b9-4215-8caf-cdcf0ded46bd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041439 May 24 15:29:52.236572 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 753/1520] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:52 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:29:52.399442 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-a1d4276f-ba41-4b4f-baa1-4e47d3257373 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:52.400386 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-a1d4276f-ba41-4b4f-baa1-4e47d3257373 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:52.406399 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a1d4276f-ba41-4b4f-baa1-4e47d3257373 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:52.406844 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a1d4276f-ba41-4b4f-baa1-4e47d3257373 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:52.407594 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a1d4276f-ba41-4b4f-baa1-4e47d3257373 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:52.408024 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a1d4276f-ba41-4b4f-baa1-4e47d3257373 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:52.435822 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-a1d4276f-ba41-4b4f-baa1-4e47d3257373 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040864 May 24 15:29:52.436374 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 768/1521] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:52 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:52.514650 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d9dd828c-210c-4754-839d-b77cb814ca3a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:52.515625 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d9dd828c-210c-4754-839d-b77cb814ca3a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:52.522624 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d9dd828c-210c-4754-839d-b77cb814ca3a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:52.523069 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d9dd828c-210c-4754-839d-b77cb814ca3a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:52.523820 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d9dd828c-210c-4754-839d-b77cb814ca3a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:52.524251 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d9dd828c-210c-4754-839d-b77cb814ca3a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:52.553915 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d9dd828c-210c-4754-839d-b77cb814ca3a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043152 May 24 15:29:52.554477 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 754/1522] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:29:52 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:29:53.247626 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-b8d84030-8934-4c6e-8717-f4ae30c8f608 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:53.248601 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-b8d84030-8934-4c6e-8717-f4ae30c8f608 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:53.255204 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b8d84030-8934-4c6e-8717-f4ae30c8f608 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:53.255653 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b8d84030-8934-4c6e-8717-f4ae30c8f608 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:53.256449 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b8d84030-8934-4c6e-8717-f4ae30c8f608 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:53.257455 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b8d84030-8934-4c6e-8717-f4ae30c8f608 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:53.285767 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-b8d84030-8934-4c6e-8717-f4ae30c8f608 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042154 May 24 15:29:53.286320 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 769/1523] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:53 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:53.447068 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-fac47d7e-0bbd-45d5-b394-79fcc54ede7f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:53.447981 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-fac47d7e-0bbd-45d5-b394-79fcc54ede7f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:53.453955 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fac47d7e-0bbd-45d5-b394-79fcc54ede7f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:53.454394 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fac47d7e-0bbd-45d5-b394-79fcc54ede7f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:53.455146 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fac47d7e-0bbd-45d5-b394-79fcc54ede7f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:53.455569 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fac47d7e-0bbd-45d5-b394-79fcc54ede7f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:53.484122 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-fac47d7e-0bbd-45d5-b394-79fcc54ede7f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041025 May 24 15:29:53.484698 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 755/1524] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:53 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:53.565446 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-ecc22972-f8c4-4323-985c-0d1f7ad980d5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:53.566413 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-ecc22972-f8c4-4323-985c-0d1f7ad980d5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:53.572642 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ecc22972-f8c4-4323-985c-0d1f7ad980d5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:53.573085 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ecc22972-f8c4-4323-985c-0d1f7ad980d5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:53.573849 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ecc22972-f8c4-4323-985c-0d1f7ad980d5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:53.574276 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ecc22972-f8c4-4323-985c-0d1f7ad980d5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:53.602667 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-ecc22972-f8c4-4323-985c-0d1f7ad980d5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041151 May 24 15:29:53.603153 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 770/1525] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:29:53 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 15:29:54.297265 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-43c32e84-4c08-42e0-a33f-5c8061cdd056 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:54.298227 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-43c32e84-4c08-42e0-a33f-5c8061cdd056 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:54.304737 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-43c32e84-4c08-42e0-a33f-5c8061cdd056 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:54.305184 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-43c32e84-4c08-42e0-a33f-5c8061cdd056 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:54.305944 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-43c32e84-4c08-42e0-a33f-5c8061cdd056 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:54.306377 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-43c32e84-4c08-42e0-a33f-5c8061cdd056 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:54.335941 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-43c32e84-4c08-42e0-a33f-5c8061cdd056 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042613 May 24 15:29:54.336445 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 756/1526] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:54 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:54.494894 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-36509f9e-de18-4cfd-8793-511de958452e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:54.495859 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-36509f9e-de18-4cfd-8793-511de958452e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:54.502346 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-36509f9e-de18-4cfd-8793-511de958452e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:54.502795 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-36509f9e-de18-4cfd-8793-511de958452e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:54.503553 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-36509f9e-de18-4cfd-8793-511de958452e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:54.503987 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-36509f9e-de18-4cfd-8793-511de958452e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:54.532491 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-36509f9e-de18-4cfd-8793-511de958452e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041502 May 24 15:29:54.533033 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 771/1527] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:54 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:54.614458 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-33ec7793-6918-4465-8b56-f922a2f9efce tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:54.615311 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-33ec7793-6918-4465-8b56-f922a2f9efce tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:54.621783 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-33ec7793-6918-4465-8b56-f922a2f9efce tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:54.622229 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-33ec7793-6918-4465-8b56-f922a2f9efce tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:54.622989 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-33ec7793-6918-4465-8b56-f922a2f9efce tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:54.623420 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-33ec7793-6918-4465-8b56-f922a2f9efce tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:54.651806 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-33ec7793-6918-4465-8b56-f922a2f9efce tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041718 May 24 15:29:54.652369 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 757/1528] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:29:54 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:29:55.347399 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-0d6888f2-19b8-46a5-8c27-d8567babe8f1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:55.348277 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-0d6888f2-19b8-46a5-8c27-d8567babe8f1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:55.354984 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0d6888f2-19b8-46a5-8c27-d8567babe8f1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:55.355434 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0d6888f2-19b8-46a5-8c27-d8567babe8f1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:55.356194 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0d6888f2-19b8-46a5-8c27-d8567babe8f1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:55.356663 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0d6888f2-19b8-46a5-8c27-d8567babe8f1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:55.384989 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-0d6888f2-19b8-46a5-8c27-d8567babe8f1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041707 May 24 15:29:55.385539 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 772/1529] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:55 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:55.544281 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d6b978bb-c6e1-4028-bdae-5d292de084e2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:55.545218 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d6b978bb-c6e1-4028-bdae-5d292de084e2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:55.551601 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d6b978bb-c6e1-4028-bdae-5d292de084e2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:55.552043 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d6b978bb-c6e1-4028-bdae-5d292de084e2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:55.552827 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d6b978bb-c6e1-4028-bdae-5d292de084e2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:55.553256 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d6b978bb-c6e1-4028-bdae-5d292de084e2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:55.580646 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d6b978bb-c6e1-4028-bdae-5d292de084e2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040228 May 24 15:29:55.581175 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 758/1530] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:55 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:55.663109 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-f07eea1d-1253-4dc8-9462-d6105737ed10 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:55.663951 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-f07eea1d-1253-4dc8-9462-d6105737ed10 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:55.670273 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f07eea1d-1253-4dc8-9462-d6105737ed10 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:55.670716 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f07eea1d-1253-4dc8-9462-d6105737ed10 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:55.671460 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f07eea1d-1253-4dc8-9462-d6105737ed10 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:55.671883 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f07eea1d-1253-4dc8-9462-d6105737ed10 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:55.699748 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-f07eea1d-1253-4dc8-9462-d6105737ed10 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040600 May 24 15:29:55.700288 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 773/1531] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:29:55 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:29:56.396454 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-c666dd4b-6d01-40a9-a7ba-e42898e4112f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:56.397378 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-c666dd4b-6d01-40a9-a7ba-e42898e4112f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:56.403353 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c666dd4b-6d01-40a9-a7ba-e42898e4112f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:56.403801 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c666dd4b-6d01-40a9-a7ba-e42898e4112f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:56.404589 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c666dd4b-6d01-40a9-a7ba-e42898e4112f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:56.405024 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c666dd4b-6d01-40a9-a7ba-e42898e4112f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:56.434855 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-c666dd4b-6d01-40a9-a7ba-e42898e4112f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042469 May 24 15:29:56.435406 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 759/1532] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:56 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:56.591777 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e7a592e7-366a-4af1-8748-c9421eaeae8a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:56.592719 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e7a592e7-366a-4af1-8748-c9421eaeae8a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:56.598653 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e7a592e7-366a-4af1-8748-c9421eaeae8a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:56.599098 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e7a592e7-366a-4af1-8748-c9421eaeae8a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:56.599852 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e7a592e7-366a-4af1-8748-c9421eaeae8a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:56.600823 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e7a592e7-366a-4af1-8748-c9421eaeae8a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:56.631503 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e7a592e7-366a-4af1-8748-c9421eaeae8a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043489 May 24 15:29:56.632054 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 774/1533] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:56 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:56.711116 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-b6c19cf0-4d8b-4ff4-9543-1dec7f9bc81d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:56.712040 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-b6c19cf0-4d8b-4ff4-9543-1dec7f9bc81d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:56.718577 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b6c19cf0-4d8b-4ff4-9543-1dec7f9bc81d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:56.719020 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b6c19cf0-4d8b-4ff4-9543-1dec7f9bc81d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:56.719781 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b6c19cf0-4d8b-4ff4-9543-1dec7f9bc81d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:56.720216 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b6c19cf0-4d8b-4ff4-9543-1dec7f9bc81d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:56.723893 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:29:56.750622 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-b6c19cf0-4d8b-4ff4-9543-1dec7f9bc81d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043476 May 24 15:29:56.751171 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 760/1534] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:29:56 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:29:57.447110 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-5da5785c-e869-4006-b3d9-04b5097a5116 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:57.447950 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-5da5785c-e869-4006-b3d9-04b5097a5116 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:57.454516 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5da5785c-e869-4006-b3d9-04b5097a5116 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:57.454970 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5da5785c-e869-4006-b3d9-04b5097a5116 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:57.455717 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5da5785c-e869-4006-b3d9-04b5097a5116 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:57.456150 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5da5785c-e869-4006-b3d9-04b5097a5116 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:57.484786 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-5da5785c-e869-4006-b3d9-04b5097a5116 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042217 May 24 15:29:57.485590 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 775/1535] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:57 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:57.647138 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-ab64bc8b-60e3-4f39-afcd-1dd698961d38 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:57.648054 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-ab64bc8b-60e3-4f39-afcd-1dd698961d38 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:57.654049 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ab64bc8b-60e3-4f39-afcd-1dd698961d38 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:57.654492 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ab64bc8b-60e3-4f39-afcd-1dd698961d38 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:57.655239 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ab64bc8b-60e3-4f39-afcd-1dd698961d38 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:57.655668 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ab64bc8b-60e3-4f39-afcd-1dd698961d38 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:57.683283 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-ab64bc8b-60e3-4f39-afcd-1dd698961d38 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040071 May 24 15:29:57.683813 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 761/1536] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:57 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:57.762756 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-2bad3af1-e13a-4f2d-a9c7-5ad24808cf41 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:57.763673 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-2bad3af1-e13a-4f2d-a9c7-5ad24808cf41 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:57.769676 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2bad3af1-e13a-4f2d-a9c7-5ad24808cf41 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:57.770121 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2bad3af1-e13a-4f2d-a9c7-5ad24808cf41 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:57.770874 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2bad3af1-e13a-4f2d-a9c7-5ad24808cf41 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:57.771302 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2bad3af1-e13a-4f2d-a9c7-5ad24808cf41 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:57.798790 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-2bad3af1-e13a-4f2d-a9c7-5ad24808cf41 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040047 May 24 15:29:57.799331 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 776/1537] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:29:57 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:29:58.496519 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f5cf032c-f75e-4d4d-9d52-a4de05273f80 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:58.497435 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f5cf032c-f75e-4d4d-9d52-a4de05273f80 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:58.503840 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f5cf032c-f75e-4d4d-9d52-a4de05273f80 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:58.504276 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f5cf032c-f75e-4d4d-9d52-a4de05273f80 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:58.505052 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f5cf032c-f75e-4d4d-9d52-a4de05273f80 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:58.505480 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f5cf032c-f75e-4d4d-9d52-a4de05273f80 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:58.533825 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f5cf032c-f75e-4d4d-9d52-a4de05273f80 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041305 May 24 15:29:58.534365 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 762/1538] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:58 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:58.694753 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-1dfae2c6-4f10-4e38-952e-76396c6809f7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:58.695677 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-1dfae2c6-4f10-4e38-952e-76396c6809f7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:58.702141 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1dfae2c6-4f10-4e38-952e-76396c6809f7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:58.702588 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1dfae2c6-4f10-4e38-952e-76396c6809f7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:58.703347 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1dfae2c6-4f10-4e38-952e-76396c6809f7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:58.703785 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1dfae2c6-4f10-4e38-952e-76396c6809f7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:58.707354 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:29:58.732294 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-1dfae2c6-4f10-4e38-952e-76396c6809f7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041526 May 24 15:29:58.732864 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 777/1539] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:58 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:58.810158 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-5eff2dc4-7891-4ec5-9e5b-c63c16b00618 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:58.811077 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-5eff2dc4-7891-4ec5-9e5b-c63c16b00618 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:58.817163 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5eff2dc4-7891-4ec5-9e5b-c63c16b00618 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:58.817613 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5eff2dc4-7891-4ec5-9e5b-c63c16b00618 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:58.818374 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5eff2dc4-7891-4ec5-9e5b-c63c16b00618 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:58.818819 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5eff2dc4-7891-4ec5-9e5b-c63c16b00618 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:58.846834 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-5eff2dc4-7891-4ec5-9e5b-c63c16b00618 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040723 May 24 15:29:58.847388 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 763/1540] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:29:58 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:29:59.148541 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 15:29:59.148707 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Tue May 24 15:29:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 15:29:59.545391 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-9dbd3c04-01c7-4dbf-a59c-86a897b3e222 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:59.546307 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-9dbd3c04-01c7-4dbf-a59c-86a897b3e222 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:59.552269 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9dbd3c04-01c7-4dbf-a59c-86a897b3e222 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:59.552745 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9dbd3c04-01c7-4dbf-a59c-86a897b3e222 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:59.553522 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9dbd3c04-01c7-4dbf-a59c-86a897b3e222 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:59.553949 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9dbd3c04-01c7-4dbf-a59c-86a897b3e222 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:59.582110 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-9dbd3c04-01c7-4dbf-a59c-86a897b3e222 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040715 May 24 15:29:59.582644 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 778/1541] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:59 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:59.742985 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-b01bcb49-9894-4317-860a-822a72101a51 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:59.744703 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-b01bcb49-9894-4317-860a-822a72101a51 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:59.751924 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b01bcb49-9894-4317-860a-822a72101a51 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:59.752403 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b01bcb49-9894-4317-860a-822a72101a51 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:59.753155 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b01bcb49-9894-4317-860a-822a72101a51 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:59.753583 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b01bcb49-9894-4317-860a-822a72101a51 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:59.781729 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-b01bcb49-9894-4317-860a-822a72101a51 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042767 May 24 15:29:59.782257 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 764/1542] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:29:59 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:59.858767 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-63fd2935-7acf-48b2-a51f-d9b7a97b7539 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:59.859707 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-63fd2935-7acf-48b2-a51f-d9b7a97b7539 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:29:59.866875 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-63fd2935-7acf-48b2-a51f-d9b7a97b7539 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:59.867316 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-63fd2935-7acf-48b2-a51f-d9b7a97b7539 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:59.868068 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-63fd2935-7acf-48b2-a51f-d9b7a97b7539 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:59.868527 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-63fd2935-7acf-48b2-a51f-d9b7a97b7539 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:59.897483 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-63fd2935-7acf-48b2-a51f-d9b7a97b7539 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042546 May 24 15:29:59.897970 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 779/1543] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:29:59 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:30:00.593929 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-39caa9df-c835-4e4d-a488-1c5373286153 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:00.594844 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-39caa9df-c835-4e4d-a488-1c5373286153 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:00.596823 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_api:SELECT=86 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:30:00.602722 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-39caa9df-c835-4e4d-a488-1c5373286153 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:00.603160 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-39caa9df-c835-4e4d-a488-1c5373286153 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:00.603912 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-39caa9df-c835-4e4d-a488-1c5373286153 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:00.604360 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-39caa9df-c835-4e4d-a488-1c5373286153 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:00.632131 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-39caa9df-c835-4e4d-a488-1c5373286153 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042183 May 24 15:30:00.632686 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 765/1544] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:30:00 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:00.793796 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-24c2b5ad-b1ec-4f8d-b668-abb73ef0d273 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:00.794709 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-24c2b5ad-b1ec-4f8d-b668-abb73ef0d273 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:00.800664 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-24c2b5ad-b1ec-4f8d-b668-abb73ef0d273 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:00.801102 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-24c2b5ad-b1ec-4f8d-b668-abb73ef0d273 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:00.801848 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-24c2b5ad-b1ec-4f8d-b668-abb73ef0d273 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:00.802275 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-24c2b5ad-b1ec-4f8d-b668-abb73ef0d273 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:00.830109 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-24c2b5ad-b1ec-4f8d-b668-abb73ef0d273 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040531 May 24 15:30:00.830649 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 780/1545] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:30:00 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:00.909043 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-83e68acf-9726-43ee-bbf0-1a74de097d1d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:00.909996 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-83e68acf-9726-43ee-bbf0-1a74de097d1d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:00.916452 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-83e68acf-9726-43ee-bbf0-1a74de097d1d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:00.916897 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-83e68acf-9726-43ee-bbf0-1a74de097d1d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:00.917649 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-83e68acf-9726-43ee-bbf0-1a74de097d1d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:00.918079 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-83e68acf-9726-43ee-bbf0-1a74de097d1d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:00.946117 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-83e68acf-9726-43ee-bbf0-1a74de097d1d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041062 May 24 15:30:00.946652 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 766/1546] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:30:00 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:30:01.643708 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c6817100-3dfa-4aec-8cff-9722cd9d9ce5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:01.644659 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-c6817100-3dfa-4aec-8cff-9722cd9d9ce5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:01.651197 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c6817100-3dfa-4aec-8cff-9722cd9d9ce5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:01.651646 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c6817100-3dfa-4aec-8cff-9722cd9d9ce5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:01.652433 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c6817100-3dfa-4aec-8cff-9722cd9d9ce5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:01.652875 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c6817100-3dfa-4aec-8cff-9722cd9d9ce5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:01.682742 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-c6817100-3dfa-4aec-8cff-9722cd9d9ce5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043020 May 24 15:30:01.683300 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 781/1547] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:30:01 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:01.841917 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-729a612b-7ee6-4a0a-9cc8-4f6d0fdd363b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:01.842838 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-729a612b-7ee6-4a0a-9cc8-4f6d0fdd363b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:01.849415 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-729a612b-7ee6-4a0a-9cc8-4f6d0fdd363b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:01.849983 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-729a612b-7ee6-4a0a-9cc8-4f6d0fdd363b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:01.851420 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-729a612b-7ee6-4a0a-9cc8-4f6d0fdd363b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:01.852044 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-729a612b-7ee6-4a0a-9cc8-4f6d0fdd363b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:01.882088 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-729a612b-7ee6-4a0a-9cc8-4f6d0fdd363b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044227 May 24 15:30:01.882635 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 767/1548] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:30:01 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:01.957698 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-54606d57-a266-41c5-b644-00bc88e6b308 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:01.958551 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-54606d57-a266-41c5-b644-00bc88e6b308 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:01.964631 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-54606d57-a266-41c5-b644-00bc88e6b308 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:01.965081 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-54606d57-a266-41c5-b644-00bc88e6b308 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:01.965834 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-54606d57-a266-41c5-b644-00bc88e6b308 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:01.966268 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-54606d57-a266-41c5-b644-00bc88e6b308 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:01.995593 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-54606d57-a266-41c5-b644-00bc88e6b308 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041916 May 24 15:30:01.996139 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 782/1549] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:30:01 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:30:02.694775 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-81c56e46-2265-4a71-97e0-017de914379c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:02.695722 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-81c56e46-2265-4a71-97e0-017de914379c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:02.702393 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-81c56e46-2265-4a71-97e0-017de914379c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:02.702845 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-81c56e46-2265-4a71-97e0-017de914379c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:02.703609 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-81c56e46-2265-4a71-97e0-017de914379c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:02.704045 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-81c56e46-2265-4a71-97e0-017de914379c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:02.732845 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-81c56e46-2265-4a71-97e0-017de914379c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042563 May 24 15:30:02.733387 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 768/1550] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:30:02 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:02.893077 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e9e4b6d8-d5ac-4837-8b32-ab96b3b9478f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:02.894004 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e9e4b6d8-d5ac-4837-8b32-ab96b3b9478f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:02.900509 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e9e4b6d8-d5ac-4837-8b32-ab96b3b9478f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:02.900969 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e9e4b6d8-d5ac-4837-8b32-ab96b3b9478f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:02.901731 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e9e4b6d8-d5ac-4837-8b32-ab96b3b9478f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:02.902165 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e9e4b6d8-d5ac-4837-8b32-ab96b3b9478f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:02.930378 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e9e4b6d8-d5ac-4837-8b32-ab96b3b9478f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041153 May 24 15:30:02.930856 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 783/1551] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:30:02 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:03.007557 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-58cfdc80-2bad-428b-ae43-7c233b0e7170 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:03.008496 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-58cfdc80-2bad-428b-ae43-7c233b0e7170 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:03.014486 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-58cfdc80-2bad-428b-ae43-7c233b0e7170 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:03.014928 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-58cfdc80-2bad-428b-ae43-7c233b0e7170 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:03.015692 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-58cfdc80-2bad-428b-ae43-7c233b0e7170 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:03.016110 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-58cfdc80-2bad-428b-ae43-7c233b0e7170 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:03.043826 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-58cfdc80-2bad-428b-ae43-7c233b0e7170 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040841 May 24 15:30:03.044386 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 769/1552] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:30:03 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:30:03.744700 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-9f4e4d3d-46cd-4d35-bd45-f3588c8aca23 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:03.746389 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-9f4e4d3d-46cd-4d35-bd45-f3588c8aca23 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:03.752640 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9f4e4d3d-46cd-4d35-bd45-f3588c8aca23 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:03.753090 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9f4e4d3d-46cd-4d35-bd45-f3588c8aca23 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:03.753851 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9f4e4d3d-46cd-4d35-bd45-f3588c8aca23 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:03.754286 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9f4e4d3d-46cd-4d35-bd45-f3588c8aca23 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:03.782702 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-9f4e4d3d-46cd-4d35-bd45-f3588c8aca23 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041988 May 24 15:30:03.783245 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 784/1553] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:30:03 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:03.941603 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-7229161d-eaf0-4f5c-b784-08ad47f54bf8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:03.942533 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-7229161d-eaf0-4f5c-b784-08ad47f54bf8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:03.949515 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7229161d-eaf0-4f5c-b784-08ad47f54bf8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:03.949968 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7229161d-eaf0-4f5c-b784-08ad47f54bf8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:03.950731 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7229161d-eaf0-4f5c-b784-08ad47f54bf8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:03.951167 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7229161d-eaf0-4f5c-b784-08ad47f54bf8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:03.979943 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-7229161d-eaf0-4f5c-b784-08ad47f54bf8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042317 May 24 15:30:03.980526 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 770/1554] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:30:03 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:04.055177 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-ecad4361-732d-4f77-8ff0-07d52bf70b79 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:04.056028 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-ecad4361-732d-4f77-8ff0-07d52bf70b79 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:04.062498 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ecad4361-732d-4f77-8ff0-07d52bf70b79 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:04.062939 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ecad4361-732d-4f77-8ff0-07d52bf70b79 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:04.063692 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ecad4361-732d-4f77-8ff0-07d52bf70b79 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:04.064120 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ecad4361-732d-4f77-8ff0-07d52bf70b79 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:04.093542 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-ecad4361-732d-4f77-8ff0-07d52bf70b79 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042351 May 24 15:30:04.094087 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 785/1555] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:30:04 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:30:04.857315 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-5ef3c451-070f-476d-8ddd-f8b1ffa7a919 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:04.858286 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-5ef3c451-070f-476d-8ddd-f8b1ffa7a919 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:04.864468 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5ef3c451-070f-476d-8ddd-f8b1ffa7a919 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:04.864911 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5ef3c451-070f-476d-8ddd-f8b1ffa7a919 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:04.865678 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5ef3c451-070f-476d-8ddd-f8b1ffa7a919 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:04.866089 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5ef3c451-070f-476d-8ddd-f8b1ffa7a919 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:04.895542 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-5ef3c451-070f-476d-8ddd-f8b1ffa7a919 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105421 May 24 15:30:04.896466 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 771/1556] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:30:04 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:04.992119 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-634570c7-48b7-4b18-9d9c-dd26891bd6f2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:04.993101 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-634570c7-48b7-4b18-9d9c-dd26891bd6f2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:04.999450 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-634570c7-48b7-4b18-9d9c-dd26891bd6f2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:04.999897 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-634570c7-48b7-4b18-9d9c-dd26891bd6f2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:05.000698 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-634570c7-48b7-4b18-9d9c-dd26891bd6f2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:05.001132 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-634570c7-48b7-4b18-9d9c-dd26891bd6f2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:05.030262 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-634570c7-48b7-4b18-9d9c-dd26891bd6f2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042898 May 24 15:30:05.030806 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 786/1557] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:30:04 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:05.105564 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-371291a5-731e-43e1-9f3f-7b57a20fa339 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:05.106470 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-371291a5-731e-43e1-9f3f-7b57a20fa339 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:05.113151 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-371291a5-731e-43e1-9f3f-7b57a20fa339 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:05.113587 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-371291a5-731e-43e1-9f3f-7b57a20fa339 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:05.114338 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-371291a5-731e-43e1-9f3f-7b57a20fa339 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:05.114765 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-371291a5-731e-43e1-9f3f-7b57a20fa339 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:05.143916 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-371291a5-731e-43e1-9f3f-7b57a20fa339 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042415 May 24 15:30:05.144477 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 772/1558] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 15:30:05 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 15:30:05.908102 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-206226b5-9e17-40cf-94b2-56240f6fcd69 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:05.908963 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-206226b5-9e17-40cf-94b2-56240f6fcd69 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:05.916171 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-206226b5-9e17-40cf-94b2-56240f6fcd69 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:05.916645 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-206226b5-9e17-40cf-94b2-56240f6fcd69 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:05.917402 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-206226b5-9e17-40cf-94b2-56240f6fcd69 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:05.917855 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-206226b5-9e17-40cf-94b2-56240f6fcd69 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:05.950530 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-206226b5-9e17-40cf-94b2-56240f6fcd69 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046774 May 24 15:30:05.951268 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 787/1559] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:30:05 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:06.041652 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f344366c-9b3d-4ebf-9d78-4e4b50fc7318 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:06.042571 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f344366c-9b3d-4ebf-9d78-4e4b50fc7318 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:06.048581 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f344366c-9b3d-4ebf-9d78-4e4b50fc7318 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:06.049020 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f344366c-9b3d-4ebf-9d78-4e4b50fc7318 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:06.049772 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f344366c-9b3d-4ebf-9d78-4e4b50fc7318 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:06.050203 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f344366c-9b3d-4ebf-9d78-4e4b50fc7318 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:06.078882 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f344366c-9b3d-4ebf-9d78-4e4b50fc7318 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041780 May 24 15:30:06.079755 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 773/1560] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:30:06 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:06.154912 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-46c44174-8ef4-4e09-bef3-0dfa510e75b6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:30:06.155830 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-46c44174-8ef4-4e09-bef3-0dfa510e75b6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:06.161821 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-46c44174-8ef4-4e09-bef3-0dfa510e75b6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:06.162210 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-46c44174-8ef4-4e09-bef3-0dfa510e75b6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:06.162963 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-46c44174-8ef4-4e09-bef3-0dfa510e75b6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:06.163399 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-46c44174-8ef4-4e09-bef3-0dfa510e75b6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:06.190189 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR oslo.messaging._drivers.impl_rabbit [None req-46c44174-8ef4-4e09-bef3-0dfa510e75b6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [582d52df-0ed1-4da7-9bbc-1b2c885fe4ce] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 24 15:30:06.962285 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-9cd84661-67f1-4f10-a4b7-3bb1af817b1d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:06.963138 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-9cd84661-67f1-4f10-a4b7-3bb1af817b1d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:06.971121 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9cd84661-67f1-4f10-a4b7-3bb1af817b1d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:06.971121 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9cd84661-67f1-4f10-a4b7-3bb1af817b1d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:06.971121 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9cd84661-67f1-4f10-a4b7-3bb1af817b1d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:06.971468 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9cd84661-67f1-4f10-a4b7-3bb1af817b1d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:07.001991 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-9cd84661-67f1-4f10-a4b7-3bb1af817b1d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043845 May 24 15:30:07.002552 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 774/1561] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:30:06 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:30:07.090341 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e0616d53-05d7-407e-9bb9-e6baf9e3a7f7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:07.091269 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-e0616d53-05d7-407e-9bb9-e6baf9e3a7f7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:07.097465 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e0616d53-05d7-407e-9bb9-e6baf9e3a7f7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:07.097910 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e0616d53-05d7-407e-9bb9-e6baf9e3a7f7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:07.098667 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e0616d53-05d7-407e-9bb9-e6baf9e3a7f7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:07.099103 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e0616d53-05d7-407e-9bb9-e6baf9e3a7f7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:07.128012 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-e0616d53-05d7-407e-9bb9-e6baf9e3a7f7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041636 May 24 15:30:07.128591 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 775/1562] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:30:07 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:30:07.196773 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO oslo.messaging._drivers.impl_rabbit [None req-46c44174-8ef4-4e09-bef3-0dfa510e75b6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [582d52df-0ed1-4da7-9bbc-1b2c885fe4ce] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 48954. May 24 15:30:07.279318 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-46c44174-8ef4-4e09-bef3-0dfa510e75b6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "POST /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/action" status: 200 len: 37576 microversion: 2.20 time: 1.128227 May 24 15:30:07.279986 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 788/1563] 10.222.0.45 () {62 vars in 1318 bytes} [Tue May 24 15:30:06 2022] POST /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078/action => generated 37576 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 24 15:30:08.013506 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-0c4147ec-d9fd-43fc-baae-51a30edc8f44 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:08.014423 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-0c4147ec-d9fd-43fc-baae-51a30edc8f44 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:08.020424 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0c4147ec-d9fd-43fc-baae-51a30edc8f44 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:08.020874 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0c4147ec-d9fd-43fc-baae-51a30edc8f44 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:08.021669 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0c4147ec-d9fd-43fc-baae-51a30edc8f44 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:08.022684 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0c4147ec-d9fd-43fc-baae-51a30edc8f44 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:08.047114 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:30:08.051987 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-0c4147ec-d9fd-43fc-baae-51a30edc8f44 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042433 May 24 15:30:08.052581 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 776/1564] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:30:08 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:08.140009 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d7ee312d-bd36-41e0-b3b9-6573ccaf7b3f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:08.141118 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d7ee312d-bd36-41e0-b3b9-6573ccaf7b3f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:08.148246 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d7ee312d-bd36-41e0-b3b9-6573ccaf7b3f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:08.148719 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d7ee312d-bd36-41e0-b3b9-6573ccaf7b3f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:08.149476 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d7ee312d-bd36-41e0-b3b9-6573ccaf7b3f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:08.149906 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d7ee312d-bd36-41e0-b3b9-6573ccaf7b3f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:08.178757 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d7ee312d-bd36-41e0-b3b9-6573ccaf7b3f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042579 May 24 15:30:08.179306 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 789/1565] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:30:08 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:09.064020 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-5d09bc26-4b2b-49fb-be60-4d825ab6f00b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:09.065013 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-5d09bc26-4b2b-49fb-be60-4d825ab6f00b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:09.072679 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5d09bc26-4b2b-49fb-be60-4d825ab6f00b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:09.073090 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5d09bc26-4b2b-49fb-be60-4d825ab6f00b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:09.073876 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5d09bc26-4b2b-49fb-be60-4d825ab6f00b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:09.074308 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5d09bc26-4b2b-49fb-be60-4d825ab6f00b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:09.104914 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-5d09bc26-4b2b-49fb-be60-4d825ab6f00b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044866 May 24 15:30:09.108482 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 777/1566] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:30:09 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:09.190205 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c547936e-6de9-4e9a-815f-057f9ac05a30 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:09.191179 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-c547936e-6de9-4e9a-815f-057f9ac05a30 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:09.198252 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c547936e-6de9-4e9a-815f-057f9ac05a30 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:09.198694 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c547936e-6de9-4e9a-815f-057f9ac05a30 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:09.199445 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c547936e-6de9-4e9a-815f-057f9ac05a30 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:09.199877 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c547936e-6de9-4e9a-815f-057f9ac05a30 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:09.227981 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-c547936e-6de9-4e9a-815f-057f9ac05a30 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041791 May 24 15:30:09.228550 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 790/1567] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:30:09 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:10.116289 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-dc2945f9-84f5-428b-be6b-4ab0cf18466f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:10.117255 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-dc2945f9-84f5-428b-be6b-4ab0cf18466f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:10.123722 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dc2945f9-84f5-428b-be6b-4ab0cf18466f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:10.124242 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dc2945f9-84f5-428b-be6b-4ab0cf18466f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:10.127235 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dc2945f9-84f5-428b-be6b-4ab0cf18466f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:10.127235 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dc2945f9-84f5-428b-be6b-4ab0cf18466f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:10.155306 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-dc2945f9-84f5-428b-be6b-4ab0cf18466f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043447 May 24 15:30:10.158730 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 778/1568] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:30:10 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:10.240099 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e6ec760f-0ecc-45b6-bfc4-0f530669432b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:10.241624 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e6ec760f-0ecc-45b6-bfc4-0f530669432b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:10.244075 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_api:SELECT=82 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:30:10.249277 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e6ec760f-0ecc-45b6-bfc4-0f530669432b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:10.249721 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e6ec760f-0ecc-45b6-bfc4-0f530669432b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:10.250474 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e6ec760f-0ecc-45b6-bfc4-0f530669432b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:10.250905 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e6ec760f-0ecc-45b6-bfc4-0f530669432b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:10.278948 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e6ec760f-0ecc-45b6-bfc4-0f530669432b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042796 May 24 15:30:10.279485 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 791/1569] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:30:10 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:11.166597 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-4cd0e333-1f6c-488b-ac5f-e7a4dfc14c9e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:11.167825 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-4cd0e333-1f6c-488b-ac5f-e7a4dfc14c9e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:11.174316 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4cd0e333-1f6c-488b-ac5f-e7a4dfc14c9e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:11.174761 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4cd0e333-1f6c-488b-ac5f-e7a4dfc14c9e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:11.175545 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4cd0e333-1f6c-488b-ac5f-e7a4dfc14c9e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:11.175978 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4cd0e333-1f6c-488b-ac5f-e7a4dfc14c9e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:11.206080 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-4cd0e333-1f6c-488b-ac5f-e7a4dfc14c9e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043520 May 24 15:30:11.206634 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 779/1570] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:30:11 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:11.290382 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-1961dc87-a58b-4d0b-a26d-68cd463df041 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:11.291298 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-1961dc87-a58b-4d0b-a26d-68cd463df041 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:11.297841 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1961dc87-a58b-4d0b-a26d-68cd463df041 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:11.298225 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1961dc87-a58b-4d0b-a26d-68cd463df041 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:11.298977 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1961dc87-a58b-4d0b-a26d-68cd463df041 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:11.299407 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1961dc87-a58b-4d0b-a26d-68cd463df041 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:11.330890 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-1961dc87-a58b-4d0b-a26d-68cd463df041 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044484 May 24 15:30:11.331451 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 792/1571] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:30:11 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:12.217610 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-75867695-d2e3-48db-8030-04a257ab76fa tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:12.218587 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-75867695-d2e3-48db-8030-04a257ab76fa tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:12.226794 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-75867695-d2e3-48db-8030-04a257ab76fa tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:12.227257 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-75867695-d2e3-48db-8030-04a257ab76fa tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:12.228017 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-75867695-d2e3-48db-8030-04a257ab76fa tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:12.228480 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-75867695-d2e3-48db-8030-04a257ab76fa tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:12.259301 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-75867695-d2e3-48db-8030-04a257ab76fa tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045784 May 24 15:30:12.259862 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 780/1572] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:30:12 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:12.342251 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-f6aa6148-031b-45c8-9982-ff9b3d7d978b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:12.343156 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-f6aa6148-031b-45c8-9982-ff9b3d7d978b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:12.349657 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f6aa6148-031b-45c8-9982-ff9b3d7d978b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:12.350183 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f6aa6148-031b-45c8-9982-ff9b3d7d978b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:12.351237 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f6aa6148-031b-45c8-9982-ff9b3d7d978b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:12.351828 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f6aa6148-031b-45c8-9982-ff9b3d7d978b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:12.382149 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-f6aa6148-031b-45c8-9982-ff9b3d7d978b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043300 May 24 15:30:12.382696 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 793/1573] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:30:12 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:13.270774 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e518c924-925f-48b4-af89-65c756170e3d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:13.271768 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-e518c924-925f-48b4-af89-65c756170e3d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:13.278935 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e518c924-925f-48b4-af89-65c756170e3d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:13.279552 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e518c924-925f-48b4-af89-65c756170e3d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:13.280332 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e518c924-925f-48b4-af89-65c756170e3d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:13.280766 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e518c924-925f-48b4-af89-65c756170e3d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:13.310195 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-e518c924-925f-48b4-af89-65c756170e3d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043292 May 24 15:30:13.310911 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 781/1574] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:30:13 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:13.350857 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-f013dc52-24d5-4f66-ac8f-0cdfde2bb24a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:13.351339 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-f013dc52-24d5-4f66-ac8f-0cdfde2bb24a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:13.357743 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f013dc52-24d5-4f66-ac8f-0cdfde2bb24a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:13.358192 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f013dc52-24d5-4f66-ac8f-0cdfde2bb24a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:13.358953 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f013dc52-24d5-4f66-ac8f-0cdfde2bb24a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:13.359386 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f013dc52-24d5-4f66-ac8f-0cdfde2bb24a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:13.363375 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:30:13.393540 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-3e6b064e-eec4-4a3e-aaf4-1e386f189a9e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:13.394459 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-3e6b064e-eec4-4a3e-aaf4-1e386f189a9e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:13.401049 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3e6b064e-eec4-4a3e-aaf4-1e386f189a9e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:13.401494 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3e6b064e-eec4-4a3e-aaf4-1e386f189a9e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:13.402250 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3e6b064e-eec4-4a3e-aaf4-1e386f189a9e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:13.402680 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3e6b064e-eec4-4a3e-aaf4-1e386f189a9e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:13.431476 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-3e6b064e-eec4-4a3e-aaf4-1e386f189a9e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041769 May 24 15:30:13.432054 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 782/1575] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:30:13 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:13.484597 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.objects.instance [None req-f013dc52-24d5-4f66-ac8f-0cdfde2bb24a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lazy-loading 'services' on Instance uuid 916e547e-8501-44fe-8429-5f9086c85992 {{(pid=117698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 15:30:13.552865 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-f013dc52-24d5-4f66-ac8f-0cdfde2bb24a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "DELETE /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992/os-volume_attachments/452abb5b-7074-4881-9fb9-b55772c9799b" status: 202 len: 0 microversion: 2.1 time: 0.206324 May 24 15:30:13.553483 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 794/1576] 10.222.0.45 () {58 vars in 1415 bytes} [Tue May 24 15:30:13 2022] DELETE /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992/os-volume_attachments/452abb5b-7074-4881-9fb9-b55772c9799b => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 15:30:14.321607 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-46a3729c-f8b7-4381-9a87-a7028fa1b509 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:14.322532 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-46a3729c-f8b7-4381-9a87-a7028fa1b509 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:14.329242 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-46a3729c-f8b7-4381-9a87-a7028fa1b509 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:14.329688 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-46a3729c-f8b7-4381-9a87-a7028fa1b509 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:14.330447 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-46a3729c-f8b7-4381-9a87-a7028fa1b509 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:14.330875 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-46a3729c-f8b7-4381-9a87-a7028fa1b509 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:14.364484 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-46a3729c-f8b7-4381-9a87-a7028fa1b509 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047423 May 24 15:30:14.365068 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 783/1577] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:30:14 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:14.443359 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-0305d8af-894c-4b56-a0f6-c35f5e3cd31f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:14.444442 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-0305d8af-894c-4b56-a0f6-c35f5e3cd31f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:14.450724 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0305d8af-894c-4b56-a0f6-c35f5e3cd31f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:14.451173 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0305d8af-894c-4b56-a0f6-c35f5e3cd31f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:14.451933 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0305d8af-894c-4b56-a0f6-c35f5e3cd31f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:14.452406 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0305d8af-894c-4b56-a0f6-c35f5e3cd31f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:14.481330 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-0305d8af-894c-4b56-a0f6-c35f5e3cd31f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042915 May 24 15:30:14.481875 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 795/1578] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:30:14 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:15.376593 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-0f53d127-fad1-4931-98f7-fa1894df9ecd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:15.377519 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-0f53d127-fad1-4931-98f7-fa1894df9ecd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:15.384535 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0f53d127-fad1-4931-98f7-fa1894df9ecd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:15.384988 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0f53d127-fad1-4931-98f7-fa1894df9ecd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:15.385751 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0f53d127-fad1-4931-98f7-fa1894df9ecd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:15.386182 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0f53d127-fad1-4931-98f7-fa1894df9ecd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:15.415559 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-0f53d127-fad1-4931-98f7-fa1894df9ecd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042915 May 24 15:30:15.416106 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 784/1579] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:30:15 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:15.492601 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c83291ee-e9a0-4edd-9632-d0aa09cdb83c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:15.493520 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-c83291ee-e9a0-4edd-9632-d0aa09cdb83c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:15.499975 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c83291ee-e9a0-4edd-9632-d0aa09cdb83c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:15.500466 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c83291ee-e9a0-4edd-9632-d0aa09cdb83c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:15.501230 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c83291ee-e9a0-4edd-9632-d0aa09cdb83c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:15.501664 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c83291ee-e9a0-4edd-9632-d0aa09cdb83c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:15.531580 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-c83291ee-e9a0-4edd-9632-d0aa09cdb83c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042909 May 24 15:30:15.532144 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 796/1580] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:30:15 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:16.166352 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 15:30:16.166516 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Tue May 24 15:30:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 15:30:16.426568 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-9963959c-69ab-46f7-aa18-0fe734871e45 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:16.427483 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-9963959c-69ab-46f7-aa18-0fe734871e45 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:16.434044 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9963959c-69ab-46f7-aa18-0fe734871e45 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:16.434557 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9963959c-69ab-46f7-aa18-0fe734871e45 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:16.435226 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9963959c-69ab-46f7-aa18-0fe734871e45 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:16.435653 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9963959c-69ab-46f7-aa18-0fe734871e45 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:16.464978 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-9963959c-69ab-46f7-aa18-0fe734871e45 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042272 May 24 15:30:16.465531 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 785/1581] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:30:16 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:16.543493 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-8d6cbc4e-c3f4-453f-a573-11b68466e99d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:16.544430 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-8d6cbc4e-c3f4-453f-a573-11b68466e99d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:16.550863 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8d6cbc4e-c3f4-453f-a573-11b68466e99d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:16.551301 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8d6cbc4e-c3f4-453f-a573-11b68466e99d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:16.552048 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8d6cbc4e-c3f4-453f-a573-11b68466e99d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:16.552508 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8d6cbc4e-c3f4-453f-a573-11b68466e99d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:16.579726 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-8d6cbc4e-c3f4-453f-a573-11b68466e99d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040155 May 24 15:30:16.580258 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 797/1582] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:30:16 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:17.476702 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-8e7594df-b096-4e54-91aa-743d2617e029 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:17.477631 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-8e7594df-b096-4e54-91aa-743d2617e029 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:17.484418 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8e7594df-b096-4e54-91aa-743d2617e029 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:17.484884 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8e7594df-b096-4e54-91aa-743d2617e029 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:17.485907 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8e7594df-b096-4e54-91aa-743d2617e029 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:17.486358 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8e7594df-b096-4e54-91aa-743d2617e029 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:17.515351 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-8e7594df-b096-4e54-91aa-743d2617e029 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043105 May 24 15:30:17.515899 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 786/1583] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:30:17 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:17.591140 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-de861621-7d3e-4529-9298-2a9c9918dd1e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:17.592058 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-de861621-7d3e-4529-9298-2a9c9918dd1e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:17.598509 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-de861621-7d3e-4529-9298-2a9c9918dd1e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:17.598959 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-de861621-7d3e-4529-9298-2a9c9918dd1e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:17.599720 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-de861621-7d3e-4529-9298-2a9c9918dd1e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:17.600683 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-de861621-7d3e-4529-9298-2a9c9918dd1e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:17.628945 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-de861621-7d3e-4529-9298-2a9c9918dd1e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041746 May 24 15:30:17.629492 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 798/1584] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:30:17 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:18.527263 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-52efc48e-1756-4395-aa91-569af40e74b1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:18.528204 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-52efc48e-1756-4395-aa91-569af40e74b1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:18.534719 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-52efc48e-1756-4395-aa91-569af40e74b1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:18.535168 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-52efc48e-1756-4395-aa91-569af40e74b1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:18.535929 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-52efc48e-1756-4395-aa91-569af40e74b1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:18.536413 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-52efc48e-1756-4395-aa91-569af40e74b1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:18.565173 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-52efc48e-1756-4395-aa91-569af40e74b1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041791 May 24 15:30:18.565721 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 787/1585] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:30:18 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:18.640376 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-64feff4f-7f6c-4f03-8535-fadc4d4b4eea tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:18.641234 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-64feff4f-7f6c-4f03-8535-fadc4d4b4eea tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:18.647665 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-64feff4f-7f6c-4f03-8535-fadc4d4b4eea tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:18.648111 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-64feff4f-7f6c-4f03-8535-fadc4d4b4eea tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:18.648907 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-64feff4f-7f6c-4f03-8535-fadc4d4b4eea tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:18.649344 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-64feff4f-7f6c-4f03-8535-fadc4d4b4eea tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:18.676764 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-64feff4f-7f6c-4f03-8535-fadc4d4b4eea tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040353 May 24 15:30:18.677301 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 799/1586] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:30:18 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:19.577084 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a0fa455a-5353-468d-ba76-f1b9c2b22bb3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:19.578014 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a0fa455a-5353-468d-ba76-f1b9c2b22bb3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:19.584994 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a0fa455a-5353-468d-ba76-f1b9c2b22bb3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:19.585441 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a0fa455a-5353-468d-ba76-f1b9c2b22bb3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:19.586205 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a0fa455a-5353-468d-ba76-f1b9c2b22bb3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:19.586641 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a0fa455a-5353-468d-ba76-f1b9c2b22bb3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:19.616036 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a0fa455a-5353-468d-ba76-f1b9c2b22bb3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042872 May 24 15:30:19.616614 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 788/1587] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:30:19 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:19.688677 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-4b558e7a-7e40-4db3-a160-2af90429d92f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:19.689608 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-4b558e7a-7e40-4db3-a160-2af90429d92f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:19.696501 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4b558e7a-7e40-4db3-a160-2af90429d92f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:19.696942 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4b558e7a-7e40-4db3-a160-2af90429d92f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:19.697680 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4b558e7a-7e40-4db3-a160-2af90429d92f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:19.698102 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4b558e7a-7e40-4db3-a160-2af90429d92f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:19.725848 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-4b558e7a-7e40-4db3-a160-2af90429d92f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041296 May 24 15:30:19.726379 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 800/1588] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:30:19 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:20.627174 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-1043f814-9a42-42b2-8ee9-a09d2d6fb1ec tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:20.628099 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-1043f814-9a42-42b2-8ee9-a09d2d6fb1ec tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:20.634596 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1043f814-9a42-42b2-8ee9-a09d2d6fb1ec tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:20.635042 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1043f814-9a42-42b2-8ee9-a09d2d6fb1ec tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:20.635801 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1043f814-9a42-42b2-8ee9-a09d2d6fb1ec tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:20.636232 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1043f814-9a42-42b2-8ee9-a09d2d6fb1ec tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:20.664847 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-1043f814-9a42-42b2-8ee9-a09d2d6fb1ec tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041549 May 24 15:30:20.665398 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 789/1589] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:30:20 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:20.736827 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-2b89be38-e308-4cdf-ba47-aea63b889a88 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:20.737776 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-2b89be38-e308-4cdf-ba47-aea63b889a88 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:20.744896 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2b89be38-e308-4cdf-ba47-aea63b889a88 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:20.745340 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2b89be38-e308-4cdf-ba47-aea63b889a88 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:20.746102 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2b89be38-e308-4cdf-ba47-aea63b889a88 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:20.746530 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2b89be38-e308-4cdf-ba47-aea63b889a88 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:20.774398 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-2b89be38-e308-4cdf-ba47-aea63b889a88 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041837 May 24 15:30:20.774944 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 801/1590] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:30:20 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:21.676330 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-009bc847-653b-4ac6-a759-9c608944de13 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:21.677263 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-009bc847-653b-4ac6-a759-9c608944de13 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:21.686651 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-009bc847-653b-4ac6-a759-9c608944de13 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:21.687330 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-009bc847-653b-4ac6-a759-9c608944de13 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:21.688532 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-009bc847-653b-4ac6-a759-9c608944de13 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:21.689204 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-009bc847-653b-4ac6-a759-9c608944de13 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:21.730326 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-009bc847-653b-4ac6-a759-9c608944de13 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057940 May 24 15:30:21.730871 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 790/1591] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:30:21 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:30:21.785829 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-1d3802a7-69af-4ec9-ba7a-82cec031c279 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:21.786789 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-1d3802a7-69af-4ec9-ba7a-82cec031c279 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:21.793284 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1d3802a7-69af-4ec9-ba7a-82cec031c279 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:21.793739 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1d3802a7-69af-4ec9-ba7a-82cec031c279 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:21.794498 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1d3802a7-69af-4ec9-ba7a-82cec031c279 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:21.794932 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1d3802a7-69af-4ec9-ba7a-82cec031c279 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:21.823713 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-1d3802a7-69af-4ec9-ba7a-82cec031c279 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041819 May 24 15:30:21.824545 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 802/1592] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:30:21 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:22.742218 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-7be78eeb-78d4-40cc-9b6c-8b6c2886858a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:22.743146 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-7be78eeb-78d4-40cc-9b6c-8b6c2886858a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:22.749760 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7be78eeb-78d4-40cc-9b6c-8b6c2886858a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:22.750214 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7be78eeb-78d4-40cc-9b6c-8b6c2886858a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:22.750995 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7be78eeb-78d4-40cc-9b6c-8b6c2886858a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:22.751430 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7be78eeb-78d4-40cc-9b6c-8b6c2886858a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:22.780870 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-7be78eeb-78d4-40cc-9b6c-8b6c2886858a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042821 May 24 15:30:22.781419 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 791/1593] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:30:22 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:22.835836 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-8fb4486a-925e-467c-a690-a5e88f851005 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:22.836881 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-8fb4486a-925e-467c-a690-a5e88f851005 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:22.843304 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8fb4486a-925e-467c-a690-a5e88f851005 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:22.843764 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8fb4486a-925e-467c-a690-a5e88f851005 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:22.844534 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8fb4486a-925e-467c-a690-a5e88f851005 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:22.844965 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8fb4486a-925e-467c-a690-a5e88f851005 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:22.872728 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-8fb4486a-925e-467c-a690-a5e88f851005 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041439 May 24 15:30:22.873269 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 803/1594] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:30:22 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:23.792997 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-4fa1d877-08cd-4c01-9ee3-760c9bd2c59f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:23.793910 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-4fa1d877-08cd-4c01-9ee3-760c9bd2c59f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:23.800403 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4fa1d877-08cd-4c01-9ee3-760c9bd2c59f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:23.800848 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4fa1d877-08cd-4c01-9ee3-760c9bd2c59f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:23.801603 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4fa1d877-08cd-4c01-9ee3-760c9bd2c59f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:23.802031 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4fa1d877-08cd-4c01-9ee3-760c9bd2c59f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:23.829829 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-4fa1d877-08cd-4c01-9ee3-760c9bd2c59f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041413 May 24 15:30:23.830366 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 792/1595] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:30:23 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:23.884208 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-0a4f56ee-f417-45e8-b4c8-8abd6af8c254 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:23.885171 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-0a4f56ee-f417-45e8-b4c8-8abd6af8c254 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:23.891538 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0a4f56ee-f417-45e8-b4c8-8abd6af8c254 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:23.891990 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0a4f56ee-f417-45e8-b4c8-8abd6af8c254 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:23.892775 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0a4f56ee-f417-45e8-b4c8-8abd6af8c254 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:23.893203 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0a4f56ee-f417-45e8-b4c8-8abd6af8c254 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:23.921736 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-0a4f56ee-f417-45e8-b4c8-8abd6af8c254 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041456 May 24 15:30:23.922290 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 804/1596] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:30:23 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:24.012153 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 15:30:24.012345 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Tue May 24 15:30:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 15:30:24.841049 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-3c5db3cb-eeef-40ee-bb72-70b23dfb684f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:24.841999 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-3c5db3cb-eeef-40ee-bb72-70b23dfb684f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:24.848567 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3c5db3cb-eeef-40ee-bb72-70b23dfb684f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:24.849011 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3c5db3cb-eeef-40ee-bb72-70b23dfb684f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:24.849757 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3c5db3cb-eeef-40ee-bb72-70b23dfb684f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:24.850202 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3c5db3cb-eeef-40ee-bb72-70b23dfb684f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:24.866980 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:30:24.880084 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-3c5db3cb-eeef-40ee-bb72-70b23dfb684f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042940 May 24 15:30:24.880650 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 793/1597] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:30:24 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:24.933343 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c68beb1a-25dd-4257-bcda-c8411f352a2f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:24.934257 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-c68beb1a-25dd-4257-bcda-c8411f352a2f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:24.940753 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c68beb1a-25dd-4257-bcda-c8411f352a2f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:24.941141 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c68beb1a-25dd-4257-bcda-c8411f352a2f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:24.941890 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c68beb1a-25dd-4257-bcda-c8411f352a2f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:24.942315 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c68beb1a-25dd-4257-bcda-c8411f352a2f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:24.969470 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-c68beb1a-25dd-4257-bcda-c8411f352a2f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040730 May 24 15:30:24.970004 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 805/1598] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:30:24 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:25.892077 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-8a877684-b8b4-45a1-be2f-a4af913de71e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:25.893035 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-8a877684-b8b4-45a1-be2f-a4af913de71e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:25.900500 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8a877684-b8b4-45a1-be2f-a4af913de71e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:25.900975 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8a877684-b8b4-45a1-be2f-a4af913de71e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:25.901737 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8a877684-b8b4-45a1-be2f-a4af913de71e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:25.902172 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8a877684-b8b4-45a1-be2f-a4af913de71e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:25.929797 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-8a877684-b8b4-45a1-be2f-a4af913de71e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041573 May 24 15:30:25.930344 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 794/1599] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:30:25 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:25.980228 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-684ebd78-237a-4458-a6a6-3f228cde0170 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:25.981180 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-684ebd78-237a-4458-a6a6-3f228cde0170 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:25.987822 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-684ebd78-237a-4458-a6a6-3f228cde0170 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:25.988258 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-684ebd78-237a-4458-a6a6-3f228cde0170 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:25.989029 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-684ebd78-237a-4458-a6a6-3f228cde0170 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:25.989454 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-684ebd78-237a-4458-a6a6-3f228cde0170 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:26.017729 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-684ebd78-237a-4458-a6a6-3f228cde0170 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041434 May 24 15:30:26.018269 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 806/1600] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:30:25 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:26.941040 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-3b9b8423-da81-47ad-93a4-0ce0c3b23bb7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:26.942025 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-3b9b8423-da81-47ad-93a4-0ce0c3b23bb7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:26.948498 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3b9b8423-da81-47ad-93a4-0ce0c3b23bb7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:26.948933 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3b9b8423-da81-47ad-93a4-0ce0c3b23bb7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:26.949723 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3b9b8423-da81-47ad-93a4-0ce0c3b23bb7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:26.950157 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3b9b8423-da81-47ad-93a4-0ce0c3b23bb7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:26.979463 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-3b9b8423-da81-47ad-93a4-0ce0c3b23bb7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042266 May 24 15:30:26.980024 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 795/1601] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:30:26 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:27.029780 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-1a082dbc-22ce-4c7a-9fc6-54da029cc410 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:27.030698 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-1a082dbc-22ce-4c7a-9fc6-54da029cc410 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:27.037202 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1a082dbc-22ce-4c7a-9fc6-54da029cc410 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:27.037650 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1a082dbc-22ce-4c7a-9fc6-54da029cc410 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:27.039430 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1a082dbc-22ce-4c7a-9fc6-54da029cc410 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:27.039874 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1a082dbc-22ce-4c7a-9fc6-54da029cc410 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:27.071007 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-1a082dbc-22ce-4c7a-9fc6-54da029cc410 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045180 May 24 15:30:27.071583 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 807/1602] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:30:27 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:30:27.995802 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-88959ef6-9346-4509-b887-fd1d2639542a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:27.997333 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-88959ef6-9346-4509-b887-fd1d2639542a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:28.006392 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-88959ef6-9346-4509-b887-fd1d2639542a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:28.007052 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-88959ef6-9346-4509-b887-fd1d2639542a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:28.008218 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-88959ef6-9346-4509-b887-fd1d2639542a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:28.010436 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-88959ef6-9346-4509-b887-fd1d2639542a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:28.045920 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-88959ef6-9346-4509-b887-fd1d2639542a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058428 May 24 15:30:28.046487 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 796/1603] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:30:27 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:28.083490 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-b6e97614-2276-4e2c-8ea1-6e6fb20c48fb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:28.084921 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-b6e97614-2276-4e2c-8ea1-6e6fb20c48fb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:28.091222 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b6e97614-2276-4e2c-8ea1-6e6fb20c48fb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:28.091746 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b6e97614-2276-4e2c-8ea1-6e6fb20c48fb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:28.092670 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b6e97614-2276-4e2c-8ea1-6e6fb20c48fb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:28.093104 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b6e97614-2276-4e2c-8ea1-6e6fb20c48fb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:28.124315 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-b6e97614-2276-4e2c-8ea1-6e6fb20c48fb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044837 May 24 15:30:28.124878 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 808/1604] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:30:28 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:29.057858 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-01c98528-6517-4f75-b265-04bbcd2807a5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:29.058782 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-01c98528-6517-4f75-b265-04bbcd2807a5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:29.065298 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-01c98528-6517-4f75-b265-04bbcd2807a5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:29.065804 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-01c98528-6517-4f75-b265-04bbcd2807a5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:29.066575 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-01c98528-6517-4f75-b265-04bbcd2807a5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:29.067010 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-01c98528-6517-4f75-b265-04bbcd2807a5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:29.096467 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-01c98528-6517-4f75-b265-04bbcd2807a5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042894 May 24 15:30:29.097011 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 797/1605] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:30:29 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:29.135549 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-176e6410-14fb-468a-b8ea-63c1d873c77c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:30:29.136492 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-176e6410-14fb-468a-b8ea-63c1d873c77c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:29.142867 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-176e6410-14fb-468a-b8ea-63c1d873c77c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:29.143312 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-176e6410-14fb-468a-b8ea-63c1d873c77c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:29.144052 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-176e6410-14fb-468a-b8ea-63c1d873c77c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:29.144767 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-176e6410-14fb-468a-b8ea-63c1d873c77c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:29.255862 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-176e6410-14fb-468a-b8ea-63c1d873c77c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "POST /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/action" status: 200 len: 82459 microversion: 2.1 time: 0.124463 May 24 15:30:29.256474 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 809/1606] 10.222.0.45 () {60 vars in 1277 bytes} [Tue May 24 15:30:29 2022] POST /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/action => generated 82459 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:30:29.273501 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e971e1de-a7e4-4f5f-a2dc-3f837fdecaed tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:29.273995 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-e971e1de-a7e4-4f5f-a2dc-3f837fdecaed tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:29.279927 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e971e1de-a7e4-4f5f-a2dc-3f837fdecaed tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:29.280400 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e971e1de-a7e4-4f5f-a2dc-3f837fdecaed tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:29.281152 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e971e1de-a7e4-4f5f-a2dc-3f837fdecaed tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:29.281581 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e971e1de-a7e4-4f5f-a2dc-3f837fdecaed tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:29.404213 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.objects.instance [None req-e971e1de-a7e4-4f5f-a2dc-3f837fdecaed tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lazy-loading 'services' on Instance uuid c395e512-b693-4a96-8301-640831fee66f {{(pid=117699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 15:30:29.473286 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.wsgi [None req-e971e1de-a7e4-4f5f-a2dc-3f837fdecaed tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-89f38dc0-9624-4612-9f17-49febbb4c5f2) May 24 15:30:29.475564 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e971e1de-a7e4-4f5f-a2dc-3f837fdecaed tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Request method failure captured: May 24 15:30:29.475564 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: request: DELETE /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments/3cbf20c3-d23e-45ec-9308-c45fc0665b2d HTTP/1.1 May 24 15:30:29.475564 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Accept: application/json May 24 15:30:29.475564 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Accept-Encoding: identity May 24 15:30:29.475564 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Connection: close May 24 15:30:29.475564 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Content-Length: 0 May 24 15:30:29.475564 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Content-Type: application/json May 24 15:30:29.475564 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Host: 10.222.0.45 May 24 15:30:29.475564 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Openstack-System-Scope: None May 24 15:30:29.475564 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: User-Agent: python-urllib3/1.26.9 May 24 15:30:29.475564 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Auth-Token: gAAAAABijPf3hbzaQ2q_50dWN8uyrmL0bH3gHJUI1qR4lwUaHdEYkXcL6WaB_6pU7VawA-vKIbnVIBhg1jtwSvF5czVBBxVzlxXG5SVCBL6kqJ-k6DF-LmL8UV6_PmlBBEV7FP5rIUcj2-lUnQbc6lx2eFGqzHlcys82OR1ztXTizf9gy3fzauA May 24 15:30:29.475564 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Domain-Id: None May 24 15:30:29.475564 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Domain-Name: None May 24 15:30:29.475564 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Identity-Status: Confirmed May 24 15:30:29.475564 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Is-Admin-Project: True May 24 15:30:29.475564 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Domain-Id: default May 24 15:30:29.475564 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Domain-Name: Default May 24 15:30:29.475564 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Id: cb659dae6f4b4f26a2d869138f573561 May 24 15:30:29.475564 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Name: tempest-TestMinimumBasicScenario-226540700 May 24 15:30:29.475564 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Role: reader,member May 24 15:30:29.475564 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Roles: reader,member May 24 15:30:29.477716 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cb659dae6f4b4f26a2d869138f573561"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cb659dae6f4b4f26a2d869138f573561"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/cb659dae6f4b4f26a2d869138f573561"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_cb659dae6f4b4f26a2d869138f573561"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 24 15:30:29.477716 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant: tempest-TestMinimumBasicScenario-226540700 May 24 15:30:29.477716 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant-Id: cb659dae6f4b4f26a2d869138f573561 May 24 15:30:29.477716 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant-Name: tempest-TestMinimumBasicScenario-226540700 May 24 15:30:29.477716 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User: tempest-TestMinimumBasicScenario-226540700-project May 24 15:30:29.477716 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Domain-Id: default May 24 15:30:29.477716 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Domain-Name: Default May 24 15:30:29.477716 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Id: 927951dcdbb348d6ac8d467753c55d61 May 24 15:30:29.477716 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Name: tempest-TestMinimumBasicScenario-226540700-project May 24 15:30:29.477716 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: method: > May 24 15:30:29.478646 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-89f38dc0-9624-4612-9f17-49febbb4c5f2) May 24 15:30:29.478646 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: action_args: {'server_id': 'c395e512-b693-4a96-8301-640831fee66f', 'id': '3cbf20c3-d23e-45ec-9308-c45fc0665b2d'} May 24 15:30:29.478646 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:30:29.478646 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:30:29.478646 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 24 15:30:29.478646 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 24 15:30:29.478646 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 15:30:29.478646 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 15:30:29.478646 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 24 15:30:29.478646 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 24 15:30:29.478646 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 24 15:30:29.478646 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 24 15:30:29.478646 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 24 15:30:29.478646 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 24 15:30:29.478646 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 24 15:30:29.478646 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 24 15:30:29.478646 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 15:30:29.479952 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 15:30:29.479952 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 15:30:29.479952 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 15:30:29.479952 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-89f38dc0-9624-4612-9f17-49febbb4c5f2) May 24 15:30:29.479952 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:30:29.479952 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:30:29.479952 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:30:29.479952 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:30:29.479952 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 24 15:30:29.479952 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 24 15:30:29.479952 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 24 15:30:29.479952 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 24 15:30:29.479952 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 24 15:30:29.479952 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 24 15:30:29.479952 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 24 15:30:29.479952 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 24 15:30:29.479952 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 15:30:29.479952 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 15:30:29.479952 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 24 15:30:29.481495 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 24 15:30:29.481495 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 24 15:30:29.481495 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 24 15:30:29.481495 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 24 15:30:29.481495 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 24 15:30:29.481495 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 24 15:30:29.481495 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 24 15:30:29.481495 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 15:30:29.481495 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 15:30:29.481495 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 15:30:29.481495 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 15:30:29.481495 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-89f38dc0-9624-4612-9f17-49febbb4c5f2) May 24 15:30:29.481495 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:30:29.481495 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:30:29.481495 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:30:29.481495 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:30:29.481495 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 24 15:30:29.482698 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 24 15:30:29.482698 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 24 15:30:29.482698 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 24 15:30:29.482698 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 24 15:30:29.482698 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 24 15:30:29.482698 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 24 15:30:29.482698 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 24 15:30:29.482698 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 24 15:30:29.482698 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 24 15:30:29.482698 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 24 15:30:29.482698 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 24 15:30:29.482698 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-89f38dc0-9624-4612-9f17-49febbb4c5f2) May 24 15:30:29.482698 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:30:29.482698 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:30:29.482698 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:30:29.482698 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:30:29.482698 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:30:29.482698 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:30:29.484017 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:30:29.484017 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:30:29.484017 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:30:29.484017 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:30:29.484017 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 24 15:30:29.484017 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 24 15:30:29.484017 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-89f38dc0-9624-4612-9f17-49febbb4c5f2) May 24 15:30:29.484017 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:30:29.484017 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:30:29.484017 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:30:29.484017 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:30:29.484017 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:30:29.484017 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:30:29.484017 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:30:29.484017 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:30:29.484017 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-89f38dc0-9624-4612-9f17-49febbb4c5f2) May 24 15:30:29.484017 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:30:29.485305 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e971e1de-a7e4-4f5f-a2dc-3f837fdecaed tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-89f38dc0-9624-4612-9f17-49febbb4c5f2) {{(pid=117699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:30:29.485305 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-e971e1de-a7e4-4f5f-a2dc-3f837fdecaed tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments/3cbf20c3-d23e-45ec-9308-c45fc0665b2d" status: 400 len: 269 microversion: 2.1 time: 0.208194 May 24 15:30:29.485305 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 798/1607] 10.222.0.45 () {58 vars in 1415 bytes} [Tue May 24 15:30:29 2022] DELETE /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f/os-volume_attachments/3cbf20c3-d23e-45ec-9308-c45fc0665b2d => generated 269 bytes in 209 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 24 15:30:30.108785 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-79b17032-94bd-48a1-84e1-4da2b804cc06 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:30.109787 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-79b17032-94bd-48a1-84e1-4da2b804cc06 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:30.117038 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-79b17032-94bd-48a1-84e1-4da2b804cc06 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:30.117482 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-79b17032-94bd-48a1-84e1-4da2b804cc06 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:30.118232 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-79b17032-94bd-48a1-84e1-4da2b804cc06 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:30.118657 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-79b17032-94bd-48a1-84e1-4da2b804cc06 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:30.132225 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:30:30.151190 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-79b17032-94bd-48a1-84e1-4da2b804cc06 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046588 May 24 15:30:30.151820 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 810/1608] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:30:30 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:31.163267 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-2c24228f-28e1-45cc-8585-44d5b5d87094 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:31.164746 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-2c24228f-28e1-45cc-8585-44d5b5d87094 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:31.167215 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_api:SELECT=68 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:30:31.172550 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2c24228f-28e1-45cc-8585-44d5b5d87094 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:31.172993 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2c24228f-28e1-45cc-8585-44d5b5d87094 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:31.173747 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2c24228f-28e1-45cc-8585-44d5b5d87094 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:31.174177 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2c24228f-28e1-45cc-8585-44d5b5d87094 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:31.203423 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-2c24228f-28e1-45cc-8585-44d5b5d87094 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044722 May 24 15:30:31.203957 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 799/1609] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:30:31 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:32.214004 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d0335279-d629-48ee-9e3d-f2aba4153657 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:32.214924 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d0335279-d629-48ee-9e3d-f2aba4153657 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:32.221372 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d0335279-d629-48ee-9e3d-f2aba4153657 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:32.221823 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d0335279-d629-48ee-9e3d-f2aba4153657 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:32.222581 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d0335279-d629-48ee-9e3d-f2aba4153657 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:32.223019 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d0335279-d629-48ee-9e3d-f2aba4153657 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:32.251320 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d0335279-d629-48ee-9e3d-f2aba4153657 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041290 May 24 15:30:32.251857 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 811/1610] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:30:32 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:33.263298 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-85fb6aa8-9f00-459a-96cb-26cb1ef7e67b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:33.264271 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-85fb6aa8-9f00-459a-96cb-26cb1ef7e67b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:33.270880 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-85fb6aa8-9f00-459a-96cb-26cb1ef7e67b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:33.271328 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-85fb6aa8-9f00-459a-96cb-26cb1ef7e67b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:33.272084 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-85fb6aa8-9f00-459a-96cb-26cb1ef7e67b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:33.272540 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-85fb6aa8-9f00-459a-96cb-26cb1ef7e67b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:33.301326 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-85fb6aa8-9f00-459a-96cb-26cb1ef7e67b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042014 May 24 15:30:33.302051 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 800/1611] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:30:33 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:34.312717 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-4b7686dd-29bf-4427-ba4c-e1de124466c7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:34.313628 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-4b7686dd-29bf-4427-ba4c-e1de124466c7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:34.320119 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4b7686dd-29bf-4427-ba4c-e1de124466c7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:34.320554 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4b7686dd-29bf-4427-ba4c-e1de124466c7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:34.321363 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4b7686dd-29bf-4427-ba4c-e1de124466c7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:34.321725 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4b7686dd-29bf-4427-ba4c-e1de124466c7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:34.349863 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-4b7686dd-29bf-4427-ba4c-e1de124466c7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041034 May 24 15:30:34.350388 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 812/1612] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:30:34 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:35.362153 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-35e3b9fe-fd56-4490-86aa-37591ebcfb8c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:35.363072 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-35e3b9fe-fd56-4490-86aa-37591ebcfb8c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:35.370289 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-35e3b9fe-fd56-4490-86aa-37591ebcfb8c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:35.370734 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-35e3b9fe-fd56-4490-86aa-37591ebcfb8c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:35.371496 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-35e3b9fe-fd56-4490-86aa-37591ebcfb8c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:35.371932 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-35e3b9fe-fd56-4490-86aa-37591ebcfb8c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:35.400737 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-35e3b9fe-fd56-4490-86aa-37591ebcfb8c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042771 May 24 15:30:35.401292 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 801/1613] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 15:30:35 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:36.412281 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-0ab2a4c2-357c-48c4-b96c-2a06e4911f66 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:30:36.413218 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-0ab2a4c2-357c-48c4-b96c-2a06e4911f66 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:30:36.419803 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0ab2a4c2-357c-48c4-b96c-2a06e4911f66 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:36.420253 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0ab2a4c2-357c-48c4-b96c-2a06e4911f66 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:36.421062 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0ab2a4c2-357c-48c4-b96c-2a06e4911f66 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:30:36.421493 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0ab2a4c2-357c-48c4-b96c-2a06e4911f66 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:30:36.522705 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-0ab2a4c2-357c-48c4-b96c-2a06e4911f66 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "POST /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/action" status: 200 len: 76648 microversion: 2.1 time: 0.114097 May 24 15:30:36.523410 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 813/1614] 10.222.0.45 () {60 vars in 1277 bytes} [Tue May 24 15:30:36 2022] POST /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3/action => generated 76648 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:31:43.545361 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_api:SELECT=5 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:31:43.546168 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=52 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:31:43.550867 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-115eacd9-1ae7-44d7-9471-e468c9aceb81 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:31:43.551368 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-115eacd9-1ae7-44d7-9471-e468c9aceb81 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 2be15600-c3a4-43ed-bf7d-0960eaf59eb1] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:31:43.558690 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-115eacd9-1ae7-44d7-9471-e468c9aceb81 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:31:43.559142 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-115eacd9-1ae7-44d7-9471-e468c9aceb81 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:31:43.559924 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-115eacd9-1ae7-44d7-9471-e468c9aceb81 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:31:43.560379 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-115eacd9-1ae7-44d7-9471-e468c9aceb81 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:31:43.585138 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-115eacd9-1ae7-44d7-9471-e468c9aceb81 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 2be15600-c3a4-43ed-bf7d-0960eaf59eb1] Going to try to terminate instance {{(pid=117699) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 15:31:43.658622 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-115eacd9-1ae7-44d7-9471-e468c9aceb81 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "DELETE /compute/v2.1/servers/2be15600-c3a4-43ed-bf7d-0960eaf59eb1" status: 204 len: 0 microversion: 2.1 time: 0.114885 May 24 15:31:43.659257 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 802/1615] 10.222.0.45 () {58 vars in 1238 bytes} [Tue May 24 15:31:43 2022] DELETE /compute/v2.1/servers/2be15600-c3a4-43ed-bf7d-0960eaf59eb1 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 15:31:43.666198 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_api:SELECT=45 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:31:43.666939 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=19 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:31:43.671335 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-09fbed30-b8af-4c18-bce3-f3cc7e0e252a tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:31:43.672026 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-09fbed30-b8af-4c18-bce3-f3cc7e0e252a tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 2be15600-c3a4-43ed-bf7d-0960eaf59eb1] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:31:43.680564 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-09fbed30-b8af-4c18-bce3-f3cc7e0e252a tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:31:43.681002 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-09fbed30-b8af-4c18-bce3-f3cc7e0e252a tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:31:43.681749 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-09fbed30-b8af-4c18-bce3-f3cc7e0e252a tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:31:43.682179 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-09fbed30-b8af-4c18-bce3-f3cc7e0e252a tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:31:43.809643 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-09fbed30-b8af-4c18-bce3-f3cc7e0e252a tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:31:43.817604 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-09fbed30-b8af-4c18-bce3-f3cc7e0e252a tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/2be15600-c3a4-43ed-bf7d-0960eaf59eb1" status: 200 len: 1673 microversion: 2.1 time: 0.153321 May 24 15:31:43.818171 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 814/1616] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:31:43 2022] GET /compute/v2.1/servers/2be15600-c3a4-43ed-bf7d-0960eaf59eb1 => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:31:44.835311 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-b868241f-6442-4581-8ea1-c8166c5dfc3c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:31:44.836126 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-b868241f-6442-4581-8ea1-c8166c5dfc3c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 2be15600-c3a4-43ed-bf7d-0960eaf59eb1] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:31:44.842702 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b868241f-6442-4581-8ea1-c8166c5dfc3c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:31:44.843223 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b868241f-6442-4581-8ea1-c8166c5dfc3c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:31:44.843992 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b868241f-6442-4581-8ea1-c8166c5dfc3c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:31:44.844455 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b868241f-6442-4581-8ea1-c8166c5dfc3c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:31:44.978610 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-b868241f-6442-4581-8ea1-c8166c5dfc3c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befe74ad06542b785d326101fc06d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0812b13a287c43259d7e09b0c658d4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:31:44.987522 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-b868241f-6442-4581-8ea1-c8166c5dfc3c tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/2be15600-c3a4-43ed-bf7d-0960eaf59eb1" status: 200 len: 1673 microversion: 2.1 time: 0.156442 May 24 15:31:44.988344 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 803/1617] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:31:44 2022] GET /compute/v2.1/servers/2be15600-c3a4-43ed-bf7d-0960eaf59eb1 => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:31:45.402477 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [req-bf498dcc-fb78-4084-81ac-950b280a21ac req-ff9cdb7b-ed79-4029-8600-b2dd894a6595 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2be15600-c3a4-43ed-bf7d-0960eaf59eb1", "name": "network-vif-deleted", "tag": "6ce1abc6-1178-4d13-b080-66a43a618f4e"}]} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:31:45.415146 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-bf498dcc-fb78-4084-81ac-950b280a21ac req-ff9cdb7b-ed79-4029-8600-b2dd894a6595 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:31:45.416870 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-bf498dcc-fb78-4084-81ac-950b280a21ac req-ff9cdb7b-ed79-4029-8600-b2dd894a6595 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:31:45.432206 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.compute.server_external_events [req-bf498dcc-fb78-4084-81ac-950b280a21ac req-ff9cdb7b-ed79-4029-8600-b2dd894a6595 service nova] Creating event network-vif-deleted:6ce1abc6-1178-4d13-b080-66a43a618f4e for instance 2be15600-c3a4-43ed-bf7d-0960eaf59eb1 on hv-cinder-84315 May 24 15:31:45.440090 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [req-bf498dcc-fb78-4084-81ac-950b280a21ac req-ff9cdb7b-ed79-4029-8600-b2dd894a6595 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117045 May 24 15:31:45.441465 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 815/1618] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:31:46.005762 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-37f32717-d802-4748-8c51-6e3e0b5e1bcf tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:31:46.007764 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-37f32717-d802-4748-8c51-6e3e0b5e1bcf tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 2be15600-c3a4-43ed-bf7d-0960eaf59eb1] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:31:46.015098 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-37f32717-d802-4748-8c51-6e3e0b5e1bcf tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:31:46.015664 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-37f32717-d802-4748-8c51-6e3e0b5e1bcf tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:31:46.016437 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-37f32717-d802-4748-8c51-6e3e0b5e1bcf tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:31:46.016855 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-37f32717-d802-4748-8c51-6e3e0b5e1bcf tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:31:46.034342 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.wsgi [None req-37f32717-d802-4748-8c51-6e3e0b5e1bcf tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] HTTP exception thrown: Instance 2be15600-c3a4-43ed-bf7d-0960eaf59eb1 could not be found. May 24 15:31:46.036211 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-37f32717-d802-4748-8c51-6e3e0b5e1bcf tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Request method failure captured: May 24 15:31:46.036211 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: request: GET /compute/v2.1/servers/2be15600-c3a4-43ed-bf7d-0960eaf59eb1 HTTP/1.1 May 24 15:31:46.036211 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Accept: application/json May 24 15:31:46.036211 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Accept-Encoding: identity May 24 15:31:46.036211 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Connection: close May 24 15:31:46.036211 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Content-Length: 0 May 24 15:31:46.036211 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Content-Type: application/json May 24 15:31:46.036211 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Host: 10.222.0.45 May 24 15:31:46.036211 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Openstack-System-Scope: None May 24 15:31:46.036211 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: User-Agent: python-urllib3/1.26.9 May 24 15:31:46.036211 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Auth-Token: gAAAAABijPenpuB3nhOrbi-s3yxL7m-sBG8ZJZ51rBJ3imPzJ57HWeKwFeyebtAB5n2bRdpBGRV3d5i1o5IlYb6fCewd8gSuMgbjsTvWfWnQ_U8M7n-X8RXyXojhl7q-zYypOQ1v7H4itKL87AzjyCIaWDLZ-yW18KI11cscCi_s9fBvwKCcm3E May 24 15:31:46.036211 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Domain-Id: None May 24 15:31:46.036211 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Domain-Name: None May 24 15:31:46.036211 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Identity-Status: Confirmed May 24 15:31:46.036211 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Is-Admin-Project: True May 24 15:31:46.036211 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Domain-Id: default May 24 15:31:46.036211 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Domain-Name: Default May 24 15:31:46.036211 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Id: 0812b13a287c43259d7e09b0c658d4c8 May 24 15:31:46.036211 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Name: tempest-AttachVolumeTestJSON-590500594 May 24 15:31:46.036211 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Role: reader,member May 24 15:31:46.036211 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Roles: reader,member May 24 15:31:46.037659 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0812b13a287c43259d7e09b0c658d4c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0812b13a287c43259d7e09b0c658d4c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0812b13a287c43259d7e09b0c658d4c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0812b13a287c43259d7e09b0c658d4c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 24 15:31:46.037659 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant: tempest-AttachVolumeTestJSON-590500594 May 24 15:31:46.037659 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant-Id: 0812b13a287c43259d7e09b0c658d4c8 May 24 15:31:46.037659 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant-Name: tempest-AttachVolumeTestJSON-590500594 May 24 15:31:46.037659 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User: tempest-AttachVolumeTestJSON-590500594-project May 24 15:31:46.037659 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Domain-Id: default May 24 15:31:46.037659 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Domain-Name: Default May 24 15:31:46.037659 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Id: 2befe74ad06542b785d326101fc06d0b May 24 15:31:46.037659 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Name: tempest-AttachVolumeTestJSON-590500594-project May 24 15:31:46.037659 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: method: > May 24 15:31:46.037659 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: exception: Instance 2be15600-c3a4-43ed-bf7d-0960eaf59eb1 could not be found. May 24 15:31:46.037659 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: action_args: {'id': '2be15600-c3a4-43ed-bf7d-0960eaf59eb1'} May 24 15:31:46.038544 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:31:46.038544 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:31:46.038544 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:31:46.038544 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:31:46.038544 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:31:46.038544 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:31:46.038544 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:31:46.038544 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:31:46.038544 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:31:46.038544 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:31:46.038544 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2be15600-c3a4-43ed-bf7d-0960eaf59eb1 could not be found. May 24 15:31:46.038544 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:31:46.038544 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:31:46.038544 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:31:46.038544 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:31:46.038544 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:31:46.038544 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:31:46.038544 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:31:46.038544 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:31:46.038544 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:31:46.039847 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:31:46.039847 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 15:31:46.039847 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 15:31:46.039847 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:31:46.039847 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:31:46.039847 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:31:46.039847 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:31:46.039847 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2be15600-c3a4-43ed-bf7d-0960eaf59eb1 could not be found. May 24 15:31:46.039847 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:31:46.039847 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:31:46.039847 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:31:46.039847 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:31:46.039847 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:31:46.039847 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:31:46.039847 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:31:46.039847 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:31:46.039847 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2be15600-c3a4-43ed-bf7d-0960eaf59eb1 could not be found. May 24 15:31:46.039847 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:31:46.042332 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-37f32717-d802-4748-8c51-6e3e0b5e1bcf tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Returning 404 to user: Instance 2be15600-c3a4-43ed-bf7d-0960eaf59eb1 could not be found. {{(pid=117699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:31:46.042332 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-37f32717-d802-4748-8c51-6e3e0b5e1bcf tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/2be15600-c3a4-43ed-bf7d-0960eaf59eb1" status: 404 len: 111 microversion: 2.1 time: 0.035739 May 24 15:31:46.042332 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 804/1619] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:31:46 2022] GET /compute/v2.1/servers/2be15600-c3a4-43ed-bf7d-0960eaf59eb1 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:31:46.047275 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-0810c82e-256f-4833-b4a2-6cd188bbda4d tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '.version_select at 0x7f2dd2770dc0>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:31:46.051457 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0810c82e-256f-4833-b4a2-6cd188bbda4d tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [5aebd939-39d2-4eea-9422-761c2eb5df8c] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 24 15:31:47.059214 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO oslo.messaging._drivers.impl_rabbit [None req-0810c82e-256f-4833-b4a2-6cd188bbda4d tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [5aebd939-39d2-4eea-9422-761c2eb5df8c] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 49962. May 24 15:31:47.081362 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-0810c82e-256f-4833-b4a2-6cd188bbda4d tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1460515207" status: 202 len: 0 microversion: 2.1 time: 1.038204 May 24 15:31:47.082135 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 816/1620] 10.222.0.45 () {58 vars in 1220 bytes} [Tue May 24 15:31:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1460515207 => generated 0 bytes in 1040 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 15:32:06.248350 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 15:32:06.248990 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Tue May 24 15:32:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 15:33:19.157141 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 15:33:19.157141 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Tue May 24 15:33:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 15:33:36.174027 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 15:33:36.174655 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Tue May 24 15:33:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 15:35:26.255895 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 15:35:26.256443 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Tue May 24 15:35:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 15:36:08.028432 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e630f128-9d86-4e1b-b4c0-e3ee323af13a] AMQP server on 10.222.0.45:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 24 15:36:08.028963 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:36:08.029981 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:36:08.034039 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-950a34b2-95be-41ef-ad13-bc3d80ea7fb8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:08.034564 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-950a34b2-95be-41ef-ad13-bc3d80ea7fb8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:08.043584 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-950a34b2-95be-41ef-ad13-bc3d80ea7fb8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:08.044092 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-950a34b2-95be-41ef-ad13-bc3d80ea7fb8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:08.044989 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-950a34b2-95be-41ef-ad13-bc3d80ea7fb8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:08.045420 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-950a34b2-95be-41ef-ad13-bc3d80ea7fb8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:08.070934 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-950a34b2-95be-41ef-ad13-bc3d80ea7fb8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Going to try to terminate instance {{(pid=117699) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 15:36:08.147724 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-950a34b2-95be-41ef-ad13-bc3d80ea7fb8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "DELETE /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 204 len: 0 microversion: 2.20 time: 0.120949 May 24 15:36:08.148384 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 805/1621] 10.222.0.45 () {60 vars in 1279 bytes} [Tue May 24 15:36:08 2022] DELETE /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 24 15:36:08.154311 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7e770269-d0e3-4f7f-b076-1dfeee56f131] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 24 15:36:08.155415 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=8 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:36:08.156273 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:36:08.160791 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-ce2a2f38-ef29-4ea3-b1b7-b9143f7449f2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:08.161534 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-ce2a2f38-ef29-4ea3-b1b7-b9143f7449f2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:08.170174 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ce2a2f38-ef29-4ea3-b1b7-b9143f7449f2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:08.170629 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ce2a2f38-ef29-4ea3-b1b7-b9143f7449f2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:08.171387 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ce2a2f38-ef29-4ea3-b1b7-b9143f7449f2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:08.171814 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ce2a2f38-ef29-4ea3-b1b7-b9143f7449f2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:08.503237 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ce2a2f38-ef29-4ea3-b1b7-b9143f7449f2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:08.512039 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ce2a2f38-ef29-4ea3-b1b7-b9143f7449f2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:08.513556 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ce2a2f38-ef29-4ea3-b1b7-b9143f7449f2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:08.514711 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-ce2a2f38-ef29-4ea3-b1b7-b9143f7449f2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1802 microversion: 2.20 time: 0.362080 May 24 15:36:08.515277 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 817/1622] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:36:08 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1802 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:36:09.534149 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-29a0bf0e-ec33-401f-9712-46e830bcd7e4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:09.534852 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-29a0bf0e-ec33-401f-9712-46e830bcd7e4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:09.543467 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-29a0bf0e-ec33-401f-9712-46e830bcd7e4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:09.543917 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-29a0bf0e-ec33-401f-9712-46e830bcd7e4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:09.544913 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-29a0bf0e-ec33-401f-9712-46e830bcd7e4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:09.545349 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-29a0bf0e-ec33-401f-9712-46e830bcd7e4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:09.564489 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO oslo.messaging._drivers.impl_rabbit [-] [e630f128-9d86-4e1b-b4c0-e3ee323af13a] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 52526. May 24 15:36:09.738594 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-29a0bf0e-ec33-401f-9712-46e830bcd7e4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:09.749399 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-29a0bf0e-ec33-401f-9712-46e830bcd7e4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:09.750904 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-29a0bf0e-ec33-401f-9712-46e830bcd7e4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:09.752082 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-29a0bf0e-ec33-401f-9712-46e830bcd7e4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1802 microversion: 2.20 time: 0.222275 May 24 15:36:09.752687 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 806/1623] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:36:09 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1802 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:36:09.985327 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [req-48a1d688-6343-4ba9-be88-1de0aa6eab5e req-e6a752e4-6522-4cfc-bd9e-97c3ef902626 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c54fc3c-070c-4cab-b181-081d80eeb078", "name": "network-vif-deleted", "tag": "17e61d65-8da4-4259-8227-bdbecc4fa610"}]} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:36:09.998131 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-48a1d688-6343-4ba9-be88-1de0aa6eab5e req-e6a752e4-6522-4cfc-bd9e-97c3ef902626 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:09.998503 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-48a1d688-6343-4ba9-be88-1de0aa6eab5e req-e6a752e4-6522-4cfc-bd9e-97c3ef902626 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:10.006874 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO oslo.messaging._drivers.impl_rabbit [-] [7e770269-d0e3-4f7f-b076-1dfeee56f131] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 52534. May 24 15:36:10.014637 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.compute.server_external_events [req-48a1d688-6343-4ba9-be88-1de0aa6eab5e req-e6a752e4-6522-4cfc-bd9e-97c3ef902626 service nova] Creating event network-vif-deleted:17e61d65-8da4-4259-8227-bdbecc4fa610 for instance 6c54fc3c-070c-4cab-b181-081d80eeb078 on hv-cinder-84315 May 24 15:36:10.018146 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR oslo.messaging._drivers.impl_rabbit [req-48a1d688-6343-4ba9-be88-1de0aa6eab5e req-e6a752e4-6522-4cfc-bd9e-97c3ef902626 service nova] [582d52df-0ed1-4da7-9bbc-1b2c885fe4ce] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 24 15:36:10.771245 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-873fb2b5-602d-4998-b836-73a753b3fe06 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:10.772007 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-873fb2b5-602d-4998-b836-73a753b3fe06 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:10.778826 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-873fb2b5-602d-4998-b836-73a753b3fe06 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:10.779083 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-873fb2b5-602d-4998-b836-73a753b3fe06 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:10.779836 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-873fb2b5-602d-4998-b836-73a753b3fe06 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:10.780260 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-873fb2b5-602d-4998-b836-73a753b3fe06 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:10.848425 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-873fb2b5-602d-4998-b836-73a753b3fe06 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:10.858592 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-873fb2b5-602d-4998-b836-73a753b3fe06 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:10.859952 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-873fb2b5-602d-4998-b836-73a753b3fe06 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:10.861176 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-873fb2b5-602d-4998-b836-73a753b3fe06 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.094224 May 24 15:36:10.862029 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 807/1624] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:36:10 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:36:11.026705 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO oslo.messaging._drivers.impl_rabbit [req-48a1d688-6343-4ba9-be88-1de0aa6eab5e req-e6a752e4-6522-4cfc-bd9e-97c3ef902626 service nova] [582d52df-0ed1-4da7-9bbc-1b2c885fe4ce] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 52546. May 24 15:36:11.030570 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [req-48a1d688-6343-4ba9-be88-1de0aa6eab5e req-e6a752e4-6522-4cfc-bd9e-97c3ef902626 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.049741 May 24 15:36:11.031374 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 818/1625] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:36:11.880243 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-4982746f-03b4-43f7-acde-39e6853d5286 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:11.880942 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-4982746f-03b4-43f7-acde-39e6853d5286 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:11.887984 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4982746f-03b4-43f7-acde-39e6853d5286 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:11.888460 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4982746f-03b4-43f7-acde-39e6853d5286 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:11.889361 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4982746f-03b4-43f7-acde-39e6853d5286 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:11.889796 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4982746f-03b4-43f7-acde-39e6853d5286 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:11.950126 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-4982746f-03b4-43f7-acde-39e6853d5286 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:11.958482 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-4982746f-03b4-43f7-acde-39e6853d5286 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:11.959968 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-4982746f-03b4-43f7-acde-39e6853d5286 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:11.961145 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-4982746f-03b4-43f7-acde-39e6853d5286 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084917 May 24 15:36:11.961686 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 808/1626] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:36:11 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:36:12.979871 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-6c32ca93-f471-4e0c-9813-6d93e181faac tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:12.980582 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-6c32ca93-f471-4e0c-9813-6d93e181faac tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:12.986784 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6c32ca93-f471-4e0c-9813-6d93e181faac tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:12.987224 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6c32ca93-f471-4e0c-9813-6d93e181faac tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:12.987975 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6c32ca93-f471-4e0c-9813-6d93e181faac tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:12.988440 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6c32ca93-f471-4e0c-9813-6d93e181faac tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:13.048862 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-6c32ca93-f471-4e0c-9813-6d93e181faac tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:13.057083 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-6c32ca93-f471-4e0c-9813-6d93e181faac tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:13.058558 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-6c32ca93-f471-4e0c-9813-6d93e181faac tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:13.059682 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-6c32ca93-f471-4e0c-9813-6d93e181faac tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084561 May 24 15:36:13.060230 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 819/1627] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:36:12 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:36:14.077919 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-be1c9937-e7ba-4f16-9e5c-4648b96e9904 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:14.078557 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-be1c9937-e7ba-4f16-9e5c-4648b96e9904 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:14.085559 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-be1c9937-e7ba-4f16-9e5c-4648b96e9904 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:14.086001 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-be1c9937-e7ba-4f16-9e5c-4648b96e9904 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:14.086768 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-be1c9937-e7ba-4f16-9e5c-4648b96e9904 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:14.087198 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-be1c9937-e7ba-4f16-9e5c-4648b96e9904 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:14.146996 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-be1c9937-e7ba-4f16-9e5c-4648b96e9904 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:14.155306 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-be1c9937-e7ba-4f16-9e5c-4648b96e9904 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:14.156835 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-be1c9937-e7ba-4f16-9e5c-4648b96e9904 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:14.157970 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-be1c9937-e7ba-4f16-9e5c-4648b96e9904 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.083992 May 24 15:36:14.158531 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 809/1628] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:36:14 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:36:14.964332 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e7cfccb9-f732-4cfd-bcf0-64fa4a6562d2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:14.964881 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e7cfccb9-f732-4cfd-bcf0-64fa4a6562d2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:14.971308 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e7cfccb9-f732-4cfd-bcf0-64fa4a6562d2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:14.971752 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e7cfccb9-f732-4cfd-bcf0-64fa4a6562d2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:14.972557 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e7cfccb9-f732-4cfd-bcf0-64fa4a6562d2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:14.973000 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e7cfccb9-f732-4cfd-bcf0-64fa4a6562d2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:14.998249 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e7cfccb9-f732-4cfd-bcf0-64fa4a6562d2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Going to try to terminate instance {{(pid=117698) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 15:36:15.073514 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e7cfccb9-f732-4cfd-bcf0-64fa4a6562d2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "DELETE /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 204 len: 0 microversion: 2.1 time: 0.112662 May 24 15:36:15.074104 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 820/1629] 10.222.0.45 () {58 vars in 1238 bytes} [Tue May 24 15:36:14 2022] DELETE /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 15:36:15.083309 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-55ea7e2d-1c9a-40d1-ba8b-ec9e78378e18 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:15.084648 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-55ea7e2d-1c9a-40d1-ba8b-ec9e78378e18 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:15.093104 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-55ea7e2d-1c9a-40d1-ba8b-ec9e78378e18 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:15.093772 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-55ea7e2d-1c9a-40d1-ba8b-ec9e78378e18 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:15.094937 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-55ea7e2d-1c9a-40d1-ba8b-ec9e78378e18 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:15.095627 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-55ea7e2d-1c9a-40d1-ba8b-ec9e78378e18 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:15.177334 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-faa32cc8-83d7-44a4-ac2c-598605794036 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:15.178032 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-faa32cc8-83d7-44a4-ac2c-598605794036 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:15.184183 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-faa32cc8-83d7-44a4-ac2c-598605794036 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:15.184674 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-faa32cc8-83d7-44a4-ac2c-598605794036 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:15.185431 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-faa32cc8-83d7-44a4-ac2c-598605794036 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:15.185891 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-faa32cc8-83d7-44a4-ac2c-598605794036 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:15.224986 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-55ea7e2d-1c9a-40d1-ba8b-ec9e78378e18 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:15.232905 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-55ea7e2d-1c9a-40d1-ba8b-ec9e78378e18 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.154174 May 24 15:36:15.233475 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 810/1630] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:36:15 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:36:15.250437 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-faa32cc8-83d7-44a4-ac2c-598605794036 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:15.259229 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-faa32cc8-83d7-44a4-ac2c-598605794036 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:15.260769 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-faa32cc8-83d7-44a4-ac2c-598605794036 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:15.261901 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-faa32cc8-83d7-44a4-ac2c-598605794036 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.088872 May 24 15:36:15.262454 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 821/1631] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:36:15 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:36:16.250171 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-2e668a61-b126-4c50-970f-6c4c10bf02df tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:16.250816 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-2e668a61-b126-4c50-970f-6c4c10bf02df tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:16.257986 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2e668a61-b126-4c50-970f-6c4c10bf02df tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:16.258431 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2e668a61-b126-4c50-970f-6c4c10bf02df tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:16.259193 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2e668a61-b126-4c50-970f-6c4c10bf02df tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:16.259626 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2e668a61-b126-4c50-970f-6c4c10bf02df tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:16.279595 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-bd520635-6866-43d5-b248-efeeaa500a0f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:16.280199 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-bd520635-6866-43d5-b248-efeeaa500a0f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:16.286635 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bd520635-6866-43d5-b248-efeeaa500a0f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:16.287083 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bd520635-6866-43d5-b248-efeeaa500a0f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:16.287844 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bd520635-6866-43d5-b248-efeeaa500a0f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:16.288277 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bd520635-6866-43d5-b248-efeeaa500a0f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:16.349450 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-bd520635-6866-43d5-b248-efeeaa500a0f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:16.357998 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-bd520635-6866-43d5-b248-efeeaa500a0f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:16.359508 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-bd520635-6866-43d5-b248-efeeaa500a0f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:16.360717 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-bd520635-6866-43d5-b248-efeeaa500a0f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.085015 May 24 15:36:16.361267 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 822/1632] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:36:16 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:36:16.391201 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-2e668a61-b126-4c50-970f-6c4c10bf02df tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:16.399152 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-2e668a61-b126-4c50-970f-6c4c10bf02df tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.152833 May 24 15:36:16.399740 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 811/1633] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:36:16 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:36:17.378900 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d6485570-6511-40fb-9070-d0dcb3d9f469 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:17.379505 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d6485570-6511-40fb-9070-d0dcb3d9f469 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:17.386488 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d6485570-6511-40fb-9070-d0dcb3d9f469 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:17.386926 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d6485570-6511-40fb-9070-d0dcb3d9f469 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:17.387672 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d6485570-6511-40fb-9070-d0dcb3d9f469 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:17.388100 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d6485570-6511-40fb-9070-d0dcb3d9f469 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:17.415896 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-17aab3fb-b27d-442a-b187-69fba0cf3406 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:17.416537 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-17aab3fb-b27d-442a-b187-69fba0cf3406 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:17.423267 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-17aab3fb-b27d-442a-b187-69fba0cf3406 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:17.423714 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-17aab3fb-b27d-442a-b187-69fba0cf3406 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:17.424523 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-17aab3fb-b27d-442a-b187-69fba0cf3406 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:17.424961 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-17aab3fb-b27d-442a-b187-69fba0cf3406 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:17.450790 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-d6485570-6511-40fb-9070-d0dcb3d9f469 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:17.459871 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-d6485570-6511-40fb-9070-d0dcb3d9f469 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:17.461414 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-d6485570-6511-40fb-9070-d0dcb3d9f469 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:17.462569 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d6485570-6511-40fb-9070-d0dcb3d9f469 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.087560 May 24 15:36:17.463131 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 823/1634] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:36:17 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:36:17.555925 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-17aab3fb-b27d-442a-b187-69fba0cf3406 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:17.563833 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-17aab3fb-b27d-442a-b187-69fba0cf3406 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.151831 May 24 15:36:17.564417 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 812/1635] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:36:17 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:36:18.485535 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-86255d6f-60b0-41ff-ae36-cf4e0cf38de8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:18.486138 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-86255d6f-60b0-41ff-ae36-cf4e0cf38de8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:18.493110 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-86255d6f-60b0-41ff-ae36-cf4e0cf38de8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:18.493553 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-86255d6f-60b0-41ff-ae36-cf4e0cf38de8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:18.494309 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-86255d6f-60b0-41ff-ae36-cf4e0cf38de8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:18.494735 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-86255d6f-60b0-41ff-ae36-cf4e0cf38de8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:18.556783 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-86255d6f-60b0-41ff-ae36-cf4e0cf38de8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:18.565191 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-86255d6f-60b0-41ff-ae36-cf4e0cf38de8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:18.566670 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-86255d6f-60b0-41ff-ae36-cf4e0cf38de8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:18.567796 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-86255d6f-60b0-41ff-ae36-cf4e0cf38de8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.086145 May 24 15:36:18.568359 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 824/1636] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:36:18 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:36:18.580973 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e41e63a9-4a68-42c1-ac8a-a15e53981125 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:18.581579 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-e41e63a9-4a68-42c1-ac8a-a15e53981125 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:18.588609 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e41e63a9-4a68-42c1-ac8a-a15e53981125 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:18.589049 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e41e63a9-4a68-42c1-ac8a-a15e53981125 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:18.589797 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e41e63a9-4a68-42c1-ac8a-a15e53981125 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:18.590223 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e41e63a9-4a68-42c1-ac8a-a15e53981125 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:18.719821 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-e41e63a9-4a68-42c1-ac8a-a15e53981125 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:18.727666 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-e41e63a9-4a68-42c1-ac8a-a15e53981125 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.150494 May 24 15:36:18.728218 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 813/1637] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:36:18 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:36:19.586098 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e0053b97-a48d-449e-87f2-a700bbb94e62 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:19.586703 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e0053b97-a48d-449e-87f2-a700bbb94e62 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:19.593123 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e0053b97-a48d-449e-87f2-a700bbb94e62 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:19.593915 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e0053b97-a48d-449e-87f2-a700bbb94e62 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:19.594662 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e0053b97-a48d-449e-87f2-a700bbb94e62 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:19.595088 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e0053b97-a48d-449e-87f2-a700bbb94e62 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:19.658132 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e0053b97-a48d-449e-87f2-a700bbb94e62 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:19.666943 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e0053b97-a48d-449e-87f2-a700bbb94e62 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:19.668466 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e0053b97-a48d-449e-87f2-a700bbb94e62 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:19.669574 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e0053b97-a48d-449e-87f2-a700bbb94e62 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.087348 May 24 15:36:19.670112 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 825/1638] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:36:19 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:36:19.745559 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d388b371-e528-4f8b-80b5-67c2a2b74a48 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:19.746164 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d388b371-e528-4f8b-80b5-67c2a2b74a48 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:19.752631 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d388b371-e528-4f8b-80b5-67c2a2b74a48 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:19.753077 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d388b371-e528-4f8b-80b5-67c2a2b74a48 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:19.753832 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d388b371-e528-4f8b-80b5-67c2a2b74a48 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:19.754258 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d388b371-e528-4f8b-80b5-67c2a2b74a48 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:19.878995 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-d388b371-e528-4f8b-80b5-67c2a2b74a48 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:19.886989 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d388b371-e528-4f8b-80b5-67c2a2b74a48 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.145234 May 24 15:36:19.887588 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 814/1639] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:36:19 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:36:20.688278 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-08ced93c-57fe-4371-aa49-3961aa695495 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:20.688927 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-08ced93c-57fe-4371-aa49-3961aa695495 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:20.695985 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-08ced93c-57fe-4371-aa49-3961aa695495 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:20.696465 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-08ced93c-57fe-4371-aa49-3961aa695495 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:20.697222 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-08ced93c-57fe-4371-aa49-3961aa695495 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:20.697652 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-08ced93c-57fe-4371-aa49-3961aa695495 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:20.758000 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-08ced93c-57fe-4371-aa49-3961aa695495 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:20.766565 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-08ced93c-57fe-4371-aa49-3961aa695495 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:20.768057 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-08ced93c-57fe-4371-aa49-3961aa695495 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:20.769235 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-08ced93c-57fe-4371-aa49-3961aa695495 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084905 May 24 15:36:20.769806 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 826/1640] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:36:20 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:36:20.904774 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-b7bf7b58-806a-4883-aff4-a4c1a5a82857 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:20.905382 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-b7bf7b58-806a-4883-aff4-a4c1a5a82857 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:20.911863 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b7bf7b58-806a-4883-aff4-a4c1a5a82857 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:20.912429 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b7bf7b58-806a-4883-aff4-a4c1a5a82857 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:20.913184 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b7bf7b58-806a-4883-aff4-a4c1a5a82857 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:20.913616 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b7bf7b58-806a-4883-aff4-a4c1a5a82857 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:21.044341 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-b7bf7b58-806a-4883-aff4-a4c1a5a82857 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:21.053131 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-b7bf7b58-806a-4883-aff4-a4c1a5a82857 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.151643 May 24 15:36:21.053702 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 815/1641] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:36:20 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:36:21.787148 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-deac25f0-3fe1-48d3-9d1d-21de01c241ec tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:21.787731 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-deac25f0-3fe1-48d3-9d1d-21de01c241ec tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:21.794194 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-deac25f0-3fe1-48d3-9d1d-21de01c241ec tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:21.794635 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-deac25f0-3fe1-48d3-9d1d-21de01c241ec tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:21.795378 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-deac25f0-3fe1-48d3-9d1d-21de01c241ec tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:21.795807 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-deac25f0-3fe1-48d3-9d1d-21de01c241ec tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:21.856975 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-deac25f0-3fe1-48d3-9d1d-21de01c241ec tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:21.865500 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-deac25f0-3fe1-48d3-9d1d-21de01c241ec tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:21.866974 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-deac25f0-3fe1-48d3-9d1d-21de01c241ec tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:21.868091 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-deac25f0-3fe1-48d3-9d1d-21de01c241ec tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.085002 May 24 15:36:21.868683 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 827/1642] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:36:21 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:36:22.070404 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-50201f3c-3091-4707-99fa-ad7a46cd59f9 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:22.071019 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-50201f3c-3091-4707-99fa-ad7a46cd59f9 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:22.077552 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-50201f3c-3091-4707-99fa-ad7a46cd59f9 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:22.078004 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-50201f3c-3091-4707-99fa-ad7a46cd59f9 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:22.078769 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-50201f3c-3091-4707-99fa-ad7a46cd59f9 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:22.079200 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-50201f3c-3091-4707-99fa-ad7a46cd59f9 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:22.204678 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-50201f3c-3091-4707-99fa-ad7a46cd59f9 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:22.212555 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-50201f3c-3091-4707-99fa-ad7a46cd59f9 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.146488 May 24 15:36:22.213120 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 816/1643] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:36:22 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:36:22.885747 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-31ca1eed-a363-4e44-9004-76f9a3c70a3e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:22.886354 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-31ca1eed-a363-4e44-9004-76f9a3c70a3e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:22.892879 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-31ca1eed-a363-4e44-9004-76f9a3c70a3e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:22.893325 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-31ca1eed-a363-4e44-9004-76f9a3c70a3e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:22.894077 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-31ca1eed-a363-4e44-9004-76f9a3c70a3e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:22.894508 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-31ca1eed-a363-4e44-9004-76f9a3c70a3e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:22.954664 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-31ca1eed-a363-4e44-9004-76f9a3c70a3e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:22.963493 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-31ca1eed-a363-4e44-9004-76f9a3c70a3e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:22.965023 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-31ca1eed-a363-4e44-9004-76f9a3c70a3e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:22.966152 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-31ca1eed-a363-4e44-9004-76f9a3c70a3e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084283 May 24 15:36:22.966708 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 828/1644] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:36:22 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:36:23.229352 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-4ee77e40-246a-4549-adae-af0b0f8fd905 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:23.229970 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-4ee77e40-246a-4549-adae-af0b0f8fd905 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:23.236505 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4ee77e40-246a-4549-adae-af0b0f8fd905 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:23.236957 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4ee77e40-246a-4549-adae-af0b0f8fd905 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:23.237721 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4ee77e40-246a-4549-adae-af0b0f8fd905 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:23.238158 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4ee77e40-246a-4549-adae-af0b0f8fd905 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:23.363534 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-4ee77e40-246a-4549-adae-af0b0f8fd905 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:23.371825 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-4ee77e40-246a-4549-adae-af0b0f8fd905 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.146370 May 24 15:36:23.372412 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 817/1645] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:36:23 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:36:23.984672 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-fa6aab7b-45ea-4c35-9429-13e3a2228632 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:23.985284 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-fa6aab7b-45ea-4c35-9429-13e3a2228632 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:23.992488 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fa6aab7b-45ea-4c35-9429-13e3a2228632 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:23.992933 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fa6aab7b-45ea-4c35-9429-13e3a2228632 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:23.993684 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fa6aab7b-45ea-4c35-9429-13e3a2228632 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:23.994116 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fa6aab7b-45ea-4c35-9429-13e3a2228632 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:24.056169 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-fa6aab7b-45ea-4c35-9429-13e3a2228632 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:24.064472 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-fa6aab7b-45ea-4c35-9429-13e3a2228632 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:24.065954 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-fa6aab7b-45ea-4c35-9429-13e3a2228632 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:24.067100 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-fa6aab7b-45ea-4c35-9429-13e3a2228632 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.086434 May 24 15:36:24.067850 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 829/1646] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:36:23 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:36:24.389332 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-20f6aa6e-9115-4c57-9159-741139a8cda5 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:24.389866 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-20f6aa6e-9115-4c57-9159-741139a8cda5 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:24.396339 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-20f6aa6e-9115-4c57-9159-741139a8cda5 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:24.396785 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-20f6aa6e-9115-4c57-9159-741139a8cda5 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:24.397537 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-20f6aa6e-9115-4c57-9159-741139a8cda5 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:24.397962 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-20f6aa6e-9115-4c57-9159-741139a8cda5 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:24.527661 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-20f6aa6e-9115-4c57-9159-741139a8cda5 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:24.535646 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-20f6aa6e-9115-4c57-9159-741139a8cda5 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.150279 May 24 15:36:24.536209 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 818/1647] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:36:24 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:36:25.084925 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-980def35-0462-4126-9543-4c83b3f1a36d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:25.085531 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-980def35-0462-4126-9543-4c83b3f1a36d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:25.091963 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-980def35-0462-4126-9543-4c83b3f1a36d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:25.092443 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-980def35-0462-4126-9543-4c83b3f1a36d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:25.093188 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-980def35-0462-4126-9543-4c83b3f1a36d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:25.093615 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-980def35-0462-4126-9543-4c83b3f1a36d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:25.156206 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-980def35-0462-4126-9543-4c83b3f1a36d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:25.165130 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-980def35-0462-4126-9543-4c83b3f1a36d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:25.166610 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-980def35-0462-4126-9543-4c83b3f1a36d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:25.167739 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-980def35-0462-4126-9543-4c83b3f1a36d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.086642 May 24 15:36:25.168282 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 830/1648] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:36:25 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:36:25.552571 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d56ff7af-1792-4a32-b802-d502685587ca tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:25.553187 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d56ff7af-1792-4a32-b802-d502685587ca tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:25.559676 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d56ff7af-1792-4a32-b802-d502685587ca tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:25.560123 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d56ff7af-1792-4a32-b802-d502685587ca tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:25.560915 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d56ff7af-1792-4a32-b802-d502685587ca tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:25.561352 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d56ff7af-1792-4a32-b802-d502685587ca tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:25.688196 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-d56ff7af-1792-4a32-b802-d502685587ca tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:25.691611 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:36:25.697638 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d56ff7af-1792-4a32-b802-d502685587ca tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.149024 May 24 15:36:25.698207 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 819/1649] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:36:25 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:36:26.185513 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-05a5d7c3-6957-435a-b0db-ad99c9e936fd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:26.186103 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-05a5d7c3-6957-435a-b0db-ad99c9e936fd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:26.192859 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-05a5d7c3-6957-435a-b0db-ad99c9e936fd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:26.193867 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-05a5d7c3-6957-435a-b0db-ad99c9e936fd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:26.194671 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-05a5d7c3-6957-435a-b0db-ad99c9e936fd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:26.195134 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-05a5d7c3-6957-435a-b0db-ad99c9e936fd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:26.254156 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-05a5d7c3-6957-435a-b0db-ad99c9e936fd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:26.263069 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-05a5d7c3-6957-435a-b0db-ad99c9e936fd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:26.264581 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-05a5d7c3-6957-435a-b0db-ad99c9e936fd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:26.265701 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-05a5d7c3-6957-435a-b0db-ad99c9e936fd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084098 May 24 15:36:26.266252 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 831/1650] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:36:26 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:36:26.715415 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-2a15579a-843f-4991-a188-d414df7b6df9 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:26.716030 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-2a15579a-843f-4991-a188-d414df7b6df9 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:26.723901 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2a15579a-843f-4991-a188-d414df7b6df9 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:26.724977 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2a15579a-843f-4991-a188-d414df7b6df9 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:26.725744 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2a15579a-843f-4991-a188-d414df7b6df9 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:26.726182 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2a15579a-843f-4991-a188-d414df7b6df9 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:26.854834 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-2a15579a-843f-4991-a188-d414df7b6df9 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:26.862759 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-2a15579a-843f-4991-a188-d414df7b6df9 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.151241 May 24 15:36:26.863322 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 820/1651] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:36:26 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:36:27.283358 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-9566d8ad-ea46-4e2c-ae04-9f24e027cad3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:27.283965 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-9566d8ad-ea46-4e2c-ae04-9f24e027cad3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:27.290536 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9566d8ad-ea46-4e2c-ae04-9f24e027cad3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:27.290981 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9566d8ad-ea46-4e2c-ae04-9f24e027cad3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:27.291737 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9566d8ad-ea46-4e2c-ae04-9f24e027cad3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:27.292168 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9566d8ad-ea46-4e2c-ae04-9f24e027cad3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:27.309798 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:36:27.353983 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-9566d8ad-ea46-4e2c-ae04-9f24e027cad3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:27.362319 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-9566d8ad-ea46-4e2c-ae04-9f24e027cad3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:27.363853 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-9566d8ad-ea46-4e2c-ae04-9f24e027cad3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:27.365966 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-9566d8ad-ea46-4e2c-ae04-9f24e027cad3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.086472 May 24 15:36:27.366865 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 832/1652] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:36:27 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:36:27.880018 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-c140a260-f195-4fbe-a826-e6f82dc6fbef tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:27.880655 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-c140a260-f195-4fbe-a826-e6f82dc6fbef tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:27.887176 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c140a260-f195-4fbe-a826-e6f82dc6fbef tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:27.887622 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c140a260-f195-4fbe-a826-e6f82dc6fbef tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:27.888410 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c140a260-f195-4fbe-a826-e6f82dc6fbef tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:27.888843 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c140a260-f195-4fbe-a826-e6f82dc6fbef tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:28.016470 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-c140a260-f195-4fbe-a826-e6f82dc6fbef tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:28.024332 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-c140a260-f195-4fbe-a826-e6f82dc6fbef tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.148293 May 24 15:36:28.024904 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 821/1653] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:36:27 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:36:28.384641 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-b5c27168-6d75-4658-8790-702d34e23601 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:28.385316 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-b5c27168-6d75-4658-8790-702d34e23601 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:28.392070 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b5c27168-6d75-4658-8790-702d34e23601 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:28.392547 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b5c27168-6d75-4658-8790-702d34e23601 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:28.393297 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b5c27168-6d75-4658-8790-702d34e23601 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:28.393720 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b5c27168-6d75-4658-8790-702d34e23601 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:28.456603 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-b5c27168-6d75-4658-8790-702d34e23601 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:28.465422 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-b5c27168-6d75-4658-8790-702d34e23601 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:28.466916 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-b5c27168-6d75-4658-8790-702d34e23601 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:28.468060 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-b5c27168-6d75-4658-8790-702d34e23601 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.087691 May 24 15:36:28.468664 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 833/1654] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:36:28 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:36:29.041093 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-4174ebea-0b26-4d17-a029-dc0e1129ec96 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:29.041707 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-4174ebea-0b26-4d17-a029-dc0e1129ec96 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:29.048253 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4174ebea-0b26-4d17-a029-dc0e1129ec96 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:29.048722 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4174ebea-0b26-4d17-a029-dc0e1129ec96 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:29.049473 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4174ebea-0b26-4d17-a029-dc0e1129ec96 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:29.049903 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4174ebea-0b26-4d17-a029-dc0e1129ec96 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:29.175394 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-4174ebea-0b26-4d17-a029-dc0e1129ec96 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:29.183259 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-4174ebea-0b26-4d17-a029-dc0e1129ec96 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.146658 May 24 15:36:29.183821 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 822/1655] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:36:29 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:36:29.485765 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-7ccc883d-b7a0-4d74-993a-694ba9ee3fc7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:29.486376 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-7ccc883d-b7a0-4d74-993a-694ba9ee3fc7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:29.493532 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7ccc883d-b7a0-4d74-993a-694ba9ee3fc7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:29.493980 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7ccc883d-b7a0-4d74-993a-694ba9ee3fc7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:29.494744 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7ccc883d-b7a0-4d74-993a-694ba9ee3fc7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:29.495176 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7ccc883d-b7a0-4d74-993a-694ba9ee3fc7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:29.556851 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-7ccc883d-b7a0-4d74-993a-694ba9ee3fc7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:29.565111 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-7ccc883d-b7a0-4d74-993a-694ba9ee3fc7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:29.566606 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-7ccc883d-b7a0-4d74-993a-694ba9ee3fc7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:29.567734 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-7ccc883d-b7a0-4d74-993a-694ba9ee3fc7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.085913 May 24 15:36:29.568286 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 834/1656] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:36:29 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:36:30.200369 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d80d618c-7c14-44b9-a2c6-1e09b2f999d5 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:30.200972 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d80d618c-7c14-44b9-a2c6-1e09b2f999d5 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:30.207378 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d80d618c-7c14-44b9-a2c6-1e09b2f999d5 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:30.207816 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d80d618c-7c14-44b9-a2c6-1e09b2f999d5 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:30.209109 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d80d618c-7c14-44b9-a2c6-1e09b2f999d5 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:30.209535 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d80d618c-7c14-44b9-a2c6-1e09b2f999d5 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:30.338532 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-d80d618c-7c14-44b9-a2c6-1e09b2f999d5 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:30.346335 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d80d618c-7c14-44b9-a2c6-1e09b2f999d5 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.149850 May 24 15:36:30.346890 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 823/1657] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:36:30 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:36:30.586076 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-f3cf18a8-f825-419a-97b0-c7774fe93a43 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:30.586619 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-f3cf18a8-f825-419a-97b0-c7774fe93a43 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:30.593001 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f3cf18a8-f825-419a-97b0-c7774fe93a43 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:30.593444 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f3cf18a8-f825-419a-97b0-c7774fe93a43 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:30.594187 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f3cf18a8-f825-419a-97b0-c7774fe93a43 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:30.594609 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f3cf18a8-f825-419a-97b0-c7774fe93a43 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:30.872724 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-f3cf18a8-f825-419a-97b0-c7774fe93a43 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:30.881833 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-f3cf18a8-f825-419a-97b0-c7774fe93a43 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:30.883332 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-f3cf18a8-f825-419a-97b0-c7774fe93a43 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:30.884499 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-f3cf18a8-f825-419a-97b0-c7774fe93a43 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.302911 May 24 15:36:30.885050 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 835/1658] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:36:30 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:36:31.363233 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-5781d2ee-d489-4208-bc09-4a862ca79fd4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:31.363855 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-5781d2ee-d489-4208-bc09-4a862ca79fd4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:31.371316 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5781d2ee-d489-4208-bc09-4a862ca79fd4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:31.371763 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5781d2ee-d489-4208-bc09-4a862ca79fd4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:31.372558 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5781d2ee-d489-4208-bc09-4a862ca79fd4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:31.372995 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5781d2ee-d489-4208-bc09-4a862ca79fd4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:31.499978 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-5781d2ee-d489-4208-bc09-4a862ca79fd4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:31.508146 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-5781d2ee-d489-4208-bc09-4a862ca79fd4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.148771 May 24 15:36:31.508741 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 824/1659] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:36:31 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:36:31.902899 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-69cbf0e8-29ff-497c-92ce-f17f99afed62 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:31.903502 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-69cbf0e8-29ff-497c-92ce-f17f99afed62 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:31.910383 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-69cbf0e8-29ff-497c-92ce-f17f99afed62 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:31.910824 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-69cbf0e8-29ff-497c-92ce-f17f99afed62 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:31.911569 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-69cbf0e8-29ff-497c-92ce-f17f99afed62 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:31.911998 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-69cbf0e8-29ff-497c-92ce-f17f99afed62 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:31.973080 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-69cbf0e8-29ff-497c-92ce-f17f99afed62 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:31.981620 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-69cbf0e8-29ff-497c-92ce-f17f99afed62 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:31.983101 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-69cbf0e8-29ff-497c-92ce-f17f99afed62 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:31.984247 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-69cbf0e8-29ff-497c-92ce-f17f99afed62 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.085238 May 24 15:36:31.984822 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 836/1660] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:36:31 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:36:32.525754 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-53d8ec49-86fd-44a6-8dc7-31f7876e7906 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:32.526359 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-53d8ec49-86fd-44a6-8dc7-31f7876e7906 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:32.532815 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-53d8ec49-86fd-44a6-8dc7-31f7876e7906 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:32.533253 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-53d8ec49-86fd-44a6-8dc7-31f7876e7906 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:32.534005 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-53d8ec49-86fd-44a6-8dc7-31f7876e7906 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:32.534429 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-53d8ec49-86fd-44a6-8dc7-31f7876e7906 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:32.663562 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-53d8ec49-86fd-44a6-8dc7-31f7876e7906 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:32.671500 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-53d8ec49-86fd-44a6-8dc7-31f7876e7906 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.150297 May 24 15:36:32.672063 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 825/1661] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:36:32 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:36:33.002313 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-71d4425e-06b4-4f07-9f4b-639a50a0dac0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:33.002912 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-71d4425e-06b4-4f07-9f4b-639a50a0dac0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:33.009945 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-71d4425e-06b4-4f07-9f4b-639a50a0dac0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:33.010386 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-71d4425e-06b4-4f07-9f4b-639a50a0dac0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:33.011136 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-71d4425e-06b4-4f07-9f4b-639a50a0dac0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:33.011561 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-71d4425e-06b4-4f07-9f4b-639a50a0dac0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:33.071505 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-71d4425e-06b4-4f07-9f4b-639a50a0dac0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:33.079707 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-71d4425e-06b4-4f07-9f4b-639a50a0dac0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:33.081220 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-71d4425e-06b4-4f07-9f4b-639a50a0dac0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:33.082410 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-71d4425e-06b4-4f07-9f4b-639a50a0dac0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084045 May 24 15:36:33.082954 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 837/1662] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:36:32 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:36:33.688436 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-89511178-56bd-4b6a-ace0-04b511813cbc tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:33.689045 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-89511178-56bd-4b6a-ace0-04b511813cbc tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:33.695490 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-89511178-56bd-4b6a-ace0-04b511813cbc tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:33.695935 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-89511178-56bd-4b6a-ace0-04b511813cbc tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:33.696711 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-89511178-56bd-4b6a-ace0-04b511813cbc tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:33.697142 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-89511178-56bd-4b6a-ace0-04b511813cbc tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:33.823539 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-89511178-56bd-4b6a-ace0-04b511813cbc tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:33.831461 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-89511178-56bd-4b6a-ace0-04b511813cbc tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.146909 May 24 15:36:33.832021 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 826/1663] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:36:33 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:36:34.100879 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-33e30e22-926b-4aec-810f-bc731075b83d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:34.101482 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-33e30e22-926b-4aec-810f-bc731075b83d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:34.107945 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-33e30e22-926b-4aec-810f-bc731075b83d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:34.108426 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-33e30e22-926b-4aec-810f-bc731075b83d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:34.109172 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-33e30e22-926b-4aec-810f-bc731075b83d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:34.109594 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-33e30e22-926b-4aec-810f-bc731075b83d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:34.168909 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-33e30e22-926b-4aec-810f-bc731075b83d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:34.177149 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-33e30e22-926b-4aec-810f-bc731075b83d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:34.178657 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-33e30e22-926b-4aec-810f-bc731075b83d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:34.179777 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-33e30e22-926b-4aec-810f-bc731075b83d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.083473 May 24 15:36:34.180339 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 838/1664] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:36:34 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:36:34.848910 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-38a72e1f-afca-4612-9975-ea9151145d9f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:34.849567 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-38a72e1f-afca-4612-9975-ea9151145d9f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:34.855988 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-38a72e1f-afca-4612-9975-ea9151145d9f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:34.856465 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-38a72e1f-afca-4612-9975-ea9151145d9f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:34.857218 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-38a72e1f-afca-4612-9975-ea9151145d9f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:34.857646 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-38a72e1f-afca-4612-9975-ea9151145d9f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:34.987484 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-38a72e1f-afca-4612-9975-ea9151145d9f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:34.996273 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-38a72e1f-afca-4612-9975-ea9151145d9f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.151233 May 24 15:36:34.996862 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 827/1665] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:36:34 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:36:35.197668 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-b1925eb1-2266-4bae-9dc2-10ae09c8292e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:35.198207 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-b1925eb1-2266-4bae-9dc2-10ae09c8292e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:35.204697 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b1925eb1-2266-4bae-9dc2-10ae09c8292e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:35.205141 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b1925eb1-2266-4bae-9dc2-10ae09c8292e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:35.205889 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b1925eb1-2266-4bae-9dc2-10ae09c8292e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:35.206316 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b1925eb1-2266-4bae-9dc2-10ae09c8292e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:35.267827 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-b1925eb1-2266-4bae-9dc2-10ae09c8292e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:35.276588 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-b1925eb1-2266-4bae-9dc2-10ae09c8292e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:35.278079 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-b1925eb1-2266-4bae-9dc2-10ae09c8292e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:35.279215 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-b1925eb1-2266-4bae-9dc2-10ae09c8292e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.085469 May 24 15:36:35.279775 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 839/1666] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:36:35 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:36:36.013696 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-661606dd-e419-4931-a702-8a5200e823e8 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:36.014300 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-661606dd-e419-4931-a702-8a5200e823e8 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:36.020779 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-661606dd-e419-4931-a702-8a5200e823e8 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:36.021227 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-661606dd-e419-4931-a702-8a5200e823e8 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:36.022468 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-661606dd-e419-4931-a702-8a5200e823e8 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:36.022898 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-661606dd-e419-4931-a702-8a5200e823e8 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:36.148801 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-661606dd-e419-4931-a702-8a5200e823e8 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:36.156623 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-661606dd-e419-4931-a702-8a5200e823e8 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.146758 May 24 15:36:36.157185 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 828/1667] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:36:36 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:36:36.297467 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-14eae5ad-f5b0-4feb-a6f4-c31170a48684 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:36.298004 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-14eae5ad-f5b0-4feb-a6f4-c31170a48684 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:36.304390 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-14eae5ad-f5b0-4feb-a6f4-c31170a48684 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:36.304834 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-14eae5ad-f5b0-4feb-a6f4-c31170a48684 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:36.305581 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-14eae5ad-f5b0-4feb-a6f4-c31170a48684 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:36.306006 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-14eae5ad-f5b0-4feb-a6f4-c31170a48684 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:36.365245 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-14eae5ad-f5b0-4feb-a6f4-c31170a48684 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:36.373458 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-14eae5ad-f5b0-4feb-a6f4-c31170a48684 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:36.374933 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-14eae5ad-f5b0-4feb-a6f4-c31170a48684 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:36.376052 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-14eae5ad-f5b0-4feb-a6f4-c31170a48684 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.082461 May 24 15:36:36.376636 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 840/1668] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:36:36 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:36:37.174034 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f7a1dacd-26b2-48d7-81f0-5d74c9b36f48 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:37.174575 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f7a1dacd-26b2-48d7-81f0-5d74c9b36f48 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:37.181978 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f7a1dacd-26b2-48d7-81f0-5d74c9b36f48 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:37.182812 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f7a1dacd-26b2-48d7-81f0-5d74c9b36f48 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:37.183769 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f7a1dacd-26b2-48d7-81f0-5d74c9b36f48 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:37.184207 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f7a1dacd-26b2-48d7-81f0-5d74c9b36f48 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:37.313457 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-f7a1dacd-26b2-48d7-81f0-5d74c9b36f48 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:37.321501 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f7a1dacd-26b2-48d7-81f0-5d74c9b36f48 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.151472 May 24 15:36:37.322063 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 829/1669] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:36:37 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:36:37.394455 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-0a4b46e5-15e4-42b6-adc0-34f6853dddad tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:37.395062 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-0a4b46e5-15e4-42b6-adc0-34f6853dddad tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:37.401658 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0a4b46e5-15e4-42b6-adc0-34f6853dddad tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:37.402108 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0a4b46e5-15e4-42b6-adc0-34f6853dddad tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:37.402863 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0a4b46e5-15e4-42b6-adc0-34f6853dddad tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:37.403296 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0a4b46e5-15e4-42b6-adc0-34f6853dddad tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:37.464253 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-0a4b46e5-15e4-42b6-adc0-34f6853dddad tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:37.472523 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-0a4b46e5-15e4-42b6-adc0-34f6853dddad tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:37.474017 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-0a4b46e5-15e4-42b6-adc0-34f6853dddad tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:37.475675 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-0a4b46e5-15e4-42b6-adc0-34f6853dddad tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.085145 May 24 15:36:37.476171 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 841/1670] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:36:37 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:36:38.338558 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-0b662876-9dee-4ba7-a35f-e07f2b30d5bb tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:38.339078 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-0b662876-9dee-4ba7-a35f-e07f2b30d5bb tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:38.341502 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:36:38.346744 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0b662876-9dee-4ba7-a35f-e07f2b30d5bb tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:38.347186 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0b662876-9dee-4ba7-a35f-e07f2b30d5bb tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:38.347936 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0b662876-9dee-4ba7-a35f-e07f2b30d5bb tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:38.348394 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0b662876-9dee-4ba7-a35f-e07f2b30d5bb tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:38.478375 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-0b662876-9dee-4ba7-a35f-e07f2b30d5bb tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:38.486258 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-0b662876-9dee-4ba7-a35f-e07f2b30d5bb tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.151659 May 24 15:36:38.487055 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 830/1671] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:36:38 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:36:38.493920 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-5cd59d7d-6a2b-49c1-9f3d-1d2f64ae91c4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:38.494533 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-5cd59d7d-6a2b-49c1-9f3d-1d2f64ae91c4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:38.496888 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:36:38.502196 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5cd59d7d-6a2b-49c1-9f3d-1d2f64ae91c4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:38.502643 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5cd59d7d-6a2b-49c1-9f3d-1d2f64ae91c4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:38.503409 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5cd59d7d-6a2b-49c1-9f3d-1d2f64ae91c4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:38.503844 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5cd59d7d-6a2b-49c1-9f3d-1d2f64ae91c4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:38.566224 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-5cd59d7d-6a2b-49c1-9f3d-1d2f64ae91c4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:38.575171 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-5cd59d7d-6a2b-49c1-9f3d-1d2f64ae91c4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:38.576678 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-5cd59d7d-6a2b-49c1-9f3d-1d2f64ae91c4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:38.577796 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-5cd59d7d-6a2b-49c1-9f3d-1d2f64ae91c4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.088499 May 24 15:36:38.578346 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 842/1672] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:36:38 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:36:39.166624 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 15:36:39.166796 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Tue May 24 15:36:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 15:36:39.503706 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-92730ab7-e9c8-452c-871e-41ffe446d65f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:39.504330 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-92730ab7-e9c8-452c-871e-41ffe446d65f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:39.511383 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-92730ab7-e9c8-452c-871e-41ffe446d65f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:39.511823 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-92730ab7-e9c8-452c-871e-41ffe446d65f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:39.512607 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-92730ab7-e9c8-452c-871e-41ffe446d65f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:39.513033 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-92730ab7-e9c8-452c-871e-41ffe446d65f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:39.596025 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-ebe510c6-4802-4078-9fd6-d6fadd89838a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:39.596773 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-ebe510c6-4802-4078-9fd6-d6fadd89838a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:39.603418 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ebe510c6-4802-4078-9fd6-d6fadd89838a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:39.603865 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ebe510c6-4802-4078-9fd6-d6fadd89838a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:39.604660 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ebe510c6-4802-4078-9fd6-d6fadd89838a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:39.605095 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ebe510c6-4802-4078-9fd6-d6fadd89838a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:39.640542 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-92730ab7-e9c8-452c-871e-41ffe446d65f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:39.649181 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-92730ab7-e9c8-452c-871e-41ffe446d65f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.149249 May 24 15:36:39.649762 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 831/1673] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:36:39 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:36:39.667955 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ebe510c6-4802-4078-9fd6-d6fadd89838a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:39.676391 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ebe510c6-4802-4078-9fd6-d6fadd89838a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:39.677923 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ebe510c6-4802-4078-9fd6-d6fadd89838a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:39.679061 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-ebe510c6-4802-4078-9fd6-d6fadd89838a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.086959 May 24 15:36:39.679612 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 843/1674] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:36:39 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:36:40.666768 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-2d4312dd-b0c1-44d7-811b-0d16bc8de3e3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:40.667416 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-2d4312dd-b0c1-44d7-811b-0d16bc8de3e3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:40.673960 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2d4312dd-b0c1-44d7-811b-0d16bc8de3e3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:40.674409 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2d4312dd-b0c1-44d7-811b-0d16bc8de3e3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:40.675164 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2d4312dd-b0c1-44d7-811b-0d16bc8de3e3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:40.675596 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2d4312dd-b0c1-44d7-811b-0d16bc8de3e3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:40.696940 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-45150f3a-669a-417d-90a3-817715a9d8c3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:40.697539 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-45150f3a-669a-417d-90a3-817715a9d8c3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:40.703530 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-45150f3a-669a-417d-90a3-817715a9d8c3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:40.703970 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-45150f3a-669a-417d-90a3-817715a9d8c3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:40.704747 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-45150f3a-669a-417d-90a3-817715a9d8c3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:40.705174 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-45150f3a-669a-417d-90a3-817715a9d8c3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:40.769488 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-45150f3a-669a-417d-90a3-817715a9d8c3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:40.778565 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-45150f3a-669a-417d-90a3-817715a9d8c3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:40.780076 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-45150f3a-669a-417d-90a3-817715a9d8c3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:40.781251 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-45150f3a-669a-417d-90a3-817715a9d8c3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.088315 May 24 15:36:40.781821 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 844/1675] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:36:40 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:36:40.811519 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-2d4312dd-b0c1-44d7-811b-0d16bc8de3e3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:40.819414 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-2d4312dd-b0c1-44d7-811b-0d16bc8de3e3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.156480 May 24 15:36:40.819982 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 832/1676] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:36:40 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:36:41.798921 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-87153928-c23b-488f-8ac8-3d093989c92d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:41.799530 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-87153928-c23b-488f-8ac8-3d093989c92d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:41.806059 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-87153928-c23b-488f-8ac8-3d093989c92d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:41.806510 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-87153928-c23b-488f-8ac8-3d093989c92d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:41.807269 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-87153928-c23b-488f-8ac8-3d093989c92d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:41.807703 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-87153928-c23b-488f-8ac8-3d093989c92d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:41.835855 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-fcb63c65-f329-4287-b5a7-bb2da93f0833 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:41.836486 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-fcb63c65-f329-4287-b5a7-bb2da93f0833 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:41.842981 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fcb63c65-f329-4287-b5a7-bb2da93f0833 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:41.843417 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fcb63c65-f329-4287-b5a7-bb2da93f0833 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:41.844173 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fcb63c65-f329-4287-b5a7-bb2da93f0833 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:41.844631 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fcb63c65-f329-4287-b5a7-bb2da93f0833 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:41.869063 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-87153928-c23b-488f-8ac8-3d093989c92d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:41.877631 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-87153928-c23b-488f-8ac8-3d093989c92d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:41.879306 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-87153928-c23b-488f-8ac8-3d093989c92d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:41.881218 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-87153928-c23b-488f-8ac8-3d093989c92d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.085663 May 24 15:36:41.881862 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 845/1677] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:36:41 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:36:41.969997 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-fcb63c65-f329-4287-b5a7-bb2da93f0833 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:41.977855 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-fcb63c65-f329-4287-b5a7-bb2da93f0833 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.146470 May 24 15:36:41.978408 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 833/1678] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:36:41 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:36:42.898853 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e8704004-1abf-472e-b29b-b0175f28c0fe tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:42.899463 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e8704004-1abf-472e-b29b-b0175f28c0fe tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:42.906011 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e8704004-1abf-472e-b29b-b0175f28c0fe tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:42.906461 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e8704004-1abf-472e-b29b-b0175f28c0fe tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:42.907217 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e8704004-1abf-472e-b29b-b0175f28c0fe tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:42.907647 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e8704004-1abf-472e-b29b-b0175f28c0fe tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:42.972623 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e8704004-1abf-472e-b29b-b0175f28c0fe tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:42.981763 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e8704004-1abf-472e-b29b-b0175f28c0fe tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:42.984706 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e8704004-1abf-472e-b29b-b0175f28c0fe tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:42.986860 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e8704004-1abf-472e-b29b-b0175f28c0fe tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.091575 May 24 15:36:42.987924 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 846/1679] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:36:42 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:36:42.995383 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-7a9408f7-3b67-4659-9ed5-6be0dc4f9e3b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:42.996113 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-7a9408f7-3b67-4659-9ed5-6be0dc4f9e3b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:43.002520 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7a9408f7-3b67-4659-9ed5-6be0dc4f9e3b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:43.002959 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7a9408f7-3b67-4659-9ed5-6be0dc4f9e3b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:43.003707 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7a9408f7-3b67-4659-9ed5-6be0dc4f9e3b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:43.004129 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7a9408f7-3b67-4659-9ed5-6be0dc4f9e3b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:43.129377 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-7a9408f7-3b67-4659-9ed5-6be0dc4f9e3b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:43.137842 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-7a9408f7-3b67-4659-9ed5-6be0dc4f9e3b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.146329 May 24 15:36:43.138400 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 834/1680] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:36:42 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:36:44.006680 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-871af370-7ecf-4e9b-9ba2-f1aa1b028bf0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:44.007313 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-871af370-7ecf-4e9b-9ba2-f1aa1b028bf0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:44.014042 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-871af370-7ecf-4e9b-9ba2-f1aa1b028bf0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:44.014483 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-871af370-7ecf-4e9b-9ba2-f1aa1b028bf0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:44.015234 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-871af370-7ecf-4e9b-9ba2-f1aa1b028bf0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:44.015660 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-871af370-7ecf-4e9b-9ba2-f1aa1b028bf0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:44.077931 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-871af370-7ecf-4e9b-9ba2-f1aa1b028bf0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:44.086968 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-871af370-7ecf-4e9b-9ba2-f1aa1b028bf0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:44.088465 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-871af370-7ecf-4e9b-9ba2-f1aa1b028bf0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:44.089587 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-871af370-7ecf-4e9b-9ba2-f1aa1b028bf0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.087325 May 24 15:36:44.090143 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 847/1681] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:36:44 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:36:44.154828 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f465c553-86ac-42e4-8b32-42a9738b7356 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:44.155467 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f465c553-86ac-42e4-8b32-42a9738b7356 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:44.161946 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f465c553-86ac-42e4-8b32-42a9738b7356 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:44.162390 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f465c553-86ac-42e4-8b32-42a9738b7356 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:44.163149 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f465c553-86ac-42e4-8b32-42a9738b7356 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:44.163578 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f465c553-86ac-42e4-8b32-42a9738b7356 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:44.291864 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-f465c553-86ac-42e4-8b32-42a9738b7356 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:44.299685 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f465c553-86ac-42e4-8b32-42a9738b7356 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.148760 May 24 15:36:44.300245 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 835/1682] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:36:44 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:36:45.110946 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-9c1b05ef-8d94-4bfd-a785-3fd96d001c79 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:45.111551 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-9c1b05ef-8d94-4bfd-a785-3fd96d001c79 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:45.118783 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9c1b05ef-8d94-4bfd-a785-3fd96d001c79 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:45.119224 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9c1b05ef-8d94-4bfd-a785-3fd96d001c79 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:45.119973 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9c1b05ef-8d94-4bfd-a785-3fd96d001c79 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:45.120433 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9c1b05ef-8d94-4bfd-a785-3fd96d001c79 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:45.188182 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-9c1b05ef-8d94-4bfd-a785-3fd96d001c79 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:45.197137 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-9c1b05ef-8d94-4bfd-a785-3fd96d001c79 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:45.198619 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-9c1b05ef-8d94-4bfd-a785-3fd96d001c79 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:45.199738 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-9c1b05ef-8d94-4bfd-a785-3fd96d001c79 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.092698 May 24 15:36:45.200288 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 848/1683] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:36:45 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:36:45.316481 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-2745c409-a9b1-4bcc-90eb-ddc8804498d3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:45.317124 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-2745c409-a9b1-4bcc-90eb-ddc8804498d3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:45.324182 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2745c409-a9b1-4bcc-90eb-ddc8804498d3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:45.324733 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2745c409-a9b1-4bcc-90eb-ddc8804498d3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:45.325493 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2745c409-a9b1-4bcc-90eb-ddc8804498d3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:45.325924 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2745c409-a9b1-4bcc-90eb-ddc8804498d3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:45.343188 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:36:45.455122 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-2745c409-a9b1-4bcc-90eb-ddc8804498d3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:45.463012 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-2745c409-a9b1-4bcc-90eb-ddc8804498d3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.150448 May 24 15:36:45.463568 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 836/1684] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:36:45 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:36:46.217400 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-95254aca-eea5-47c2-8654-7768db48be42 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:46.218004 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-95254aca-eea5-47c2-8654-7768db48be42 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:46.224962 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-95254aca-eea5-47c2-8654-7768db48be42 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:46.225408 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-95254aca-eea5-47c2-8654-7768db48be42 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:46.226155 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-95254aca-eea5-47c2-8654-7768db48be42 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:46.226580 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-95254aca-eea5-47c2-8654-7768db48be42 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:46.230421 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:36:46.288763 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-95254aca-eea5-47c2-8654-7768db48be42 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:46.296986 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-95254aca-eea5-47c2-8654-7768db48be42 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:46.298467 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-95254aca-eea5-47c2-8654-7768db48be42 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:46.299594 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-95254aca-eea5-47c2-8654-7768db48be42 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.086085 May 24 15:36:46.300146 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 849/1685] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:36:46 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:36:46.480229 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-1588c014-a874-4d26-b73e-a081ef7186ab tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:46.480871 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-1588c014-a874-4d26-b73e-a081ef7186ab tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:46.487351 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1588c014-a874-4d26-b73e-a081ef7186ab tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:46.487792 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1588c014-a874-4d26-b73e-a081ef7186ab tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:46.488578 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1588c014-a874-4d26-b73e-a081ef7186ab tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:46.489015 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1588c014-a874-4d26-b73e-a081ef7186ab tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:46.619150 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-1588c014-a874-4d26-b73e-a081ef7186ab tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:46.627035 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-1588c014-a874-4d26-b73e-a081ef7186ab tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.150656 May 24 15:36:46.627598 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 837/1686] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:36:46 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:36:47.317929 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-a3eead07-688c-4fbd-a6d4-924d4184f3b7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:47.319158 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-a3eead07-688c-4fbd-a6d4-924d4184f3b7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:47.328187 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a3eead07-688c-4fbd-a6d4-924d4184f3b7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:47.328654 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a3eead07-688c-4fbd-a6d4-924d4184f3b7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:47.329408 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a3eead07-688c-4fbd-a6d4-924d4184f3b7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:47.329838 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a3eead07-688c-4fbd-a6d4-924d4184f3b7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:47.389761 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-a3eead07-688c-4fbd-a6d4-924d4184f3b7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:47.398060 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-a3eead07-688c-4fbd-a6d4-924d4184f3b7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:47.399551 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-a3eead07-688c-4fbd-a6d4-924d4184f3b7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:47.400720 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-a3eead07-688c-4fbd-a6d4-924d4184f3b7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.086660 May 24 15:36:47.401271 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 850/1687] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:36:47 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:36:47.643907 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-2be563ff-5dd3-4d2b-b0a1-498707ce51e4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:47.644541 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-2be563ff-5dd3-4d2b-b0a1-498707ce51e4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:47.651258 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2be563ff-5dd3-4d2b-b0a1-498707ce51e4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:47.651702 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2be563ff-5dd3-4d2b-b0a1-498707ce51e4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:47.652476 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2be563ff-5dd3-4d2b-b0a1-498707ce51e4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:47.652900 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2be563ff-5dd3-4d2b-b0a1-498707ce51e4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:47.777816 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-2be563ff-5dd3-4d2b-b0a1-498707ce51e4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:47.788813 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-2be563ff-5dd3-4d2b-b0a1-498707ce51e4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.148619 May 24 15:36:47.789390 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 838/1688] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:36:47 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:36:48.421651 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-2e5c9104-ea23-4791-8be1-cb7755b50b9f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:48.422706 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-2e5c9104-ea23-4791-8be1-cb7755b50b9f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:48.431103 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2e5c9104-ea23-4791-8be1-cb7755b50b9f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:48.431794 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2e5c9104-ea23-4791-8be1-cb7755b50b9f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:48.432778 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2e5c9104-ea23-4791-8be1-cb7755b50b9f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:48.433214 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2e5c9104-ea23-4791-8be1-cb7755b50b9f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:48.504833 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-2e5c9104-ea23-4791-8be1-cb7755b50b9f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:48.513680 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-2e5c9104-ea23-4791-8be1-cb7755b50b9f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:48.515177 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-2e5c9104-ea23-4791-8be1-cb7755b50b9f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:48.516320 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-2e5c9104-ea23-4791-8be1-cb7755b50b9f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.101141 May 24 15:36:48.516882 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 851/1689] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:36:48 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:36:48.805990 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d65533c5-a8ce-4853-8c6a-6b70251f173f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:48.806593 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d65533c5-a8ce-4853-8c6a-6b70251f173f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:48.813106 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d65533c5-a8ce-4853-8c6a-6b70251f173f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:48.813549 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d65533c5-a8ce-4853-8c6a-6b70251f173f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:48.814332 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d65533c5-a8ce-4853-8c6a-6b70251f173f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:48.814761 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d65533c5-a8ce-4853-8c6a-6b70251f173f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:48.945136 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-d65533c5-a8ce-4853-8c6a-6b70251f173f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:48.953034 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d65533c5-a8ce-4853-8c6a-6b70251f173f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.151394 May 24 15:36:48.953603 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 839/1690] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:36:48 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:36:49.534439 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-46b38747-91ec-4387-9652-4363b8e81811 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:49.535044 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-46b38747-91ec-4387-9652-4363b8e81811 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:49.541525 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-46b38747-91ec-4387-9652-4363b8e81811 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:49.541970 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-46b38747-91ec-4387-9652-4363b8e81811 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:49.542754 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-46b38747-91ec-4387-9652-4363b8e81811 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:49.543187 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-46b38747-91ec-4387-9652-4363b8e81811 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:49.602962 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-46b38747-91ec-4387-9652-4363b8e81811 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:49.611350 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-46b38747-91ec-4387-9652-4363b8e81811 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:49.612905 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-46b38747-91ec-4387-9652-4363b8e81811 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:49.614034 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-46b38747-91ec-4387-9652-4363b8e81811 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.083519 May 24 15:36:49.615320 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 852/1691] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:36:49 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:36:49.969901 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-b4f21fe2-4783-434c-9107-5b8cac61ef2d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:49.970513 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-b4f21fe2-4783-434c-9107-5b8cac61ef2d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:49.977832 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b4f21fe2-4783-434c-9107-5b8cac61ef2d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:49.978271 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b4f21fe2-4783-434c-9107-5b8cac61ef2d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:49.979020 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b4f21fe2-4783-434c-9107-5b8cac61ef2d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:49.979446 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b4f21fe2-4783-434c-9107-5b8cac61ef2d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:50.101422 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 15:36:50.101610 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Tue May 24 15:36:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 15:36:50.108412 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-b4f21fe2-4783-434c-9107-5b8cac61ef2d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:50.117230 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-b4f21fe2-4783-434c-9107-5b8cac61ef2d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.151392 May 24 15:36:50.117788 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 840/1692] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:36:49 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:36:50.632899 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-992fcedd-4214-4388-9964-521a4f3e9eb6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:50.633500 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-992fcedd-4214-4388-9964-521a4f3e9eb6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:50.639942 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-992fcedd-4214-4388-9964-521a4f3e9eb6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:50.640415 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-992fcedd-4214-4388-9964-521a4f3e9eb6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:50.641163 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-992fcedd-4214-4388-9964-521a4f3e9eb6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:50.641747 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-992fcedd-4214-4388-9964-521a4f3e9eb6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:50.701370 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-992fcedd-4214-4388-9964-521a4f3e9eb6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:50.710167 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-992fcedd-4214-4388-9964-521a4f3e9eb6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:50.711649 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-992fcedd-4214-4388-9964-521a4f3e9eb6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:50.712805 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-992fcedd-4214-4388-9964-521a4f3e9eb6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084363 May 24 15:36:50.713347 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 853/1693] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:36:50 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:36:51.133944 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-0af6837a-2173-4802-b5a4-d8325d86c4f5 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:51.134557 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-0af6837a-2173-4802-b5a4-d8325d86c4f5 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:51.141110 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0af6837a-2173-4802-b5a4-d8325d86c4f5 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:51.141557 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0af6837a-2173-4802-b5a4-d8325d86c4f5 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:51.142319 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0af6837a-2173-4802-b5a4-d8325d86c4f5 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:51.142749 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0af6837a-2173-4802-b5a4-d8325d86c4f5 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:51.269469 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-0af6837a-2173-4802-b5a4-d8325d86c4f5 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:51.277884 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-0af6837a-2173-4802-b5a4-d8325d86c4f5 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.147822 May 24 15:36:51.278450 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 841/1694] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:36:51 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:36:51.731202 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-0ffb64ae-a5f9-479b-a53d-1494fb6f77ea tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:51.731817 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-0ffb64ae-a5f9-479b-a53d-1494fb6f77ea tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:51.738305 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0ffb64ae-a5f9-479b-a53d-1494fb6f77ea tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:51.738757 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0ffb64ae-a5f9-479b-a53d-1494fb6f77ea tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:51.739768 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0ffb64ae-a5f9-479b-a53d-1494fb6f77ea tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:51.740227 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0ffb64ae-a5f9-479b-a53d-1494fb6f77ea tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:51.800036 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-0ffb64ae-a5f9-479b-a53d-1494fb6f77ea tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:51.808461 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-0ffb64ae-a5f9-479b-a53d-1494fb6f77ea tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:51.809963 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-0ffb64ae-a5f9-479b-a53d-1494fb6f77ea tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:51.811098 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-0ffb64ae-a5f9-479b-a53d-1494fb6f77ea tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.083844 May 24 15:36:51.811652 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 854/1695] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:36:51 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:36:52.295144 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-482f4ca3-e03c-496b-abb9-ccc40b965126 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:52.295754 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-482f4ca3-e03c-496b-abb9-ccc40b965126 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:52.302812 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-482f4ca3-e03c-496b-abb9-ccc40b965126 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:52.303255 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-482f4ca3-e03c-496b-abb9-ccc40b965126 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:52.304013 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-482f4ca3-e03c-496b-abb9-ccc40b965126 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:52.304474 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-482f4ca3-e03c-496b-abb9-ccc40b965126 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:52.435620 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-482f4ca3-e03c-496b-abb9-ccc40b965126 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:52.444799 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-482f4ca3-e03c-496b-abb9-ccc40b965126 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.153575 May 24 15:36:52.445371 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 842/1696] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:36:52 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:36:52.830827 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-ff87bd89-b347-4c73-9156-34a55bf3afd5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:52.831436 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-ff87bd89-b347-4c73-9156-34a55bf3afd5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:52.837836 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ff87bd89-b347-4c73-9156-34a55bf3afd5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:52.838279 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ff87bd89-b347-4c73-9156-34a55bf3afd5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:52.839034 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ff87bd89-b347-4c73-9156-34a55bf3afd5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:52.839468 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ff87bd89-b347-4c73-9156-34a55bf3afd5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:52.902616 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ff87bd89-b347-4c73-9156-34a55bf3afd5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:52.911297 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ff87bd89-b347-4c73-9156-34a55bf3afd5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:52.913462 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ff87bd89-b347-4c73-9156-34a55bf3afd5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:52.914582 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-ff87bd89-b347-4c73-9156-34a55bf3afd5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.087642 May 24 15:36:52.915135 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 855/1697] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:36:52 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:36:53.462776 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-55a8ef3d-f301-4420-a557-65e95720bfbc tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:53.463385 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-55a8ef3d-f301-4420-a557-65e95720bfbc tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:53.469866 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-55a8ef3d-f301-4420-a557-65e95720bfbc tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:53.470305 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-55a8ef3d-f301-4420-a557-65e95720bfbc tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:53.471060 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-55a8ef3d-f301-4420-a557-65e95720bfbc tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:53.471488 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-55a8ef3d-f301-4420-a557-65e95720bfbc tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:53.600416 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-55a8ef3d-f301-4420-a557-65e95720bfbc tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:53.608321 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-55a8ef3d-f301-4420-a557-65e95720bfbc tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.150010 May 24 15:36:53.608893 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 843/1698] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:36:53 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:36:53.932057 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-7186079d-e8cf-4f8d-bd3b-917cda497afa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:53.932694 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-7186079d-e8cf-4f8d-bd3b-917cda497afa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:53.939202 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7186079d-e8cf-4f8d-bd3b-917cda497afa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:53.939647 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7186079d-e8cf-4f8d-bd3b-917cda497afa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:53.940433 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7186079d-e8cf-4f8d-bd3b-917cda497afa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:53.940867 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7186079d-e8cf-4f8d-bd3b-917cda497afa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:54.002138 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-7186079d-e8cf-4f8d-bd3b-917cda497afa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:54.011510 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-7186079d-e8cf-4f8d-bd3b-917cda497afa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:54.013056 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-7186079d-e8cf-4f8d-bd3b-917cda497afa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:54.014192 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-7186079d-e8cf-4f8d-bd3b-917cda497afa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.085993 May 24 15:36:54.014744 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 856/1699] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:36:53 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:36:54.626340 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-b1a5bca2-2ba1-4ded-94df-8ef8cd6db9cb tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:54.626946 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-b1a5bca2-2ba1-4ded-94df-8ef8cd6db9cb tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:54.633795 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b1a5bca2-2ba1-4ded-94df-8ef8cd6db9cb tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:54.634244 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b1a5bca2-2ba1-4ded-94df-8ef8cd6db9cb tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:54.634998 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b1a5bca2-2ba1-4ded-94df-8ef8cd6db9cb tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:54.635426 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b1a5bca2-2ba1-4ded-94df-8ef8cd6db9cb tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:54.764695 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-b1a5bca2-2ba1-4ded-94df-8ef8cd6db9cb tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:54.773250 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-b1a5bca2-2ba1-4ded-94df-8ef8cd6db9cb tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.150835 May 24 15:36:54.773821 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 844/1700] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:36:54 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:36:55.031869 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-ac8998c3-7645-44cd-8738-95c9ed282ea5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:55.032507 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-ac8998c3-7645-44cd-8738-95c9ed282ea5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:55.039000 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ac8998c3-7645-44cd-8738-95c9ed282ea5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:55.039446 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ac8998c3-7645-44cd-8738-95c9ed282ea5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:55.040202 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ac8998c3-7645-44cd-8738-95c9ed282ea5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:55.040659 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ac8998c3-7645-44cd-8738-95c9ed282ea5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:55.101425 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ac8998c3-7645-44cd-8738-95c9ed282ea5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:55.109718 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ac8998c3-7645-44cd-8738-95c9ed282ea5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:55.111204 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ac8998c3-7645-44cd-8738-95c9ed282ea5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:55.112356 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-ac8998c3-7645-44cd-8738-95c9ed282ea5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084428 May 24 15:36:55.112908 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 857/1701] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:36:55 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:36:55.790100 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-79cd3cdb-85c6-4413-89ff-4615b163353c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:55.790742 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-79cd3cdb-85c6-4413-89ff-4615b163353c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:55.797192 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-79cd3cdb-85c6-4413-89ff-4615b163353c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:55.797640 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-79cd3cdb-85c6-4413-89ff-4615b163353c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:55.798402 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-79cd3cdb-85c6-4413-89ff-4615b163353c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:55.798834 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-79cd3cdb-85c6-4413-89ff-4615b163353c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:55.925775 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-79cd3cdb-85c6-4413-89ff-4615b163353c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:55.933679 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-79cd3cdb-85c6-4413-89ff-4615b163353c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.147472 May 24 15:36:55.934248 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 845/1702] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:36:55 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:36:56.131009 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-93043207-338d-420e-9f17-0ed12c28ab11 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:56.131618 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-93043207-338d-420e-9f17-0ed12c28ab11 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:56.138117 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-93043207-338d-420e-9f17-0ed12c28ab11 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:56.138559 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-93043207-338d-420e-9f17-0ed12c28ab11 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:56.139310 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-93043207-338d-420e-9f17-0ed12c28ab11 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:56.139737 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-93043207-338d-420e-9f17-0ed12c28ab11 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:56.182412 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 15:36:56.182644 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Tue May 24 15:36:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 15:36:56.199620 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-93043207-338d-420e-9f17-0ed12c28ab11 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:56.208826 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-93043207-338d-420e-9f17-0ed12c28ab11 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:56.210328 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-93043207-338d-420e-9f17-0ed12c28ab11 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:56.211452 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-93043207-338d-420e-9f17-0ed12c28ab11 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084440 May 24 15:36:56.212001 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 858/1703] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:36:56 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:36:56.950123 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-b30a811a-556e-4ab6-8add-b5d1bdff97a8 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:56.950738 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-b30a811a-556e-4ab6-8add-b5d1bdff97a8 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:56.957347 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b30a811a-556e-4ab6-8add-b5d1bdff97a8 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:56.957795 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b30a811a-556e-4ab6-8add-b5d1bdff97a8 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:56.959046 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b30a811a-556e-4ab6-8add-b5d1bdff97a8 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:56.959480 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b30a811a-556e-4ab6-8add-b5d1bdff97a8 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:57.085624 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-b30a811a-556e-4ab6-8add-b5d1bdff97a8 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:57.093582 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-b30a811a-556e-4ab6-8add-b5d1bdff97a8 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.147397 May 24 15:36:57.094144 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 846/1704] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:36:56 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:36:57.228794 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-85d3c404-8dbc-494a-8061-4bfe86aca799 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:57.229544 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-85d3c404-8dbc-494a-8061-4bfe86aca799 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:57.236147 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-85d3c404-8dbc-494a-8061-4bfe86aca799 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:57.236624 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-85d3c404-8dbc-494a-8061-4bfe86aca799 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:57.237379 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-85d3c404-8dbc-494a-8061-4bfe86aca799 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:57.237807 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-85d3c404-8dbc-494a-8061-4bfe86aca799 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:57.299978 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-85d3c404-8dbc-494a-8061-4bfe86aca799 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:57.308281 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-85d3c404-8dbc-494a-8061-4bfe86aca799 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:57.309776 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-85d3c404-8dbc-494a-8061-4bfe86aca799 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:57.310896 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-85d3c404-8dbc-494a-8061-4bfe86aca799 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.085958 May 24 15:36:57.311442 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 859/1705] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:36:57 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:36:58.110457 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-144cb762-9714-4cb6-9e67-ee5d648ca1fb tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:58.111071 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-144cb762-9714-4cb6-9e67-ee5d648ca1fb tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:58.118362 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-144cb762-9714-4cb6-9e67-ee5d648ca1fb tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:58.118802 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-144cb762-9714-4cb6-9e67-ee5d648ca1fb tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:58.119564 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-144cb762-9714-4cb6-9e67-ee5d648ca1fb tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:58.119995 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-144cb762-9714-4cb6-9e67-ee5d648ca1fb tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:58.247814 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-144cb762-9714-4cb6-9e67-ee5d648ca1fb tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:58.256328 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-144cb762-9714-4cb6-9e67-ee5d648ca1fb tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.149763 May 24 15:36:58.256900 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 847/1706] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:36:58 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:36:58.329502 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-a1dad1f2-1428-4eff-a66c-12c624fa5037 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:58.330042 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-a1dad1f2-1428-4eff-a66c-12c624fa5037 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:58.336529 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a1dad1f2-1428-4eff-a66c-12c624fa5037 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:58.336994 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a1dad1f2-1428-4eff-a66c-12c624fa5037 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:58.337740 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a1dad1f2-1428-4eff-a66c-12c624fa5037 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:58.338164 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a1dad1f2-1428-4eff-a66c-12c624fa5037 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:58.398679 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-a1dad1f2-1428-4eff-a66c-12c624fa5037 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:58.406997 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-a1dad1f2-1428-4eff-a66c-12c624fa5037 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:58.408506 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-a1dad1f2-1428-4eff-a66c-12c624fa5037 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:58.409636 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-a1dad1f2-1428-4eff-a66c-12c624fa5037 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084056 May 24 15:36:58.410184 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 860/1707] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:36:58 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:36:59.273061 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a65f99a7-84e4-4325-ba8b-74ef1c7aae1d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:59.273676 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a65f99a7-84e4-4325-ba8b-74ef1c7aae1d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:59.280220 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a65f99a7-84e4-4325-ba8b-74ef1c7aae1d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:59.280696 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a65f99a7-84e4-4325-ba8b-74ef1c7aae1d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:59.281454 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a65f99a7-84e4-4325-ba8b-74ef1c7aae1d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:59.281889 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a65f99a7-84e4-4325-ba8b-74ef1c7aae1d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:59.407012 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-a65f99a7-84e4-4325-ba8b-74ef1c7aae1d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:59.414816 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a65f99a7-84e4-4325-ba8b-74ef1c7aae1d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.146349 May 24 15:36:59.415384 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 848/1708] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:36:59 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:36:59.426773 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-aa235e80-ee37-4920-8841-7edaaf5e90db tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:59.427395 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-aa235e80-ee37-4920-8841-7edaaf5e90db tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:36:59.433852 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-aa235e80-ee37-4920-8841-7edaaf5e90db tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:59.434293 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-aa235e80-ee37-4920-8841-7edaaf5e90db tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:59.435043 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-aa235e80-ee37-4920-8841-7edaaf5e90db tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:59.435470 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-aa235e80-ee37-4920-8841-7edaaf5e90db tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:59.496689 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-aa235e80-ee37-4920-8841-7edaaf5e90db tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:59.505022 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-aa235e80-ee37-4920-8841-7edaaf5e90db tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:59.507022 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-aa235e80-ee37-4920-8841-7edaaf5e90db tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:36:59.508160 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-aa235e80-ee37-4920-8841-7edaaf5e90db tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.085212 May 24 15:36:59.508753 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 861/1709] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:36:59 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:37:00.431475 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-1c4f6f8a-4b9f-4a6a-943e-36b7c4187332 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:00.432031 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-1c4f6f8a-4b9f-4a6a-943e-36b7c4187332 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:00.438650 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1c4f6f8a-4b9f-4a6a-943e-36b7c4187332 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:00.439093 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1c4f6f8a-4b9f-4a6a-943e-36b7c4187332 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:00.439849 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1c4f6f8a-4b9f-4a6a-943e-36b7c4187332 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:00.440276 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1c4f6f8a-4b9f-4a6a-943e-36b7c4187332 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:00.525328 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-ff2b2f07-1c60-4452-86ae-114821a7450a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:00.525943 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-ff2b2f07-1c60-4452-86ae-114821a7450a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:00.532747 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ff2b2f07-1c60-4452-86ae-114821a7450a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:00.533198 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ff2b2f07-1c60-4452-86ae-114821a7450a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:00.533959 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ff2b2f07-1c60-4452-86ae-114821a7450a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:00.534398 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ff2b2f07-1c60-4452-86ae-114821a7450a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:00.573943 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-1c4f6f8a-4b9f-4a6a-943e-36b7c4187332 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:00.582078 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-1c4f6f8a-4b9f-4a6a-943e-36b7c4187332 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.155032 May 24 15:37:00.582624 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 849/1710] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:37:00 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:37:00.597398 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ff2b2f07-1c60-4452-86ae-114821a7450a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:00.605757 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ff2b2f07-1c60-4452-86ae-114821a7450a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:00.607246 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ff2b2f07-1c60-4452-86ae-114821a7450a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:00.608410 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-ff2b2f07-1c60-4452-86ae-114821a7450a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.086992 May 24 15:37:00.608965 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 862/1711] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:37:00 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:37:01.598582 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-6ed541b9-e2e8-4485-a011-e7beaf995b67 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:01.599719 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-6ed541b9-e2e8-4485-a011-e7beaf995b67 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:01.606271 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6ed541b9-e2e8-4485-a011-e7beaf995b67 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:01.606719 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6ed541b9-e2e8-4485-a011-e7beaf995b67 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:01.607476 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6ed541b9-e2e8-4485-a011-e7beaf995b67 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:01.607914 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6ed541b9-e2e8-4485-a011-e7beaf995b67 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:01.626027 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-aefa0ae4-bb3d-4e7b-bf4f-a6b19f9f44d9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:01.626661 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-aefa0ae4-bb3d-4e7b-bf4f-a6b19f9f44d9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:01.633249 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-aefa0ae4-bb3d-4e7b-bf4f-a6b19f9f44d9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:01.633702 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-aefa0ae4-bb3d-4e7b-bf4f-a6b19f9f44d9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:01.634464 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-aefa0ae4-bb3d-4e7b-bf4f-a6b19f9f44d9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:01.634900 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-aefa0ae4-bb3d-4e7b-bf4f-a6b19f9f44d9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:01.698228 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-aefa0ae4-bb3d-4e7b-bf4f-a6b19f9f44d9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:01.706641 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-aefa0ae4-bb3d-4e7b-bf4f-a6b19f9f44d9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:01.708137 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-aefa0ae4-bb3d-4e7b-bf4f-a6b19f9f44d9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:01.709344 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-aefa0ae4-bb3d-4e7b-bf4f-a6b19f9f44d9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.087147 May 24 15:37:01.709900 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 863/1712] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:37:01 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:37:01.734763 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-6ed541b9-e2e8-4485-a011-e7beaf995b67 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:01.743495 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-6ed541b9-e2e8-4485-a011-e7beaf995b67 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.148777 May 24 15:37:01.744054 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 850/1713] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:37:01 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:37:02.727517 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-af4e9f72-40c1-40d9-8bf3-b544dd0ba74a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:02.728141 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-af4e9f72-40c1-40d9-8bf3-b544dd0ba74a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:02.734576 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-af4e9f72-40c1-40d9-8bf3-b544dd0ba74a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:02.735021 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-af4e9f72-40c1-40d9-8bf3-b544dd0ba74a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:02.735775 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-af4e9f72-40c1-40d9-8bf3-b544dd0ba74a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:02.736233 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-af4e9f72-40c1-40d9-8bf3-b544dd0ba74a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:02.760338 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-b87ef13e-7974-4867-b087-e13ba88cbe74 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:02.761178 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-b87ef13e-7974-4867-b087-e13ba88cbe74 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:02.767601 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b87ef13e-7974-4867-b087-e13ba88cbe74 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:02.768049 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b87ef13e-7974-4867-b087-e13ba88cbe74 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:02.768848 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b87ef13e-7974-4867-b087-e13ba88cbe74 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:02.769282 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b87ef13e-7974-4867-b087-e13ba88cbe74 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:02.801544 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-af4e9f72-40c1-40d9-8bf3-b544dd0ba74a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:02.810311 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-af4e9f72-40c1-40d9-8bf3-b544dd0ba74a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:02.811847 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-af4e9f72-40c1-40d9-8bf3-b544dd0ba74a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:02.813030 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-af4e9f72-40c1-40d9-8bf3-b544dd0ba74a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.090032 May 24 15:37:02.813602 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 864/1714] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:37:02 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:37:02.915114 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-b87ef13e-7974-4867-b087-e13ba88cbe74 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:02.923229 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-b87ef13e-7974-4867-b087-e13ba88cbe74 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.166836 May 24 15:37:02.923794 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 851/1715] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:37:02 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:37:03.830257 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-7f203c57-240e-49b4-8ca4-302b57fee9e2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:03.830843 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-7f203c57-240e-49b4-8ca4-302b57fee9e2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:03.837301 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7f203c57-240e-49b4-8ca4-302b57fee9e2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:03.837747 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7f203c57-240e-49b4-8ca4-302b57fee9e2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:03.838496 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7f203c57-240e-49b4-8ca4-302b57fee9e2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:03.838923 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7f203c57-240e-49b4-8ca4-302b57fee9e2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:03.898795 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-7f203c57-240e-49b4-8ca4-302b57fee9e2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:03.902135 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:37:03.907754 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-7f203c57-240e-49b4-8ca4-302b57fee9e2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:03.909269 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-7f203c57-240e-49b4-8ca4-302b57fee9e2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:03.910395 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-7f203c57-240e-49b4-8ca4-302b57fee9e2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084099 May 24 15:37:03.910948 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 865/1716] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:37:03 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:37:03.940129 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-cd12b03a-9dd3-47c8-abb3-14c5e6161c0d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:03.940772 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-cd12b03a-9dd3-47c8-abb3-14c5e6161c0d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:03.947281 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cd12b03a-9dd3-47c8-abb3-14c5e6161c0d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:03.947732 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cd12b03a-9dd3-47c8-abb3-14c5e6161c0d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:03.948533 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cd12b03a-9dd3-47c8-abb3-14c5e6161c0d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:03.948971 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cd12b03a-9dd3-47c8-abb3-14c5e6161c0d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:04.076869 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-cd12b03a-9dd3-47c8-abb3-14c5e6161c0d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:04.085378 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-cd12b03a-9dd3-47c8-abb3-14c5e6161c0d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.148921 May 24 15:37:04.085885 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 852/1717] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:37:03 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:37:04.928156 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-70efb57b-fc6b-460f-91c0-89cde1b86ba9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:04.928885 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-70efb57b-fc6b-460f-91c0-89cde1b86ba9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:04.935288 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-70efb57b-fc6b-460f-91c0-89cde1b86ba9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:04.935729 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-70efb57b-fc6b-460f-91c0-89cde1b86ba9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:04.936519 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-70efb57b-fc6b-460f-91c0-89cde1b86ba9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:04.936953 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-70efb57b-fc6b-460f-91c0-89cde1b86ba9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:04.996841 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-70efb57b-fc6b-460f-91c0-89cde1b86ba9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:05.005107 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-70efb57b-fc6b-460f-91c0-89cde1b86ba9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:05.006595 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-70efb57b-fc6b-460f-91c0-89cde1b86ba9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:05.007718 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-70efb57b-fc6b-460f-91c0-89cde1b86ba9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.083752 May 24 15:37:05.008274 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 866/1718] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:37:04 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:37:05.103048 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d6308043-543c-4fe6-877a-afb670c012c5 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:05.103683 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d6308043-543c-4fe6-877a-afb670c012c5 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:05.110184 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d6308043-543c-4fe6-877a-afb670c012c5 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:05.110627 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d6308043-543c-4fe6-877a-afb670c012c5 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:05.111382 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d6308043-543c-4fe6-877a-afb670c012c5 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:05.111810 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d6308043-543c-4fe6-877a-afb670c012c5 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:05.116007 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:37:05.239960 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-d6308043-543c-4fe6-877a-afb670c012c5 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:05.247845 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d6308043-543c-4fe6-877a-afb670c012c5 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.149425 May 24 15:37:05.248429 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 853/1719] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:37:05 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:37:06.027779 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-b9dfce84-9b70-46df-8872-d8bd54870878 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:06.028438 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-b9dfce84-9b70-46df-8872-d8bd54870878 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:06.034880 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b9dfce84-9b70-46df-8872-d8bd54870878 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:06.035329 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b9dfce84-9b70-46df-8872-d8bd54870878 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:06.036085 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b9dfce84-9b70-46df-8872-d8bd54870878 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:06.036558 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b9dfce84-9b70-46df-8872-d8bd54870878 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:06.099291 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-b9dfce84-9b70-46df-8872-d8bd54870878 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:06.107659 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-b9dfce84-9b70-46df-8872-d8bd54870878 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:06.109177 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-b9dfce84-9b70-46df-8872-d8bd54870878 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:06.110305 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-b9dfce84-9b70-46df-8872-d8bd54870878 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.086495 May 24 15:37:06.110866 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 867/1720] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:37:06 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:37:06.265112 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-bf0f94df-144f-4a6a-b795-27a549a9c287 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:06.265732 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-bf0f94df-144f-4a6a-b795-27a549a9c287 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:06.273102 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bf0f94df-144f-4a6a-b795-27a549a9c287 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:06.273545 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bf0f94df-144f-4a6a-b795-27a549a9c287 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:06.274295 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bf0f94df-144f-4a6a-b795-27a549a9c287 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:06.274723 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bf0f94df-144f-4a6a-b795-27a549a9c287 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:06.402562 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-bf0f94df-144f-4a6a-b795-27a549a9c287 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:06.410515 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-bf0f94df-144f-4a6a-b795-27a549a9c287 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.149290 May 24 15:37:06.411088 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 854/1721] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:37:06 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:37:07.128592 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-fa04bdb5-eaf9-4b83-b1ef-f91b20c9938e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:07.129208 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-fa04bdb5-eaf9-4b83-b1ef-f91b20c9938e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:07.137492 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fa04bdb5-eaf9-4b83-b1ef-f91b20c9938e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:07.137886 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fa04bdb5-eaf9-4b83-b1ef-f91b20c9938e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:07.138655 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fa04bdb5-eaf9-4b83-b1ef-f91b20c9938e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:07.139091 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fa04bdb5-eaf9-4b83-b1ef-f91b20c9938e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:07.200145 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-fa04bdb5-eaf9-4b83-b1ef-f91b20c9938e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:07.208687 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-fa04bdb5-eaf9-4b83-b1ef-f91b20c9938e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:07.210189 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-fa04bdb5-eaf9-4b83-b1ef-f91b20c9938e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:07.211318 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-fa04bdb5-eaf9-4b83-b1ef-f91b20c9938e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.086706 May 24 15:37:07.211876 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 868/1722] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:37:07 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:37:07.428012 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-92ab9ae2-c2fe-4cf3-927b-965bbab74520 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:07.428842 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-92ab9ae2-c2fe-4cf3-927b-965bbab74520 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:07.435337 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-92ab9ae2-c2fe-4cf3-927b-965bbab74520 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:07.435783 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-92ab9ae2-c2fe-4cf3-927b-965bbab74520 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:07.436568 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-92ab9ae2-c2fe-4cf3-927b-965bbab74520 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:07.437003 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-92ab9ae2-c2fe-4cf3-927b-965bbab74520 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:07.568892 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-92ab9ae2-c2fe-4cf3-927b-965bbab74520 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:07.576803 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-92ab9ae2-c2fe-4cf3-927b-965bbab74520 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.153263 May 24 15:37:07.577368 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 855/1723] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:37:07 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:37:08.229071 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e118d297-bc6f-4d2d-9d21-164e0bbd2b7f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:08.229681 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e118d297-bc6f-4d2d-9d21-164e0bbd2b7f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:08.236195 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e118d297-bc6f-4d2d-9d21-164e0bbd2b7f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:08.236678 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e118d297-bc6f-4d2d-9d21-164e0bbd2b7f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:08.237435 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e118d297-bc6f-4d2d-9d21-164e0bbd2b7f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:08.237907 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e118d297-bc6f-4d2d-9d21-164e0bbd2b7f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:08.299618 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e118d297-bc6f-4d2d-9d21-164e0bbd2b7f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:08.308056 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e118d297-bc6f-4d2d-9d21-164e0bbd2b7f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:08.309586 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e118d297-bc6f-4d2d-9d21-164e0bbd2b7f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:08.310716 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e118d297-bc6f-4d2d-9d21-164e0bbd2b7f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.085518 May 24 15:37:08.311280 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 869/1724] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:37:08 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:37:08.593720 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-1b3ed556-6563-4fd8-85c7-3b55346ee9b5 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:08.594335 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-1b3ed556-6563-4fd8-85c7-3b55346ee9b5 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:08.596687 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_api:SELECT=52 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:37:08.601955 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1b3ed556-6563-4fd8-85c7-3b55346ee9b5 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:08.602399 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1b3ed556-6563-4fd8-85c7-3b55346ee9b5 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:08.603159 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1b3ed556-6563-4fd8-85c7-3b55346ee9b5 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:08.603593 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1b3ed556-6563-4fd8-85c7-3b55346ee9b5 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:08.730386 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-1b3ed556-6563-4fd8-85c7-3b55346ee9b5 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:08.738291 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-1b3ed556-6563-4fd8-85c7-3b55346ee9b5 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.148413 May 24 15:37:08.738852 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 856/1725] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:37:08 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:37:09.327913 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-28fe3db8-1e04-4e7b-b100-57981a4dd1a1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:09.328580 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-28fe3db8-1e04-4e7b-b100-57981a4dd1a1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:09.330907 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_api:SELECT=56 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:37:09.336572 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-28fe3db8-1e04-4e7b-b100-57981a4dd1a1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:09.337023 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-28fe3db8-1e04-4e7b-b100-57981a4dd1a1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:09.337788 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-28fe3db8-1e04-4e7b-b100-57981a4dd1a1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:09.338222 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-28fe3db8-1e04-4e7b-b100-57981a4dd1a1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:09.398729 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-28fe3db8-1e04-4e7b-b100-57981a4dd1a1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:09.407096 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-28fe3db8-1e04-4e7b-b100-57981a4dd1a1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:09.408627 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-28fe3db8-1e04-4e7b-b100-57981a4dd1a1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:09.409767 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-28fe3db8-1e04-4e7b-b100-57981a4dd1a1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.085746 May 24 15:37:09.410322 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 870/1726] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:37:09 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:37:09.756571 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-eb5f76e1-e3de-43ac-a89a-5d1b0c448112 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:09.757181 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-eb5f76e1-e3de-43ac-a89a-5d1b0c448112 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:09.763490 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-eb5f76e1-e3de-43ac-a89a-5d1b0c448112 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:09.763935 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-eb5f76e1-e3de-43ac-a89a-5d1b0c448112 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:09.764842 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-eb5f76e1-e3de-43ac-a89a-5d1b0c448112 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:09.765276 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-eb5f76e1-e3de-43ac-a89a-5d1b0c448112 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:09.889107 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-eb5f76e1-e3de-43ac-a89a-5d1b0c448112 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:09.897595 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-eb5f76e1-e3de-43ac-a89a-5d1b0c448112 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.145420 May 24 15:37:09.898188 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 857/1727] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:37:09 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:37:10.428373 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-1cacb25d-6931-4247-b497-f4dd65b2d860 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:10.428925 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-1cacb25d-6931-4247-b497-f4dd65b2d860 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:10.435092 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1cacb25d-6931-4247-b497-f4dd65b2d860 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:10.435811 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1cacb25d-6931-4247-b497-f4dd65b2d860 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:10.436587 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1cacb25d-6931-4247-b497-f4dd65b2d860 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:10.437015 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1cacb25d-6931-4247-b497-f4dd65b2d860 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:10.500279 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-1cacb25d-6931-4247-b497-f4dd65b2d860 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:10.509158 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-1cacb25d-6931-4247-b497-f4dd65b2d860 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:10.510653 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-1cacb25d-6931-4247-b497-f4dd65b2d860 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:10.511780 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-1cacb25d-6931-4247-b497-f4dd65b2d860 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.087479 May 24 15:37:10.512348 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 871/1728] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:37:10 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:37:10.915166 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-87949a68-ea1a-4648-913f-d5616ca24f41 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:10.915775 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-87949a68-ea1a-4648-913f-d5616ca24f41 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:10.922475 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-87949a68-ea1a-4648-913f-d5616ca24f41 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:10.922916 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-87949a68-ea1a-4648-913f-d5616ca24f41 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:10.923670 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-87949a68-ea1a-4648-913f-d5616ca24f41 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:10.924096 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-87949a68-ea1a-4648-913f-d5616ca24f41 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:11.050967 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-87949a68-ea1a-4648-913f-d5616ca24f41 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:11.059007 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-87949a68-ea1a-4648-913f-d5616ca24f41 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.148369 May 24 15:37:11.059575 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 858/1729] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:37:10 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:37:11.529557 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-70ededde-a9cd-4c45-b511-ea1327508801 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:11.530310 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-70ededde-a9cd-4c45-b511-ea1327508801 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:11.537114 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-70ededde-a9cd-4c45-b511-ea1327508801 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:11.537559 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-70ededde-a9cd-4c45-b511-ea1327508801 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:11.538310 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-70ededde-a9cd-4c45-b511-ea1327508801 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:11.538741 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-70ededde-a9cd-4c45-b511-ea1327508801 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:11.599187 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-70ededde-a9cd-4c45-b511-ea1327508801 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:11.607628 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-70ededde-a9cd-4c45-b511-ea1327508801 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:11.609165 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-70ededde-a9cd-4c45-b511-ea1327508801 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:11.610303 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-70ededde-a9cd-4c45-b511-ea1327508801 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084699 May 24 15:37:11.610856 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 872/1730] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:37:11 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:37:12.076770 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-df882c53-1dec-46af-839c-d687ad998c1c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:12.077392 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-df882c53-1dec-46af-839c-d687ad998c1c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:12.084379 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-df882c53-1dec-46af-839c-d687ad998c1c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:12.084838 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-df882c53-1dec-46af-839c-d687ad998c1c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:12.085610 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-df882c53-1dec-46af-839c-d687ad998c1c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:12.086046 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-df882c53-1dec-46af-839c-d687ad998c1c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:12.217194 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-df882c53-1dec-46af-839c-d687ad998c1c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:12.225647 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-df882c53-1dec-46af-839c-d687ad998c1c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.152762 May 24 15:37:12.226211 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 859/1731] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:37:12 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:37:12.627581 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-cd7a3f8a-1b21-4c2c-828d-7b1baf7898fd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:12.628182 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-cd7a3f8a-1b21-4c2c-828d-7b1baf7898fd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:12.634688 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cd7a3f8a-1b21-4c2c-828d-7b1baf7898fd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:12.635125 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cd7a3f8a-1b21-4c2c-828d-7b1baf7898fd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:12.635867 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cd7a3f8a-1b21-4c2c-828d-7b1baf7898fd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:12.636316 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cd7a3f8a-1b21-4c2c-828d-7b1baf7898fd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:12.695775 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-cd7a3f8a-1b21-4c2c-828d-7b1baf7898fd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:12.703970 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-cd7a3f8a-1b21-4c2c-828d-7b1baf7898fd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:12.705477 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-cd7a3f8a-1b21-4c2c-828d-7b1baf7898fd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:12.706611 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-cd7a3f8a-1b21-4c2c-828d-7b1baf7898fd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.082868 May 24 15:37:12.707133 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 873/1732] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:37:12 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:37:13.243828 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-83f2e6c0-ccf8-4b5f-94f3-2470f1bacb5e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:13.244465 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-83f2e6c0-ccf8-4b5f-94f3-2470f1bacb5e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:13.250982 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-83f2e6c0-ccf8-4b5f-94f3-2470f1bacb5e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:13.251430 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-83f2e6c0-ccf8-4b5f-94f3-2470f1bacb5e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:13.252191 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-83f2e6c0-ccf8-4b5f-94f3-2470f1bacb5e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:13.252662 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-83f2e6c0-ccf8-4b5f-94f3-2470f1bacb5e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:13.377230 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-83f2e6c0-ccf8-4b5f-94f3-2470f1bacb5e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:13.385743 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-83f2e6c0-ccf8-4b5f-94f3-2470f1bacb5e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.146579 May 24 15:37:13.386309 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 860/1733] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:37:13 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:37:13.725354 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-50e2e1b2-0d8e-43b3-821e-246140c18462 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:13.725971 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-50e2e1b2-0d8e-43b3-821e-246140c18462 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:13.732482 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-50e2e1b2-0d8e-43b3-821e-246140c18462 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:13.732934 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-50e2e1b2-0d8e-43b3-821e-246140c18462 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:13.733692 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-50e2e1b2-0d8e-43b3-821e-246140c18462 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:13.734124 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-50e2e1b2-0d8e-43b3-821e-246140c18462 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:13.794045 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-50e2e1b2-0d8e-43b3-821e-246140c18462 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:13.803414 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-50e2e1b2-0d8e-43b3-821e-246140c18462 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:13.805039 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-50e2e1b2-0d8e-43b3-821e-246140c18462 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:13.806096 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-50e2e1b2-0d8e-43b3-821e-246140c18462 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.085186 May 24 15:37:13.806679 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 874/1734] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:37:13 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:37:14.402749 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-2a14368a-e9a4-4925-ada2-713c96223c7a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:14.403365 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-2a14368a-e9a4-4925-ada2-713c96223c7a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:14.409871 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2a14368a-e9a4-4925-ada2-713c96223c7a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:14.410320 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2a14368a-e9a4-4925-ada2-713c96223c7a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:14.411093 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2a14368a-e9a4-4925-ada2-713c96223c7a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:14.411532 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2a14368a-e9a4-4925-ada2-713c96223c7a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:14.544876 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-2a14368a-e9a4-4925-ada2-713c96223c7a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:14.552726 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-2a14368a-e9a4-4925-ada2-713c96223c7a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.153905 May 24 15:37:14.553294 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 861/1735] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:37:14 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:37:14.823928 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-6614e404-5f56-4833-b20f-b3fc1cf033b8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:14.824560 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-6614e404-5f56-4833-b20f-b3fc1cf033b8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:14.831003 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6614e404-5f56-4833-b20f-b3fc1cf033b8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:14.831441 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6614e404-5f56-4833-b20f-b3fc1cf033b8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:14.832185 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6614e404-5f56-4833-b20f-b3fc1cf033b8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:14.832638 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6614e404-5f56-4833-b20f-b3fc1cf033b8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:14.895340 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-6614e404-5f56-4833-b20f-b3fc1cf033b8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:14.904187 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-6614e404-5f56-4833-b20f-b3fc1cf033b8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:14.905733 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-6614e404-5f56-4833-b20f-b3fc1cf033b8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:14.906858 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-6614e404-5f56-4833-b20f-b3fc1cf033b8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.086953 May 24 15:37:14.907408 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 875/1736] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:37:14 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:37:15.569891 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-1dab35c0-87ea-46b9-b5bf-873fdbe185da tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:15.570500 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-1dab35c0-87ea-46b9-b5bf-873fdbe185da tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:15.577485 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1dab35c0-87ea-46b9-b5bf-873fdbe185da tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:15.577922 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1dab35c0-87ea-46b9-b5bf-873fdbe185da tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:15.578685 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1dab35c0-87ea-46b9-b5bf-873fdbe185da tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:15.579117 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1dab35c0-87ea-46b9-b5bf-873fdbe185da tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:15.703597 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-1dab35c0-87ea-46b9-b5bf-873fdbe185da tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:15.711462 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-1dab35c0-87ea-46b9-b5bf-873fdbe185da tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.146056 May 24 15:37:15.712028 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 862/1737] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:37:15 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:37:15.925088 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-178d0bcc-692a-4cb8-90cc-5956e4382f07 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:15.925623 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-178d0bcc-692a-4cb8-90cc-5956e4382f07 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:15.932710 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-178d0bcc-692a-4cb8-90cc-5956e4382f07 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:15.933157 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-178d0bcc-692a-4cb8-90cc-5956e4382f07 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:15.933917 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-178d0bcc-692a-4cb8-90cc-5956e4382f07 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:15.934348 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-178d0bcc-692a-4cb8-90cc-5956e4382f07 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:15.996024 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-178d0bcc-692a-4cb8-90cc-5956e4382f07 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:16.004547 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-178d0bcc-692a-4cb8-90cc-5956e4382f07 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:16.006085 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-178d0bcc-692a-4cb8-90cc-5956e4382f07 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:16.007218 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-178d0bcc-692a-4cb8-90cc-5956e4382f07 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.086111 May 24 15:37:16.007775 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 876/1738] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:37:15 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:37:16.728904 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-5b54fccf-6a40-4f96-b569-6add2c92c99f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:16.729515 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-5b54fccf-6a40-4f96-b569-6add2c92c99f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:16.736008 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5b54fccf-6a40-4f96-b569-6add2c92c99f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:16.736490 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5b54fccf-6a40-4f96-b569-6add2c92c99f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:16.737250 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5b54fccf-6a40-4f96-b569-6add2c92c99f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:16.737682 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5b54fccf-6a40-4f96-b569-6add2c92c99f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:16.867276 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-5b54fccf-6a40-4f96-b569-6add2c92c99f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:16.875217 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-5b54fccf-6a40-4f96-b569-6add2c92c99f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.150205 May 24 15:37:16.875786 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 863/1739] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:37:16 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:37:17.025980 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-04a21a25-33df-405f-9a20-e1abcb16bee7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:17.026519 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-04a21a25-33df-405f-9a20-e1abcb16bee7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:17.032993 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-04a21a25-33df-405f-9a20-e1abcb16bee7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:17.033439 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-04a21a25-33df-405f-9a20-e1abcb16bee7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:17.034196 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-04a21a25-33df-405f-9a20-e1abcb16bee7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:17.034631 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-04a21a25-33df-405f-9a20-e1abcb16bee7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:17.095185 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-04a21a25-33df-405f-9a20-e1abcb16bee7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:17.104234 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-04a21a25-33df-405f-9a20-e1abcb16bee7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:17.105764 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-04a21a25-33df-405f-9a20-e1abcb16bee7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:17.106910 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-04a21a25-33df-405f-9a20-e1abcb16bee7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084985 May 24 15:37:17.107464 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 877/1740] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:37:17 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:37:17.892118 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-828044f0-af33-4f52-bdd7-0a047d2b7189 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:17.892788 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-828044f0-af33-4f52-bdd7-0a047d2b7189 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:17.899288 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-828044f0-af33-4f52-bdd7-0a047d2b7189 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:17.899732 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-828044f0-af33-4f52-bdd7-0a047d2b7189 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:17.900533 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-828044f0-af33-4f52-bdd7-0a047d2b7189 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:17.900966 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-828044f0-af33-4f52-bdd7-0a047d2b7189 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:18.025831 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-828044f0-af33-4f52-bdd7-0a047d2b7189 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:18.033838 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-828044f0-af33-4f52-bdd7-0a047d2b7189 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.145624 May 24 15:37:18.034405 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 864/1741] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:37:17 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:37:18.124679 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-367ba06f-9b96-4cfb-91f2-2db3caaf79ad tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:18.125288 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-367ba06f-9b96-4cfb-91f2-2db3caaf79ad tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:18.131985 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-367ba06f-9b96-4cfb-91f2-2db3caaf79ad tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:18.132712 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-367ba06f-9b96-4cfb-91f2-2db3caaf79ad tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:18.133881 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-367ba06f-9b96-4cfb-91f2-2db3caaf79ad tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:18.134533 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-367ba06f-9b96-4cfb-91f2-2db3caaf79ad tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:18.202427 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-367ba06f-9b96-4cfb-91f2-2db3caaf79ad tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:18.210734 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-367ba06f-9b96-4cfb-91f2-2db3caaf79ad tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:18.212216 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-367ba06f-9b96-4cfb-91f2-2db3caaf79ad tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:18.213372 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-367ba06f-9b96-4cfb-91f2-2db3caaf79ad tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.092542 May 24 15:37:18.213922 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 878/1742] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:37:18 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:37:19.051206 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a12361eb-d44c-43bb-8802-8227b171b4ad tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:19.051817 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a12361eb-d44c-43bb-8802-8227b171b4ad tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:19.058371 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a12361eb-d44c-43bb-8802-8227b171b4ad tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:19.058810 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a12361eb-d44c-43bb-8802-8227b171b4ad tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:19.059561 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a12361eb-d44c-43bb-8802-8227b171b4ad tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:19.059990 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a12361eb-d44c-43bb-8802-8227b171b4ad tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:19.190692 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-a12361eb-d44c-43bb-8802-8227b171b4ad tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:19.199538 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a12361eb-d44c-43bb-8802-8227b171b4ad tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.152272 May 24 15:37:19.200199 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 865/1743] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:37:19 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:37:19.231264 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-64dc826c-4726-4ddc-a95c-6cfb1160fa04 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:19.232072 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-64dc826c-4726-4ddc-a95c-6cfb1160fa04 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:19.238636 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-64dc826c-4726-4ddc-a95c-6cfb1160fa04 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:19.239079 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-64dc826c-4726-4ddc-a95c-6cfb1160fa04 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:19.240599 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-64dc826c-4726-4ddc-a95c-6cfb1160fa04 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:19.241033 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-64dc826c-4726-4ddc-a95c-6cfb1160fa04 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:19.304040 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-64dc826c-4726-4ddc-a95c-6cfb1160fa04 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:19.312435 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-64dc826c-4726-4ddc-a95c-6cfb1160fa04 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:19.314014 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-64dc826c-4726-4ddc-a95c-6cfb1160fa04 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:19.315139 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-64dc826c-4726-4ddc-a95c-6cfb1160fa04 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.088204 May 24 15:37:19.315694 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 879/1744] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:37:19 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:37:20.215550 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-dc3c7127-ca41-439c-b5a3-5c8c9ebd284e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:20.216155 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-dc3c7127-ca41-439c-b5a3-5c8c9ebd284e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:20.222699 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dc3c7127-ca41-439c-b5a3-5c8c9ebd284e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:20.223140 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dc3c7127-ca41-439c-b5a3-5c8c9ebd284e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:20.224474 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dc3c7127-ca41-439c-b5a3-5c8c9ebd284e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:20.224906 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dc3c7127-ca41-439c-b5a3-5c8c9ebd284e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:20.334073 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-1726e0d9-2bdb-42b9-9556-9896e0429a86 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:20.334634 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-1726e0d9-2bdb-42b9-9556-9896e0429a86 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:20.340824 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1726e0d9-2bdb-42b9-9556-9896e0429a86 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:20.341289 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1726e0d9-2bdb-42b9-9556-9896e0429a86 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:20.342037 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1726e0d9-2bdb-42b9-9556-9896e0429a86 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:20.342468 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1726e0d9-2bdb-42b9-9556-9896e0429a86 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:20.352703 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-dc3c7127-ca41-439c-b5a3-5c8c9ebd284e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:20.360915 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-dc3c7127-ca41-439c-b5a3-5c8c9ebd284e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.149192 May 24 15:37:20.361566 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 866/1745] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:37:20 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:37:20.405166 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-1726e0d9-2bdb-42b9-9556-9896e0429a86 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:20.413687 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-1726e0d9-2bdb-42b9-9556-9896e0429a86 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:20.415178 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-1726e0d9-2bdb-42b9-9556-9896e0429a86 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:20.416325 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-1726e0d9-2bdb-42b9-9556-9896e0429a86 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.086822 May 24 15:37:20.419750 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 880/1746] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:37:20 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:37:21.378068 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-7b81ef50-4d0e-447b-9e59-4d095523d127 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:21.378675 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-7b81ef50-4d0e-447b-9e59-4d095523d127 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:21.385330 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7b81ef50-4d0e-447b-9e59-4d095523d127 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:21.385768 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7b81ef50-4d0e-447b-9e59-4d095523d127 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:21.386516 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7b81ef50-4d0e-447b-9e59-4d095523d127 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:21.386950 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7b81ef50-4d0e-447b-9e59-4d095523d127 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:21.434691 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-0c6e8115-27f6-4397-bb9a-e4bbac41cd9d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:21.435411 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-0c6e8115-27f6-4397-bb9a-e4bbac41cd9d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:21.441976 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0c6e8115-27f6-4397-bb9a-e4bbac41cd9d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:21.442450 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0c6e8115-27f6-4397-bb9a-e4bbac41cd9d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:21.443214 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0c6e8115-27f6-4397-bb9a-e4bbac41cd9d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:21.443649 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0c6e8115-27f6-4397-bb9a-e4bbac41cd9d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:21.504189 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-0c6e8115-27f6-4397-bb9a-e4bbac41cd9d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:21.512769 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-0c6e8115-27f6-4397-bb9a-e4bbac41cd9d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:21.513795 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-7b81ef50-4d0e-447b-9e59-4d095523d127 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:21.514285 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-0c6e8115-27f6-4397-bb9a-e4bbac41cd9d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:21.515435 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-0c6e8115-27f6-4397-bb9a-e4bbac41cd9d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084833 May 24 15:37:21.515999 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 881/1747] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:37:21 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:37:21.522335 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-7b81ef50-4d0e-447b-9e59-4d095523d127 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.148090 May 24 15:37:21.522886 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 867/1748] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:37:21 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:37:22.533886 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-5bcb79fa-62eb-4751-a724-970cbebdb635 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:22.534509 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-5bcb79fa-62eb-4751-a724-970cbebdb635 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:22.539633 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a7b9bd0d-fdb4-4b02-a9e0-4325cb472dec tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:22.540280 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a7b9bd0d-fdb4-4b02-a9e0-4325cb472dec tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:22.541523 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5bcb79fa-62eb-4751-a724-970cbebdb635 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:22.541972 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5bcb79fa-62eb-4751-a724-970cbebdb635 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:22.542726 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5bcb79fa-62eb-4751-a724-970cbebdb635 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:22.543152 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5bcb79fa-62eb-4751-a724-970cbebdb635 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:22.546748 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a7b9bd0d-fdb4-4b02-a9e0-4325cb472dec tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:22.547192 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a7b9bd0d-fdb4-4b02-a9e0-4325cb472dec tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:22.547953 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a7b9bd0d-fdb4-4b02-a9e0-4325cb472dec tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:22.548414 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a7b9bd0d-fdb4-4b02-a9e0-4325cb472dec tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:22.561328 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:37:22.611124 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-5bcb79fa-62eb-4751-a724-970cbebdb635 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:22.620345 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-5bcb79fa-62eb-4751-a724-970cbebdb635 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:22.621823 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-5bcb79fa-62eb-4751-a724-970cbebdb635 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:22.622978 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-5bcb79fa-62eb-4751-a724-970cbebdb635 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.093142 May 24 15:37:22.623529 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 882/1749] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:37:22 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:37:22.678876 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-a7b9bd0d-fdb4-4b02-a9e0-4325cb472dec tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:22.686772 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a7b9bd0d-fdb4-4b02-a9e0-4325cb472dec tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.151461 May 24 15:37:22.687331 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 868/1750] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:37:22 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:37:23.641103 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-914ac69c-d4bf-4155-930d-da184868c7c8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:23.641703 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-914ac69c-d4bf-4155-930d-da184868c7c8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:23.648948 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-914ac69c-d4bf-4155-930d-da184868c7c8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:23.649396 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-914ac69c-d4bf-4155-930d-da184868c7c8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:23.650141 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-914ac69c-d4bf-4155-930d-da184868c7c8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:23.650570 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-914ac69c-d4bf-4155-930d-da184868c7c8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:23.702915 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-ba1055a6-b852-4586-8d9f-360845c65a64 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:23.703534 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-ba1055a6-b852-4586-8d9f-360845c65a64 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:23.709620 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-914ac69c-d4bf-4155-930d-da184868c7c8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:23.710906 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ba1055a6-b852-4586-8d9f-360845c65a64 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:23.711431 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ba1055a6-b852-4586-8d9f-360845c65a64 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:23.712213 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ba1055a6-b852-4586-8d9f-360845c65a64 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:23.712681 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ba1055a6-b852-4586-8d9f-360845c65a64 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:23.717948 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-914ac69c-d4bf-4155-930d-da184868c7c8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:23.719443 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-914ac69c-d4bf-4155-930d-da184868c7c8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:23.720603 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-914ac69c-d4bf-4155-930d-da184868c7c8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.083344 May 24 15:37:23.721156 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 883/1751] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:37:23 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:37:23.837563 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-ba1055a6-b852-4586-8d9f-360845c65a64 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:23.841042 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:37:23.846532 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-ba1055a6-b852-4586-8d9f-360845c65a64 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.147501 May 24 15:37:23.847104 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 869/1752] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:37:23 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:37:24.738959 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-5eb26301-c2da-4f6a-a6cc-be282bc16fc1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:24.739556 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-5eb26301-c2da-4f6a-a6cc-be282bc16fc1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:24.746381 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5eb26301-c2da-4f6a-a6cc-be282bc16fc1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:24.746832 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5eb26301-c2da-4f6a-a6cc-be282bc16fc1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:24.747589 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5eb26301-c2da-4f6a-a6cc-be282bc16fc1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:24.748030 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5eb26301-c2da-4f6a-a6cc-be282bc16fc1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:24.808024 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-5eb26301-c2da-4f6a-a6cc-be282bc16fc1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:24.816390 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-5eb26301-c2da-4f6a-a6cc-be282bc16fc1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:24.817884 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-5eb26301-c2da-4f6a-a6cc-be282bc16fc1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:24.819506 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-5eb26301-c2da-4f6a-a6cc-be282bc16fc1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084497 May 24 15:37:24.820060 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 884/1753] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:37:24 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:37:24.863891 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-3791f245-db6c-4bcf-b3e4-2c987c5ad35c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:24.864564 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-3791f245-db6c-4bcf-b3e4-2c987c5ad35c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:24.871333 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3791f245-db6c-4bcf-b3e4-2c987c5ad35c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:24.871811 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3791f245-db6c-4bcf-b3e4-2c987c5ad35c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:24.872605 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3791f245-db6c-4bcf-b3e4-2c987c5ad35c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:24.873045 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3791f245-db6c-4bcf-b3e4-2c987c5ad35c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:24.996232 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-3791f245-db6c-4bcf-b3e4-2c987c5ad35c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:25.004092 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-3791f245-db6c-4bcf-b3e4-2c987c5ad35c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.144038 May 24 15:37:25.004698 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 870/1754] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:37:24 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:37:25.837138 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-5c557b65-8162-4bbc-8824-92adcb6c3a01 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:25.837741 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-5c557b65-8162-4bbc-8824-92adcb6c3a01 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:25.844214 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5c557b65-8162-4bbc-8824-92adcb6c3a01 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:25.844687 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5c557b65-8162-4bbc-8824-92adcb6c3a01 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:25.845430 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5c557b65-8162-4bbc-8824-92adcb6c3a01 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:25.845857 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5c557b65-8162-4bbc-8824-92adcb6c3a01 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:25.906040 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-5c557b65-8162-4bbc-8824-92adcb6c3a01 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:25.914889 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-5c557b65-8162-4bbc-8824-92adcb6c3a01 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:25.916406 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-5c557b65-8162-4bbc-8824-92adcb6c3a01 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:25.917530 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-5c557b65-8162-4bbc-8824-92adcb6c3a01 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084251 May 24 15:37:25.918072 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 885/1755] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:37:25 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:37:26.020992 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-75d3b119-7cef-4373-bc59-fc5cbf49f933 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:26.022135 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-75d3b119-7cef-4373-bc59-fc5cbf49f933 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:26.028677 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-75d3b119-7cef-4373-bc59-fc5cbf49f933 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:26.029121 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-75d3b119-7cef-4373-bc59-fc5cbf49f933 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:26.029877 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-75d3b119-7cef-4373-bc59-fc5cbf49f933 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:26.030306 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-75d3b119-7cef-4373-bc59-fc5cbf49f933 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:26.161545 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-75d3b119-7cef-4373-bc59-fc5cbf49f933 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:26.170200 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-75d3b119-7cef-4373-bc59-fc5cbf49f933 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.152994 May 24 15:37:26.170764 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 871/1756] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:37:26 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:37:26.935178 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-b675c9b1-4990-4c40-85c5-4b95ecc000c2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:26.935785 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-b675c9b1-4990-4c40-85c5-4b95ecc000c2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:26.942256 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b675c9b1-4990-4c40-85c5-4b95ecc000c2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:26.942704 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b675c9b1-4990-4c40-85c5-4b95ecc000c2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:26.944144 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b675c9b1-4990-4c40-85c5-4b95ecc000c2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:26.944594 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b675c9b1-4990-4c40-85c5-4b95ecc000c2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:27.007560 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-b675c9b1-4990-4c40-85c5-4b95ecc000c2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:27.015925 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-b675c9b1-4990-4c40-85c5-4b95ecc000c2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:27.017455 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-b675c9b1-4990-4c40-85c5-4b95ecc000c2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:27.018669 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-b675c9b1-4990-4c40-85c5-4b95ecc000c2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.087360 May 24 15:37:27.019238 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 886/1757] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:37:26 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:37:27.187114 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-0717f177-8144-4927-8cea-3738bac5b566 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:27.187647 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-0717f177-8144-4927-8cea-3738bac5b566 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:27.194185 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0717f177-8144-4927-8cea-3738bac5b566 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:27.194627 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0717f177-8144-4927-8cea-3738bac5b566 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:27.195381 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0717f177-8144-4927-8cea-3738bac5b566 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:27.195812 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0717f177-8144-4927-8cea-3738bac5b566 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:27.320630 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-0717f177-8144-4927-8cea-3738bac5b566 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:27.328523 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-0717f177-8144-4927-8cea-3738bac5b566 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.145375 May 24 15:37:27.329087 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 872/1758] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:37:27 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:37:28.036443 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-166c4548-2bc9-4b80-9ba9-f2c1726f9e2e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:28.037080 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-166c4548-2bc9-4b80-9ba9-f2c1726f9e2e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:28.043556 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-166c4548-2bc9-4b80-9ba9-f2c1726f9e2e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:28.044001 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-166c4548-2bc9-4b80-9ba9-f2c1726f9e2e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:28.044789 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-166c4548-2bc9-4b80-9ba9-f2c1726f9e2e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:28.045220 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-166c4548-2bc9-4b80-9ba9-f2c1726f9e2e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:28.104658 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-166c4548-2bc9-4b80-9ba9-f2c1726f9e2e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:28.113004 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-166c4548-2bc9-4b80-9ba9-f2c1726f9e2e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:28.114499 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-166c4548-2bc9-4b80-9ba9-f2c1726f9e2e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:28.116408 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-166c4548-2bc9-4b80-9ba9-f2c1726f9e2e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.083908 May 24 15:37:28.116961 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 887/1759] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:37:28 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:37:28.345766 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-309cdcc6-2745-4966-9fdb-5b6027a654d0 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:28.346331 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-309cdcc6-2745-4966-9fdb-5b6027a654d0 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:28.352777 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-309cdcc6-2745-4966-9fdb-5b6027a654d0 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:28.353221 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-309cdcc6-2745-4966-9fdb-5b6027a654d0 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:28.353967 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-309cdcc6-2745-4966-9fdb-5b6027a654d0 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:28.354392 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-309cdcc6-2745-4966-9fdb-5b6027a654d0 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:28.483329 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-309cdcc6-2745-4966-9fdb-5b6027a654d0 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:28.492455 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-309cdcc6-2745-4966-9fdb-5b6027a654d0 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.150602 May 24 15:37:28.493020 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 873/1760] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:37:28 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:37:29.133661 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-fc29a667-471f-4e88-a30a-03db67beb0aa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:29.134262 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-fc29a667-471f-4e88-a30a-03db67beb0aa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:29.140890 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fc29a667-471f-4e88-a30a-03db67beb0aa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:29.141337 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fc29a667-471f-4e88-a30a-03db67beb0aa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:29.142090 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fc29a667-471f-4e88-a30a-03db67beb0aa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:29.142519 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fc29a667-471f-4e88-a30a-03db67beb0aa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:29.202290 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-fc29a667-471f-4e88-a30a-03db67beb0aa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:29.211350 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-fc29a667-471f-4e88-a30a-03db67beb0aa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:29.212873 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-fc29a667-471f-4e88-a30a-03db67beb0aa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:29.213989 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-fc29a667-471f-4e88-a30a-03db67beb0aa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084210 May 24 15:37:29.214534 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 888/1761] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:37:29 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:37:29.509767 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-893e17b4-36a5-436b-a85a-f463e705bdf4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:29.510369 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-893e17b4-36a5-436b-a85a-f463e705bdf4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:29.516822 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-893e17b4-36a5-436b-a85a-f463e705bdf4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:29.517259 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-893e17b4-36a5-436b-a85a-f463e705bdf4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:29.518011 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-893e17b4-36a5-436b-a85a-f463e705bdf4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:29.518440 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-893e17b4-36a5-436b-a85a-f463e705bdf4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:29.642602 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-893e17b4-36a5-436b-a85a-f463e705bdf4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:29.650459 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-893e17b4-36a5-436b-a85a-f463e705bdf4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.145038 May 24 15:37:29.651029 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 874/1762] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:37:29 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:37:30.232577 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-bb0f4879-38e5-45fa-84b7-be488b0b4cd3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:30.233181 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-bb0f4879-38e5-45fa-84b7-be488b0b4cd3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:30.239597 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bb0f4879-38e5-45fa-84b7-be488b0b4cd3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:30.240881 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bb0f4879-38e5-45fa-84b7-be488b0b4cd3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:30.241640 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bb0f4879-38e5-45fa-84b7-be488b0b4cd3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:30.242071 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bb0f4879-38e5-45fa-84b7-be488b0b4cd3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:30.303236 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-bb0f4879-38e5-45fa-84b7-be488b0b4cd3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:30.311515 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-bb0f4879-38e5-45fa-84b7-be488b0b4cd3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:30.313035 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-bb0f4879-38e5-45fa-84b7-be488b0b4cd3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:30.314169 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-bb0f4879-38e5-45fa-84b7-be488b0b4cd3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.085532 May 24 15:37:30.314724 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 889/1763] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:37:30 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:37:30.666480 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-c5caf2ef-f972-4a0c-adf3-d1b9522f6c4c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:30.667090 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-c5caf2ef-f972-4a0c-adf3-d1b9522f6c4c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:30.673571 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c5caf2ef-f972-4a0c-adf3-d1b9522f6c4c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:30.674011 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c5caf2ef-f972-4a0c-adf3-d1b9522f6c4c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:30.674761 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c5caf2ef-f972-4a0c-adf3-d1b9522f6c4c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:30.675188 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c5caf2ef-f972-4a0c-adf3-d1b9522f6c4c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:30.805055 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-c5caf2ef-f972-4a0c-adf3-d1b9522f6c4c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:30.812904 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-c5caf2ef-f972-4a0c-adf3-d1b9522f6c4c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.150324 May 24 15:37:30.813462 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 875/1764] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:37:30 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:37:31.331829 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-6b9a5633-e861-4f64-b97a-1541ea44d906 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:31.332436 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-6b9a5633-e861-4f64-b97a-1541ea44d906 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:31.339443 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6b9a5633-e861-4f64-b97a-1541ea44d906 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:31.339895 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6b9a5633-e861-4f64-b97a-1541ea44d906 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:31.340689 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6b9a5633-e861-4f64-b97a-1541ea44d906 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:31.341130 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6b9a5633-e861-4f64-b97a-1541ea44d906 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:31.404790 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-6b9a5633-e861-4f64-b97a-1541ea44d906 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:31.413832 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-6b9a5633-e861-4f64-b97a-1541ea44d906 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:31.415332 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-6b9a5633-e861-4f64-b97a-1541ea44d906 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:31.416515 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-6b9a5633-e861-4f64-b97a-1541ea44d906 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.088574 May 24 15:37:31.417076 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 890/1765] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:37:31 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:37:31.830345 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-c9d801c8-fe5d-4c47-802d-af4795dbe091 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:31.830952 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-c9d801c8-fe5d-4c47-802d-af4795dbe091 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:31.838256 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c9d801c8-fe5d-4c47-802d-af4795dbe091 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:31.838701 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c9d801c8-fe5d-4c47-802d-af4795dbe091 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:31.839462 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c9d801c8-fe5d-4c47-802d-af4795dbe091 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:31.839894 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c9d801c8-fe5d-4c47-802d-af4795dbe091 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:31.964943 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-c9d801c8-fe5d-4c47-802d-af4795dbe091 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:31.972761 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-c9d801c8-fe5d-4c47-802d-af4795dbe091 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.146272 May 24 15:37:31.973324 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 876/1766] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:37:31 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:37:32.434409 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-2661fde6-3291-448d-8e0c-2f09b71e5d6f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:32.435027 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-2661fde6-3291-448d-8e0c-2f09b71e5d6f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:32.441527 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2661fde6-3291-448d-8e0c-2f09b71e5d6f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:32.442053 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2661fde6-3291-448d-8e0c-2f09b71e5d6f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:32.442828 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2661fde6-3291-448d-8e0c-2f09b71e5d6f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:32.443257 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2661fde6-3291-448d-8e0c-2f09b71e5d6f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:32.503727 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-2661fde6-3291-448d-8e0c-2f09b71e5d6f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:32.512177 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-2661fde6-3291-448d-8e0c-2f09b71e5d6f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:32.513715 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-2661fde6-3291-448d-8e0c-2f09b71e5d6f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:32.514859 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-2661fde6-3291-448d-8e0c-2f09b71e5d6f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084395 May 24 15:37:32.515418 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 891/1767] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:37:32 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:37:32.990041 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-569a5f76-de44-43c4-b47a-51725656a0b0 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:32.990659 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-569a5f76-de44-43c4-b47a-51725656a0b0 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:32.997174 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-569a5f76-de44-43c4-b47a-51725656a0b0 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:32.997612 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-569a5f76-de44-43c4-b47a-51725656a0b0 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:32.998364 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-569a5f76-de44-43c4-b47a-51725656a0b0 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:32.998797 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-569a5f76-de44-43c4-b47a-51725656a0b0 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:33.124961 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-569a5f76-de44-43c4-b47a-51725656a0b0 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:33.133293 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-569a5f76-de44-43c4-b47a-51725656a0b0 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.147408 May 24 15:37:33.133876 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 877/1768] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:37:32 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:37:33.532648 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-a217ab5f-7e81-4da5-8773-c65b94873691 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:33.533262 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-a217ab5f-7e81-4da5-8773-c65b94873691 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:33.540578 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a217ab5f-7e81-4da5-8773-c65b94873691 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:33.541032 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a217ab5f-7e81-4da5-8773-c65b94873691 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:33.541794 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a217ab5f-7e81-4da5-8773-c65b94873691 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:33.542231 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a217ab5f-7e81-4da5-8773-c65b94873691 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:33.602557 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-a217ab5f-7e81-4da5-8773-c65b94873691 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:33.610937 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-a217ab5f-7e81-4da5-8773-c65b94873691 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:33.612478 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-a217ab5f-7e81-4da5-8773-c65b94873691 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:33.613616 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-a217ab5f-7e81-4da5-8773-c65b94873691 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084913 May 24 15:37:33.614175 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 892/1769] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:37:33 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:37:34.150516 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-810d3b0e-1e16-4bd1-af98-ccd3935a7597 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:34.151181 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-810d3b0e-1e16-4bd1-af98-ccd3935a7597 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:34.157634 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-810d3b0e-1e16-4bd1-af98-ccd3935a7597 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:34.158077 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-810d3b0e-1e16-4bd1-af98-ccd3935a7597 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:34.158824 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-810d3b0e-1e16-4bd1-af98-ccd3935a7597 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:34.159251 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-810d3b0e-1e16-4bd1-af98-ccd3935a7597 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:34.289908 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-810d3b0e-1e16-4bd1-af98-ccd3935a7597 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:34.297766 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-810d3b0e-1e16-4bd1-af98-ccd3935a7597 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.151129 May 24 15:37:34.298334 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 878/1770] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:37:34 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:37:34.631643 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-2eb0a647-f874-4df4-a843-977f9d3b49ef tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:34.632253 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-2eb0a647-f874-4df4-a843-977f9d3b49ef tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:34.638774 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2eb0a647-f874-4df4-a843-977f9d3b49ef tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:34.639222 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2eb0a647-f874-4df4-a843-977f9d3b49ef tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:34.639981 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2eb0a647-f874-4df4-a843-977f9d3b49ef tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:34.640450 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2eb0a647-f874-4df4-a843-977f9d3b49ef tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:34.699924 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-2eb0a647-f874-4df4-a843-977f9d3b49ef tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:34.708686 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-2eb0a647-f874-4df4-a843-977f9d3b49ef tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:34.710196 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-2eb0a647-f874-4df4-a843-977f9d3b49ef tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:34.711340 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-2eb0a647-f874-4df4-a843-977f9d3b49ef tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.083676 May 24 15:37:34.711895 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 893/1771] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:37:34 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:37:35.314241 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d677aa6b-53c8-4ae2-987b-eb46f25f7b4e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:35.314846 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d677aa6b-53c8-4ae2-987b-eb46f25f7b4e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:35.321809 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d677aa6b-53c8-4ae2-987b-eb46f25f7b4e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:35.322248 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d677aa6b-53c8-4ae2-987b-eb46f25f7b4e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:35.323001 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d677aa6b-53c8-4ae2-987b-eb46f25f7b4e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:35.323430 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d677aa6b-53c8-4ae2-987b-eb46f25f7b4e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:35.448228 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-d677aa6b-53c8-4ae2-987b-eb46f25f7b4e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:35.456276 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d677aa6b-53c8-4ae2-987b-eb46f25f7b4e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.145866 May 24 15:37:35.456917 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 879/1772] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:37:35 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:37:35.729352 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c76389cf-f8c9-486a-a9e1-bcbebf6f8049 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:35.729970 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-c76389cf-f8c9-486a-a9e1-bcbebf6f8049 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:35.736532 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c76389cf-f8c9-486a-a9e1-bcbebf6f8049 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:35.736983 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c76389cf-f8c9-486a-a9e1-bcbebf6f8049 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:35.737741 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c76389cf-f8c9-486a-a9e1-bcbebf6f8049 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:35.738175 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c76389cf-f8c9-486a-a9e1-bcbebf6f8049 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:35.801309 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-c76389cf-f8c9-486a-a9e1-bcbebf6f8049 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:35.810089 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-c76389cf-f8c9-486a-a9e1-bcbebf6f8049 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:35.811568 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-c76389cf-f8c9-486a-a9e1-bcbebf6f8049 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:35.812845 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-c76389cf-f8c9-486a-a9e1-bcbebf6f8049 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.087211 May 24 15:37:35.813420 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 894/1773] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:37:35 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:37:36.473861 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-2ef41ee7-f161-4eb5-8aef-b80dffa6ef1c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:36.475090 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-2ef41ee7-f161-4eb5-8aef-b80dffa6ef1c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:36.481593 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2ef41ee7-f161-4eb5-8aef-b80dffa6ef1c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:36.482039 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2ef41ee7-f161-4eb5-8aef-b80dffa6ef1c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:36.482793 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2ef41ee7-f161-4eb5-8aef-b80dffa6ef1c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:36.483225 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2ef41ee7-f161-4eb5-8aef-b80dffa6ef1c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:36.610685 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-2ef41ee7-f161-4eb5-8aef-b80dffa6ef1c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:36.618825 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-2ef41ee7-f161-4eb5-8aef-b80dffa6ef1c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.148838 May 24 15:37:36.619388 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 880/1774] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:37:36 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:37:36.830832 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-90509221-4c16-4ca1-944f-dd52090c27af tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:36.831376 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-90509221-4c16-4ca1-944f-dd52090c27af tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:36.838541 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-90509221-4c16-4ca1-944f-dd52090c27af tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:36.838990 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-90509221-4c16-4ca1-944f-dd52090c27af tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:36.839750 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-90509221-4c16-4ca1-944f-dd52090c27af tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:36.840187 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-90509221-4c16-4ca1-944f-dd52090c27af tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:36.903682 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-90509221-4c16-4ca1-944f-dd52090c27af tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:36.912275 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-90509221-4c16-4ca1-944f-dd52090c27af tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:36.913795 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-90509221-4c16-4ca1-944f-dd52090c27af tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:36.914932 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-90509221-4c16-4ca1-944f-dd52090c27af tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.088003 May 24 15:37:36.915495 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 895/1775] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:37:36 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:37:37.636635 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e5fa9d8d-fac4-422f-b45d-d351b1d15171 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:37.637252 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-e5fa9d8d-fac4-422f-b45d-d351b1d15171 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:37.643417 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e5fa9d8d-fac4-422f-b45d-d351b1d15171 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:37.643865 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e5fa9d8d-fac4-422f-b45d-d351b1d15171 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:37.644662 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e5fa9d8d-fac4-422f-b45d-d351b1d15171 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:37.645099 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e5fa9d8d-fac4-422f-b45d-d351b1d15171 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:37.770685 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-e5fa9d8d-fac4-422f-b45d-d351b1d15171 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:37.779133 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-e5fa9d8d-fac4-422f-b45d-d351b1d15171 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.147004 May 24 15:37:37.779694 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 881/1776] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:37:37 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:37:37.932660 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-4d07295b-b99d-4f40-9305-e86320c28b23 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:37.933199 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-4d07295b-b99d-4f40-9305-e86320c28b23 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:37.939642 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4d07295b-b99d-4f40-9305-e86320c28b23 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:37.940075 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4d07295b-b99d-4f40-9305-e86320c28b23 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:37.940904 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4d07295b-b99d-4f40-9305-e86320c28b23 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:37.941337 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4d07295b-b99d-4f40-9305-e86320c28b23 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:38.000758 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-4d07295b-b99d-4f40-9305-e86320c28b23 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:38.009096 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-4d07295b-b99d-4f40-9305-e86320c28b23 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:38.010598 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-4d07295b-b99d-4f40-9305-e86320c28b23 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:38.011736 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-4d07295b-b99d-4f40-9305-e86320c28b23 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.083068 May 24 15:37:38.012289 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 896/1777] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:37:37 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:37:38.795825 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-97d868f0-a0f0-47ab-93c3-14f95de4161b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:38.796477 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-97d868f0-a0f0-47ab-93c3-14f95de4161b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:38.798865 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_api:SELECT=52 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:37:38.804752 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-97d868f0-a0f0-47ab-93c3-14f95de4161b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:38.805202 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-97d868f0-a0f0-47ab-93c3-14f95de4161b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:38.805965 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-97d868f0-a0f0-47ab-93c3-14f95de4161b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:38.806402 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-97d868f0-a0f0-47ab-93c3-14f95de4161b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:38.933262 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-97d868f0-a0f0-47ab-93c3-14f95de4161b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:38.941174 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-97d868f0-a0f0-47ab-93c3-14f95de4161b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.149189 May 24 15:37:38.941749 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 882/1778] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:37:38 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:37:39.029756 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-f4b799fc-1980-40db-a0f2-308f138a1828 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:39.030366 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-f4b799fc-1980-40db-a0f2-308f138a1828 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:39.036828 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f4b799fc-1980-40db-a0f2-308f138a1828 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:39.037274 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f4b799fc-1980-40db-a0f2-308f138a1828 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:39.038034 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f4b799fc-1980-40db-a0f2-308f138a1828 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:39.038467 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f4b799fc-1980-40db-a0f2-308f138a1828 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:39.098584 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-f4b799fc-1980-40db-a0f2-308f138a1828 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:39.106955 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-f4b799fc-1980-40db-a0f2-308f138a1828 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:39.108481 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-f4b799fc-1980-40db-a0f2-308f138a1828 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:39.109613 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-f4b799fc-1980-40db-a0f2-308f138a1828 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.083750 May 24 15:37:39.110184 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 897/1779] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:37:39 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:37:39.958137 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-2baab2db-c177-4750-b479-92cf06a130dc tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:39.959354 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-2baab2db-c177-4750-b479-92cf06a130dc tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:39.965609 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2baab2db-c177-4750-b479-92cf06a130dc tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:39.966059 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2baab2db-c177-4750-b479-92cf06a130dc tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:39.966822 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2baab2db-c177-4750-b479-92cf06a130dc tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:39.967257 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2baab2db-c177-4750-b479-92cf06a130dc tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:40.094634 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-2baab2db-c177-4750-b479-92cf06a130dc tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:40.102610 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-2baab2db-c177-4750-b479-92cf06a130dc tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.148334 May 24 15:37:40.103173 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 883/1780] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:37:39 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:37:40.127096 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-fd339665-eafd-403d-942e-2f4c3c704eb8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:40.127703 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-fd339665-eafd-403d-942e-2f4c3c704eb8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:40.129587 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_api:SELECT=56 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:37:40.135373 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fd339665-eafd-403d-942e-2f4c3c704eb8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:40.135819 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fd339665-eafd-403d-942e-2f4c3c704eb8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:40.136609 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fd339665-eafd-403d-942e-2f4c3c704eb8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:40.137039 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fd339665-eafd-403d-942e-2f4c3c704eb8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:40.198900 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-fd339665-eafd-403d-942e-2f4c3c704eb8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:40.207417 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-fd339665-eafd-403d-942e-2f4c3c704eb8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:40.209046 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-fd339665-eafd-403d-942e-2f4c3c704eb8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:40.210154 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-fd339665-eafd-403d-942e-2f4c3c704eb8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.087024 May 24 15:37:40.210732 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 898/1781] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:37:40 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:37:41.119384 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f704e178-26d7-4e70-94ba-8b297914880b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:41.120002 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f704e178-26d7-4e70-94ba-8b297914880b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:41.126488 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f704e178-26d7-4e70-94ba-8b297914880b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:41.126934 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f704e178-26d7-4e70-94ba-8b297914880b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:41.127699 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f704e178-26d7-4e70-94ba-8b297914880b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:41.128134 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f704e178-26d7-4e70-94ba-8b297914880b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:41.227882 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-092e55f4-faae-4742-a3f9-dfe124ddb58b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:41.228708 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-092e55f4-faae-4742-a3f9-dfe124ddb58b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:41.235227 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-092e55f4-faae-4742-a3f9-dfe124ddb58b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:41.235672 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-092e55f4-faae-4742-a3f9-dfe124ddb58b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:41.236449 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-092e55f4-faae-4742-a3f9-dfe124ddb58b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:41.236880 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-092e55f4-faae-4742-a3f9-dfe124ddb58b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:41.241432 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:37:41.256698 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-f704e178-26d7-4e70-94ba-8b297914880b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:41.267601 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f704e178-26d7-4e70-94ba-8b297914880b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.151991 May 24 15:37:41.268746 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 884/1782] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:37:41 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:37:41.298817 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-092e55f4-faae-4742-a3f9-dfe124ddb58b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:41.307126 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-092e55f4-faae-4742-a3f9-dfe124ddb58b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:41.308637 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-092e55f4-faae-4742-a3f9-dfe124ddb58b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:41.309756 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-092e55f4-faae-4742-a3f9-dfe124ddb58b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.086406 May 24 15:37:41.310323 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 899/1783] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:37:41 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:37:42.286824 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-c9afcd05-5071-410a-a4e2-d3a2fadad9f0 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:42.287464 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-c9afcd05-5071-410a-a4e2-d3a2fadad9f0 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:42.294063 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c9afcd05-5071-410a-a4e2-d3a2fadad9f0 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:42.294508 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c9afcd05-5071-410a-a4e2-d3a2fadad9f0 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:42.295293 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c9afcd05-5071-410a-a4e2-d3a2fadad9f0 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:42.295724 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c9afcd05-5071-410a-a4e2-d3a2fadad9f0 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:42.327959 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-8a7bc53a-e2c3-4866-a1c1-b7f5c2299e52 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:42.328609 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-8a7bc53a-e2c3-4866-a1c1-b7f5c2299e52 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:42.335943 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8a7bc53a-e2c3-4866-a1c1-b7f5c2299e52 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:42.336516 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8a7bc53a-e2c3-4866-a1c1-b7f5c2299e52 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:42.337359 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8a7bc53a-e2c3-4866-a1c1-b7f5c2299e52 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:42.337799 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8a7bc53a-e2c3-4866-a1c1-b7f5c2299e52 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:42.399948 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-8a7bc53a-e2c3-4866-a1c1-b7f5c2299e52 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:42.408575 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-8a7bc53a-e2c3-4866-a1c1-b7f5c2299e52 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:42.410085 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-8a7bc53a-e2c3-4866-a1c1-b7f5c2299e52 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:42.411246 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-8a7bc53a-e2c3-4866-a1c1-b7f5c2299e52 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.087166 May 24 15:37:42.413318 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 900/1784] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:37:42 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:37:42.431196 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-c9afcd05-5071-410a-a4e2-d3a2fadad9f0 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:42.439147 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-c9afcd05-5071-410a-a4e2-d3a2fadad9f0 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.156171 May 24 15:37:42.439711 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 885/1785] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:37:42 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:37:43.428653 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-67e3385d-2c1a-499f-8bf3-f20d779534f3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:43.429303 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-67e3385d-2c1a-499f-8bf3-f20d779534f3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:43.435801 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-67e3385d-2c1a-499f-8bf3-f20d779534f3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:43.436245 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-67e3385d-2c1a-499f-8bf3-f20d779534f3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:43.437050 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-67e3385d-2c1a-499f-8bf3-f20d779534f3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:43.437483 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-67e3385d-2c1a-499f-8bf3-f20d779534f3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:43.456120 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-3627b456-7b36-422c-b377-92ca76762dce tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:43.456779 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-3627b456-7b36-422c-b377-92ca76762dce tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:43.463729 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3627b456-7b36-422c-b377-92ca76762dce tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:43.464175 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3627b456-7b36-422c-b377-92ca76762dce tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:43.464961 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3627b456-7b36-422c-b377-92ca76762dce tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:43.465391 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3627b456-7b36-422c-b377-92ca76762dce tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:43.483974 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:37:43.499500 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-67e3385d-2c1a-499f-8bf3-f20d779534f3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:43.508560 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-67e3385d-2c1a-499f-8bf3-f20d779534f3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:43.510055 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-67e3385d-2c1a-499f-8bf3-f20d779534f3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:43.511190 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-67e3385d-2c1a-499f-8bf3-f20d779534f3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.086504 May 24 15:37:43.511762 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 901/1786] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:37:43 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:37:43.598063 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-3627b456-7b36-422c-b377-92ca76762dce tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:43.606029 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-3627b456-7b36-422c-b377-92ca76762dce tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.153763 May 24 15:37:43.606591 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 886/1787] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:37:43 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:37:44.528844 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-9aee93f5-880d-4c28-8ed8-b9f6ed698904 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:44.529472 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-9aee93f5-880d-4c28-8ed8-b9f6ed698904 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:44.536003 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9aee93f5-880d-4c28-8ed8-b9f6ed698904 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:44.536510 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9aee93f5-880d-4c28-8ed8-b9f6ed698904 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:44.537259 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9aee93f5-880d-4c28-8ed8-b9f6ed698904 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:44.537686 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9aee93f5-880d-4c28-8ed8-b9f6ed698904 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:44.601498 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-9aee93f5-880d-4c28-8ed8-b9f6ed698904 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:44.609781 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-9aee93f5-880d-4c28-8ed8-b9f6ed698904 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:44.611255 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-9aee93f5-880d-4c28-8ed8-b9f6ed698904 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:44.612433 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-9aee93f5-880d-4c28-8ed8-b9f6ed698904 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.087706 May 24 15:37:44.612991 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 902/1788] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:37:44 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:37:44.622684 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-b385eac9-4a46-433b-9cad-1089adfa126a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:44.623288 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-b385eac9-4a46-433b-9cad-1089adfa126a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:44.630039 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b385eac9-4a46-433b-9cad-1089adfa126a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:44.631117 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b385eac9-4a46-433b-9cad-1089adfa126a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:44.631868 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b385eac9-4a46-433b-9cad-1089adfa126a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:44.632294 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b385eac9-4a46-433b-9cad-1089adfa126a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:44.759692 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-b385eac9-4a46-433b-9cad-1089adfa126a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:44.767640 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-b385eac9-4a46-433b-9cad-1089adfa126a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.148725 May 24 15:37:44.768208 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 887/1789] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:37:44 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:37:45.630926 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-047dda44-3464-4a19-a64f-02783432c1d7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:45.631562 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-047dda44-3464-4a19-a64f-02783432c1d7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:45.638354 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-047dda44-3464-4a19-a64f-02783432c1d7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:45.638804 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-047dda44-3464-4a19-a64f-02783432c1d7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:45.639564 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-047dda44-3464-4a19-a64f-02783432c1d7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:45.639995 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-047dda44-3464-4a19-a64f-02783432c1d7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:45.699635 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-047dda44-3464-4a19-a64f-02783432c1d7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:45.707995 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-047dda44-3464-4a19-a64f-02783432c1d7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:45.710029 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-047dda44-3464-4a19-a64f-02783432c1d7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:45.711146 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-047dda44-3464-4a19-a64f-02783432c1d7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084146 May 24 15:37:45.711701 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 903/1790] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:37:45 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:37:45.784001 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-980d845c-369d-49bb-b5d0-61b0eba51336 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:45.784640 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-980d845c-369d-49bb-b5d0-61b0eba51336 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:45.791110 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-980d845c-369d-49bb-b5d0-61b0eba51336 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:45.791560 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-980d845c-369d-49bb-b5d0-61b0eba51336 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:45.792318 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-980d845c-369d-49bb-b5d0-61b0eba51336 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:45.792756 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-980d845c-369d-49bb-b5d0-61b0eba51336 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:45.916598 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-980d845c-369d-49bb-b5d0-61b0eba51336 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:45.924486 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-980d845c-369d-49bb-b5d0-61b0eba51336 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.144212 May 24 15:37:45.925044 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 888/1791] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:37:45 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:37:46.729349 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-7b5f9acd-7efa-4a50-b4e3-71954c1bfb8c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:46.729956 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-7b5f9acd-7efa-4a50-b4e3-71954c1bfb8c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:46.736423 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7b5f9acd-7efa-4a50-b4e3-71954c1bfb8c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:46.736865 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7b5f9acd-7efa-4a50-b4e3-71954c1bfb8c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:46.737613 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7b5f9acd-7efa-4a50-b4e3-71954c1bfb8c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:46.738044 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7b5f9acd-7efa-4a50-b4e3-71954c1bfb8c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:46.803024 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-7b5f9acd-7efa-4a50-b4e3-71954c1bfb8c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:46.811311 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-7b5f9acd-7efa-4a50-b4e3-71954c1bfb8c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:46.812828 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-7b5f9acd-7efa-4a50-b4e3-71954c1bfb8c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:46.813959 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-7b5f9acd-7efa-4a50-b4e3-71954c1bfb8c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.088562 May 24 15:37:46.814527 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 904/1792] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:37:46 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:37:46.941420 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-6f39a048-dd3f-40a8-8c07-8de81353d671 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:46.942038 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-6f39a048-dd3f-40a8-8c07-8de81353d671 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:46.949231 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6f39a048-dd3f-40a8-8c07-8de81353d671 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:46.949683 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6f39a048-dd3f-40a8-8c07-8de81353d671 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:46.950455 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6f39a048-dd3f-40a8-8c07-8de81353d671 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:46.950892 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6f39a048-dd3f-40a8-8c07-8de81353d671 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:47.079816 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-6f39a048-dd3f-40a8-8c07-8de81353d671 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:47.094039 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-6f39a048-dd3f-40a8-8c07-8de81353d671 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.154211 May 24 15:37:47.094039 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 889/1793] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:37:46 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:37:47.832273 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-6e5da629-d06d-4f05-ad78-d58091a6b822 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:47.832903 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-6e5da629-d06d-4f05-ad78-d58091a6b822 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:47.839889 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6e5da629-d06d-4f05-ad78-d58091a6b822 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:47.840371 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6e5da629-d06d-4f05-ad78-d58091a6b822 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:47.841131 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6e5da629-d06d-4f05-ad78-d58091a6b822 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:47.841561 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6e5da629-d06d-4f05-ad78-d58091a6b822 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:47.901076 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-6e5da629-d06d-4f05-ad78-d58091a6b822 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:47.909283 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-6e5da629-d06d-4f05-ad78-d58091a6b822 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:47.910777 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-6e5da629-d06d-4f05-ad78-d58091a6b822 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:47.912623 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-6e5da629-d06d-4f05-ad78-d58091a6b822 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084357 May 24 15:37:47.913176 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 905/1794] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:37:47 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:37:48.108867 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-2f5ee193-debb-4f16-98f6-d21c211d07c0 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:48.109427 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-2f5ee193-debb-4f16-98f6-d21c211d07c0 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:48.116325 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2f5ee193-debb-4f16-98f6-d21c211d07c0 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:48.116781 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2f5ee193-debb-4f16-98f6-d21c211d07c0 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:48.117548 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2f5ee193-debb-4f16-98f6-d21c211d07c0 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:48.117987 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2f5ee193-debb-4f16-98f6-d21c211d07c0 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:48.248239 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-2f5ee193-debb-4f16-98f6-d21c211d07c0 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:48.256652 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-2f5ee193-debb-4f16-98f6-d21c211d07c0 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.151738 May 24 15:37:48.257228 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 890/1795] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:37:48 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:37:48.929793 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-9126b991-df79-42b9-b4f7-35521b814dfc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:48.930426 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-9126b991-df79-42b9-b4f7-35521b814dfc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:48.936972 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9126b991-df79-42b9-b4f7-35521b814dfc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:48.937418 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9126b991-df79-42b9-b4f7-35521b814dfc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:48.938172 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9126b991-df79-42b9-b4f7-35521b814dfc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:48.938604 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9126b991-df79-42b9-b4f7-35521b814dfc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:49.001342 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-9126b991-df79-42b9-b4f7-35521b814dfc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:49.010174 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-9126b991-df79-42b9-b4f7-35521b814dfc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:49.011663 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-9126b991-df79-42b9-b4f7-35521b814dfc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:49.012842 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-9126b991-df79-42b9-b4f7-35521b814dfc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.086936 May 24 15:37:49.013403 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 906/1796] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:37:48 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:37:49.273656 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-5c69caf1-4c3c-48b4-849c-2372fc337576 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:49.274293 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-5c69caf1-4c3c-48b4-849c-2372fc337576 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:49.280808 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5c69caf1-4c3c-48b4-849c-2372fc337576 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:49.281248 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5c69caf1-4c3c-48b4-849c-2372fc337576 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:49.281996 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5c69caf1-4c3c-48b4-849c-2372fc337576 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:49.282448 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5c69caf1-4c3c-48b4-849c-2372fc337576 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:49.412427 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-5c69caf1-4c3c-48b4-849c-2372fc337576 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:49.420394 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-5c69caf1-4c3c-48b4-849c-2372fc337576 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.150711 May 24 15:37:49.420952 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 891/1797] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:37:49 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:37:50.031315 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-817f8f6a-2a27-48fd-806a-79c95be28404 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:50.032486 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-817f8f6a-2a27-48fd-806a-79c95be28404 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:50.041399 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-817f8f6a-2a27-48fd-806a-79c95be28404 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:50.041839 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-817f8f6a-2a27-48fd-806a-79c95be28404 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:50.042602 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-817f8f6a-2a27-48fd-806a-79c95be28404 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:50.043030 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-817f8f6a-2a27-48fd-806a-79c95be28404 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:50.103138 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-817f8f6a-2a27-48fd-806a-79c95be28404 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:50.111425 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-817f8f6a-2a27-48fd-806a-79c95be28404 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:50.113015 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-817f8f6a-2a27-48fd-806a-79c95be28404 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:50.114118 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-817f8f6a-2a27-48fd-806a-79c95be28404 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.087045 May 24 15:37:50.114697 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 907/1798] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:37:50 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:37:50.438537 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a7b7fb48-a059-42d6-90d3-b3d082c7cfc2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:50.439053 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a7b7fb48-a059-42d6-90d3-b3d082c7cfc2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:50.446194 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a7b7fb48-a059-42d6-90d3-b3d082c7cfc2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:50.446643 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a7b7fb48-a059-42d6-90d3-b3d082c7cfc2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:50.447403 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a7b7fb48-a059-42d6-90d3-b3d082c7cfc2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:50.447837 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a7b7fb48-a059-42d6-90d3-b3d082c7cfc2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:50.574904 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-a7b7fb48-a059-42d6-90d3-b3d082c7cfc2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:50.582821 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a7b7fb48-a059-42d6-90d3-b3d082c7cfc2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.148258 May 24 15:37:50.584020 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 892/1799] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:37:50 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:37:51.132700 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-98cfcc87-b631-4189-9640-5830d66fd54d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:51.133307 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-98cfcc87-b631-4189-9640-5830d66fd54d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:51.139714 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-98cfcc87-b631-4189-9640-5830d66fd54d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:51.140161 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-98cfcc87-b631-4189-9640-5830d66fd54d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:51.140954 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-98cfcc87-b631-4189-9640-5830d66fd54d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:51.141389 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-98cfcc87-b631-4189-9640-5830d66fd54d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:51.202109 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-98cfcc87-b631-4189-9640-5830d66fd54d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:51.211154 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-98cfcc87-b631-4189-9640-5830d66fd54d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:51.212684 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-98cfcc87-b631-4189-9640-5830d66fd54d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:51.213813 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-98cfcc87-b631-4189-9640-5830d66fd54d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.085537 May 24 15:37:51.214362 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 908/1800] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:37:51 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:37:51.600448 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-eb756edf-7398-4bcf-9ab8-f07df20b6de4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:51.601064 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-eb756edf-7398-4bcf-9ab8-f07df20b6de4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:51.607615 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-eb756edf-7398-4bcf-9ab8-f07df20b6de4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:51.608064 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-eb756edf-7398-4bcf-9ab8-f07df20b6de4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:51.608849 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-eb756edf-7398-4bcf-9ab8-f07df20b6de4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:51.609288 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-eb756edf-7398-4bcf-9ab8-f07df20b6de4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:51.734429 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-eb756edf-7398-4bcf-9ab8-f07df20b6de4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:51.743200 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-eb756edf-7398-4bcf-9ab8-f07df20b6de4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.146642 May 24 15:37:51.743769 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 893/1801] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:37:51 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:37:52.231634 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-be0b67dd-f5a7-4d8d-b115-f3affdc125ad tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:52.232243 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-be0b67dd-f5a7-4d8d-b115-f3affdc125ad tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:52.238750 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-be0b67dd-f5a7-4d8d-b115-f3affdc125ad tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:52.239203 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-be0b67dd-f5a7-4d8d-b115-f3affdc125ad tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:52.240223 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-be0b67dd-f5a7-4d8d-b115-f3affdc125ad tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:52.240683 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-be0b67dd-f5a7-4d8d-b115-f3affdc125ad tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:52.301816 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-be0b67dd-f5a7-4d8d-b115-f3affdc125ad tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:52.310164 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-be0b67dd-f5a7-4d8d-b115-f3affdc125ad tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:52.311679 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-be0b67dd-f5a7-4d8d-b115-f3affdc125ad tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:52.312841 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-be0b67dd-f5a7-4d8d-b115-f3affdc125ad tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.085159 May 24 15:37:52.313405 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 909/1802] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:37:52 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:37:52.760237 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-005afb30-bb00-4dec-a581-cc9810f23ba5 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:52.760873 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-005afb30-bb00-4dec-a581-cc9810f23ba5 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:52.767422 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-005afb30-bb00-4dec-a581-cc9810f23ba5 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:52.767866 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-005afb30-bb00-4dec-a581-cc9810f23ba5 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:52.768656 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-005afb30-bb00-4dec-a581-cc9810f23ba5 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:52.769089 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-005afb30-bb00-4dec-a581-cc9810f23ba5 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:52.893658 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-005afb30-bb00-4dec-a581-cc9810f23ba5 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:52.901607 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-005afb30-bb00-4dec-a581-cc9810f23ba5 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.145242 May 24 15:37:52.902165 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 894/1803] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:37:52 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:37:53.330525 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-1d9d5efc-27ff-4bf6-9bfd-409be0852cc2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:53.331105 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-1d9d5efc-27ff-4bf6-9bfd-409be0852cc2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:53.337584 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1d9d5efc-27ff-4bf6-9bfd-409be0852cc2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:53.338021 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1d9d5efc-27ff-4bf6-9bfd-409be0852cc2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:53.338767 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1d9d5efc-27ff-4bf6-9bfd-409be0852cc2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:53.339193 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1d9d5efc-27ff-4bf6-9bfd-409be0852cc2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:53.402412 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-1d9d5efc-27ff-4bf6-9bfd-409be0852cc2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:53.410803 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-1d9d5efc-27ff-4bf6-9bfd-409be0852cc2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:53.412847 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-1d9d5efc-27ff-4bf6-9bfd-409be0852cc2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:53.414015 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-1d9d5efc-27ff-4bf6-9bfd-409be0852cc2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.087388 May 24 15:37:53.414583 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 910/1804] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:37:53 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:37:53.918364 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-bdf62a0c-9d2b-475c-ac43-bbfc61471854 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:53.918964 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-bdf62a0c-9d2b-475c-ac43-bbfc61471854 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:53.925469 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bdf62a0c-9d2b-475c-ac43-bbfc61471854 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:53.925911 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bdf62a0c-9d2b-475c-ac43-bbfc61471854 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:53.926667 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bdf62a0c-9d2b-475c-ac43-bbfc61471854 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:53.927099 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bdf62a0c-9d2b-475c-ac43-bbfc61471854 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:54.054911 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-bdf62a0c-9d2b-475c-ac43-bbfc61471854 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:54.062802 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-bdf62a0c-9d2b-475c-ac43-bbfc61471854 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.148293 May 24 15:37:54.063360 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 895/1805] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:37:53 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:37:54.432357 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-822a21ab-8a8a-4b43-afce-0e69a3cdcf6c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:54.432966 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-822a21ab-8a8a-4b43-afce-0e69a3cdcf6c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:54.439400 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-822a21ab-8a8a-4b43-afce-0e69a3cdcf6c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:54.439845 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-822a21ab-8a8a-4b43-afce-0e69a3cdcf6c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:54.440781 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-822a21ab-8a8a-4b43-afce-0e69a3cdcf6c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:54.441219 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-822a21ab-8a8a-4b43-afce-0e69a3cdcf6c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:54.500692 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-822a21ab-8a8a-4b43-afce-0e69a3cdcf6c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:54.508959 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-822a21ab-8a8a-4b43-afce-0e69a3cdcf6c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:54.510460 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-822a21ab-8a8a-4b43-afce-0e69a3cdcf6c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:54.511581 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-822a21ab-8a8a-4b43-afce-0e69a3cdcf6c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.083149 May 24 15:37:54.512127 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 911/1806] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:37:54 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:37:55.078927 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-531a358b-74b2-4827-b233-c736fdeb8ab7 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:55.079578 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-531a358b-74b2-4827-b233-c736fdeb8ab7 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:55.086819 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-531a358b-74b2-4827-b233-c736fdeb8ab7 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:55.087268 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-531a358b-74b2-4827-b233-c736fdeb8ab7 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:55.088030 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-531a358b-74b2-4827-b233-c736fdeb8ab7 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:55.088503 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-531a358b-74b2-4827-b233-c736fdeb8ab7 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:55.212250 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-531a358b-74b2-4827-b233-c736fdeb8ab7 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:55.220132 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-531a358b-74b2-4827-b233-c736fdeb8ab7 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.145085 May 24 15:37:55.220734 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 896/1807] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:37:55 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:37:55.529724 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-93562d31-0b49-41e7-9994-96f15b025bed tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:55.530325 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-93562d31-0b49-41e7-9994-96f15b025bed tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:55.537480 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-93562d31-0b49-41e7-9994-96f15b025bed tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:55.537920 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-93562d31-0b49-41e7-9994-96f15b025bed tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:55.538665 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-93562d31-0b49-41e7-9994-96f15b025bed tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:55.539095 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-93562d31-0b49-41e7-9994-96f15b025bed tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:55.597545 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-93562d31-0b49-41e7-9994-96f15b025bed tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:55.606299 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-93562d31-0b49-41e7-9994-96f15b025bed tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:55.607780 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-93562d31-0b49-41e7-9994-96f15b025bed tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:55.608933 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-93562d31-0b49-41e7-9994-96f15b025bed tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.083080 May 24 15:37:55.609482 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 912/1808] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:37:55 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:37:56.236948 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-229d0af6-512e-4636-9f36-95edc4efacad tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:56.237598 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-229d0af6-512e-4636-9f36-95edc4efacad tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:56.244390 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-229d0af6-512e-4636-9f36-95edc4efacad tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:56.244846 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-229d0af6-512e-4636-9f36-95edc4efacad tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:56.245604 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-229d0af6-512e-4636-9f36-95edc4efacad tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:56.246040 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-229d0af6-512e-4636-9f36-95edc4efacad tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:56.374198 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-229d0af6-512e-4636-9f36-95edc4efacad tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:56.382640 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-229d0af6-512e-4636-9f36-95edc4efacad tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.149539 May 24 15:37:56.383202 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 897/1809] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:37:56 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:37:56.627027 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-ea7b250e-73db-4fa4-bf73-254bf9b81c52 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:56.627570 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-ea7b250e-73db-4fa4-bf73-254bf9b81c52 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:56.634718 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ea7b250e-73db-4fa4-bf73-254bf9b81c52 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:56.635176 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ea7b250e-73db-4fa4-bf73-254bf9b81c52 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:56.635941 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ea7b250e-73db-4fa4-bf73-254bf9b81c52 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:56.636401 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ea7b250e-73db-4fa4-bf73-254bf9b81c52 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:56.695648 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ea7b250e-73db-4fa4-bf73-254bf9b81c52 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:56.703867 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ea7b250e-73db-4fa4-bf73-254bf9b81c52 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:56.705391 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ea7b250e-73db-4fa4-bf73-254bf9b81c52 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:56.706528 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-ea7b250e-73db-4fa4-bf73-254bf9b81c52 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.083524 May 24 15:37:56.707081 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 913/1810] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:37:56 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:37:57.400097 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-dcabb507-9e16-405b-93fd-03ccdaa51ece tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:57.400711 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-dcabb507-9e16-405b-93fd-03ccdaa51ece tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:57.407163 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dcabb507-9e16-405b-93fd-03ccdaa51ece tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:57.407602 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dcabb507-9e16-405b-93fd-03ccdaa51ece tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:57.408402 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dcabb507-9e16-405b-93fd-03ccdaa51ece tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:57.408832 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dcabb507-9e16-405b-93fd-03ccdaa51ece tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:57.537128 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-dcabb507-9e16-405b-93fd-03ccdaa51ece tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:57.545066 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-dcabb507-9e16-405b-93fd-03ccdaa51ece tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.149298 May 24 15:37:57.545634 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 898/1811] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:37:57 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:37:57.724604 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-997ad766-5a8d-484a-be18-a416ef709f8a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:57.725214 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-997ad766-5a8d-484a-be18-a416ef709f8a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:57.731700 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-997ad766-5a8d-484a-be18-a416ef709f8a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:57.732092 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-997ad766-5a8d-484a-be18-a416ef709f8a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:57.732882 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-997ad766-5a8d-484a-be18-a416ef709f8a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:57.733317 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-997ad766-5a8d-484a-be18-a416ef709f8a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:57.795519 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-997ad766-5a8d-484a-be18-a416ef709f8a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:57.804135 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-997ad766-5a8d-484a-be18-a416ef709f8a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:57.805683 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-997ad766-5a8d-484a-be18-a416ef709f8a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:57.806853 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-997ad766-5a8d-484a-be18-a416ef709f8a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.086674 May 24 15:37:57.807401 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 914/1812] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:37:57 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:37:58.561893 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-64249d5f-b99f-461d-8b3d-d5d38af1ed7d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:58.562507 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-64249d5f-b99f-461d-8b3d-d5d38af1ed7d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:58.569467 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-64249d5f-b99f-461d-8b3d-d5d38af1ed7d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:58.569913 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-64249d5f-b99f-461d-8b3d-d5d38af1ed7d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:58.570674 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-64249d5f-b99f-461d-8b3d-d5d38af1ed7d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:58.571110 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-64249d5f-b99f-461d-8b3d-d5d38af1ed7d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:58.698419 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-64249d5f-b99f-461d-8b3d-d5d38af1ed7d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:58.706355 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-64249d5f-b99f-461d-8b3d-d5d38af1ed7d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.148308 May 24 15:37:58.706922 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 899/1813] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:37:58 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:37:58.824492 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-1c5111ae-8f5f-4c23-8416-438470368042 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:58.825109 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-1c5111ae-8f5f-4c23-8416-438470368042 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:58.831661 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1c5111ae-8f5f-4c23-8416-438470368042 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:58.832110 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1c5111ae-8f5f-4c23-8416-438470368042 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:58.833484 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1c5111ae-8f5f-4c23-8416-438470368042 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:58.833941 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1c5111ae-8f5f-4c23-8416-438470368042 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:58.896176 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-1c5111ae-8f5f-4c23-8416-438470368042 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:58.899654 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:37:58.905648 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-1c5111ae-8f5f-4c23-8416-438470368042 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:58.907153 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-1c5111ae-8f5f-4c23-8416-438470368042 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:58.908294 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-1c5111ae-8f5f-4c23-8416-438470368042 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.087748 May 24 15:37:58.908872 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 915/1814] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:37:58 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:37:59.723666 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e464eeef-30e2-4932-b71c-00da24f30c00 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:59.724436 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-e464eeef-30e2-4932-b71c-00da24f30c00 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:59.730919 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e464eeef-30e2-4932-b71c-00da24f30c00 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:59.731357 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e464eeef-30e2-4932-b71c-00da24f30c00 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:59.732106 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e464eeef-30e2-4932-b71c-00da24f30c00 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:59.732566 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e464eeef-30e2-4932-b71c-00da24f30c00 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:59.856786 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-e464eeef-30e2-4932-b71c-00da24f30c00 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:37:59.865306 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-e464eeef-30e2-4932-b71c-00da24f30c00 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.145210 May 24 15:37:59.865873 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 900/1815] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:37:59 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:37:59.925941 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-02a95b4e-0491-427c-8e5c-aff6791780f2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:37:59.927066 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-02a95b4e-0491-427c-8e5c-aff6791780f2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:37:59.933805 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-02a95b4e-0491-427c-8e5c-aff6791780f2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:59.934250 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-02a95b4e-0491-427c-8e5c-aff6791780f2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:59.935006 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-02a95b4e-0491-427c-8e5c-aff6791780f2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:59.935440 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-02a95b4e-0491-427c-8e5c-aff6791780f2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:59.995639 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-02a95b4e-0491-427c-8e5c-aff6791780f2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:00.004205 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-02a95b4e-0491-427c-8e5c-aff6791780f2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:00.005766 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-02a95b4e-0491-427c-8e5c-aff6791780f2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:00.006906 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-02a95b4e-0491-427c-8e5c-aff6791780f2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084847 May 24 15:38:00.007469 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 916/1816] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:37:59 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:38:00.882695 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-1aca4613-2d70-4baa-b0a1-fc318f15f676 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:00.883299 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-1aca4613-2d70-4baa-b0a1-fc318f15f676 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:00.889875 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1aca4613-2d70-4baa-b0a1-fc318f15f676 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:00.890315 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1aca4613-2d70-4baa-b0a1-fc318f15f676 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:00.891060 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1aca4613-2d70-4baa-b0a1-fc318f15f676 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:00.891487 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1aca4613-2d70-4baa-b0a1-fc318f15f676 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:01.015929 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-1aca4613-2d70-4baa-b0a1-fc318f15f676 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:01.024650 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-1aca4613-2d70-4baa-b0a1-fc318f15f676 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.146315 May 24 15:38:01.025226 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 901/1817] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:00 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:01.025349 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e9f4e7e6-1fa6-4303-a754-d5b65462fd7c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:01.026027 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e9f4e7e6-1fa6-4303-a754-d5b65462fd7c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:01.032552 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e9f4e7e6-1fa6-4303-a754-d5b65462fd7c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:01.032998 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e9f4e7e6-1fa6-4303-a754-d5b65462fd7c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:01.033749 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e9f4e7e6-1fa6-4303-a754-d5b65462fd7c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:01.034177 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e9f4e7e6-1fa6-4303-a754-d5b65462fd7c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:01.095600 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e9f4e7e6-1fa6-4303-a754-d5b65462fd7c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:01.103982 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e9f4e7e6-1fa6-4303-a754-d5b65462fd7c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:01.105517 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e9f4e7e6-1fa6-4303-a754-d5b65462fd7c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:01.106654 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e9f4e7e6-1fa6-4303-a754-d5b65462fd7c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.086043 May 24 15:38:01.107209 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 917/1818] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:38:01 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:38:02.042125 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-ca3c23d9-e94c-497f-a857-d890097a9a1a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:02.042740 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-ca3c23d9-e94c-497f-a857-d890097a9a1a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:02.049230 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ca3c23d9-e94c-497f-a857-d890097a9a1a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:02.049674 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ca3c23d9-e94c-497f-a857-d890097a9a1a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:02.050432 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ca3c23d9-e94c-497f-a857-d890097a9a1a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:02.050863 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ca3c23d9-e94c-497f-a857-d890097a9a1a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:02.125241 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-7f2a406f-6fab-4a14-961b-946625aed535 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:02.125974 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-7f2a406f-6fab-4a14-961b-946625aed535 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:02.132573 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7f2a406f-6fab-4a14-961b-946625aed535 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:02.133010 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7f2a406f-6fab-4a14-961b-946625aed535 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:02.133970 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7f2a406f-6fab-4a14-961b-946625aed535 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:02.134399 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7f2a406f-6fab-4a14-961b-946625aed535 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:02.183471 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-ca3c23d9-e94c-497f-a857-d890097a9a1a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:02.191415 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-ca3c23d9-e94c-497f-a857-d890097a9a1a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.153139 May 24 15:38:02.191999 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 902/1819] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:02 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:02.199030 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-7f2a406f-6fab-4a14-961b-946625aed535 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:02.207371 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-7f2a406f-6fab-4a14-961b-946625aed535 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:02.209384 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-7f2a406f-6fab-4a14-961b-946625aed535 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:02.210506 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-7f2a406f-6fab-4a14-961b-946625aed535 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.089344 May 24 15:38:02.211046 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 918/1820] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:38:02 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:38:03.208611 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-15da88b3-2440-492f-b1ec-09aabfa08123 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:03.209192 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-15da88b3-2440-492f-b1ec-09aabfa08123 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:03.215843 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-15da88b3-2440-492f-b1ec-09aabfa08123 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:03.216285 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-15da88b3-2440-492f-b1ec-09aabfa08123 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:03.217066 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-15da88b3-2440-492f-b1ec-09aabfa08123 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:03.217495 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-15da88b3-2440-492f-b1ec-09aabfa08123 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:03.221313 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:38:03.228865 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-5b93bde4-340b-410e-9e49-5538b113020f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:03.229499 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-5b93bde4-340b-410e-9e49-5538b113020f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:03.236047 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5b93bde4-340b-410e-9e49-5538b113020f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:03.236527 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5b93bde4-340b-410e-9e49-5538b113020f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:03.237271 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5b93bde4-340b-410e-9e49-5538b113020f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:03.237700 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5b93bde4-340b-410e-9e49-5538b113020f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:03.298327 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-5b93bde4-340b-410e-9e49-5538b113020f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:03.307836 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-5b93bde4-340b-410e-9e49-5538b113020f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:03.309379 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-5b93bde4-340b-410e-9e49-5538b113020f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:03.310530 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-5b93bde4-340b-410e-9e49-5538b113020f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.085491 May 24 15:38:03.311089 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 919/1821] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:38:03 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:38:03.347737 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-15da88b3-2440-492f-b1ec-09aabfa08123 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:03.356226 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-15da88b3-2440-492f-b1ec-09aabfa08123 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.151564 May 24 15:38:03.356829 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 903/1822] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:03 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:04.327893 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e71d7e06-f2ff-48d3-be57-d72e6dc6616d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:04.328469 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e71d7e06-f2ff-48d3-be57-d72e6dc6616d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:04.335489 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e71d7e06-f2ff-48d3-be57-d72e6dc6616d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:04.335933 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e71d7e06-f2ff-48d3-be57-d72e6dc6616d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:04.336713 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e71d7e06-f2ff-48d3-be57-d72e6dc6616d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:04.337144 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e71d7e06-f2ff-48d3-be57-d72e6dc6616d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:04.373691 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-4aece225-4bcb-476d-9bcb-4c537d1a9456 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:04.374385 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-4aece225-4bcb-476d-9bcb-4c537d1a9456 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:04.380804 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4aece225-4bcb-476d-9bcb-4c537d1a9456 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:04.381323 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4aece225-4bcb-476d-9bcb-4c537d1a9456 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:04.382173 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4aece225-4bcb-476d-9bcb-4c537d1a9456 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:04.382677 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4aece225-4bcb-476d-9bcb-4c537d1a9456 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:04.397594 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e71d7e06-f2ff-48d3-be57-d72e6dc6616d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:04.406440 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e71d7e06-f2ff-48d3-be57-d72e6dc6616d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:04.408006 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e71d7e06-f2ff-48d3-be57-d72e6dc6616d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:04.409438 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e71d7e06-f2ff-48d3-be57-d72e6dc6616d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.085516 May 24 15:38:04.410002 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 920/1823] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:38:04 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:38:04.516268 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-4aece225-4bcb-476d-9bcb-4c537d1a9456 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:04.524744 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-4aece225-4bcb-476d-9bcb-4c537d1a9456 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.154803 May 24 15:38:04.525416 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 904/1824] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:04 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:38:05.427642 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-86a2921d-6ffe-4e05-8af6-2069a8dcd1f4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:05.428250 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-86a2921d-6ffe-4e05-8af6-2069a8dcd1f4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:05.434846 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-86a2921d-6ffe-4e05-8af6-2069a8dcd1f4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:05.435291 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-86a2921d-6ffe-4e05-8af6-2069a8dcd1f4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:05.436056 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-86a2921d-6ffe-4e05-8af6-2069a8dcd1f4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:05.436526 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-86a2921d-6ffe-4e05-8af6-2069a8dcd1f4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:05.497251 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-86a2921d-6ffe-4e05-8af6-2069a8dcd1f4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:05.505558 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-86a2921d-6ffe-4e05-8af6-2069a8dcd1f4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:05.507062 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-86a2921d-6ffe-4e05-8af6-2069a8dcd1f4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:05.508195 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-86a2921d-6ffe-4e05-8af6-2069a8dcd1f4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.085130 May 24 15:38:05.508786 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 921/1825] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:38:05 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:38:05.541880 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-c0973a60-fc78-4dc7-ac4a-be65040f6367 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:05.542490 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-c0973a60-fc78-4dc7-ac4a-be65040f6367 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:05.548925 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c0973a60-fc78-4dc7-ac4a-be65040f6367 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:05.549366 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c0973a60-fc78-4dc7-ac4a-be65040f6367 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:05.550114 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c0973a60-fc78-4dc7-ac4a-be65040f6367 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:05.550541 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c0973a60-fc78-4dc7-ac4a-be65040f6367 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:05.673706 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-c0973a60-fc78-4dc7-ac4a-be65040f6367 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:05.681633 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-c0973a60-fc78-4dc7-ac4a-be65040f6367 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.143436 May 24 15:38:05.682132 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 905/1826] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:05 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:06.526482 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-0f2f7002-a72a-4713-a7d5-98066ece6260 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:06.527086 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-0f2f7002-a72a-4713-a7d5-98066ece6260 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:06.533710 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0f2f7002-a72a-4713-a7d5-98066ece6260 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:06.534153 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0f2f7002-a72a-4713-a7d5-98066ece6260 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:06.534909 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0f2f7002-a72a-4713-a7d5-98066ece6260 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:06.535344 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0f2f7002-a72a-4713-a7d5-98066ece6260 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:06.599847 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-0f2f7002-a72a-4713-a7d5-98066ece6260 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:06.608132 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-0f2f7002-a72a-4713-a7d5-98066ece6260 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:06.609658 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-0f2f7002-a72a-4713-a7d5-98066ece6260 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:06.610818 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-0f2f7002-a72a-4713-a7d5-98066ece6260 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.088291 May 24 15:38:06.611371 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 922/1827] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:38:06 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:38:06.698312 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-fc678a55-4182-4d02-8a42-a16b40bd9620 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:06.698922 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-fc678a55-4182-4d02-8a42-a16b40bd9620 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:06.705398 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fc678a55-4182-4d02-8a42-a16b40bd9620 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:06.705837 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fc678a55-4182-4d02-8a42-a16b40bd9620 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:06.706590 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fc678a55-4182-4d02-8a42-a16b40bd9620 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:06.707019 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fc678a55-4182-4d02-8a42-a16b40bd9620 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:06.831284 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-fc678a55-4182-4d02-8a42-a16b40bd9620 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:06.839745 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-fc678a55-4182-4d02-8a42-a16b40bd9620 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.145299 May 24 15:38:06.840331 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 906/1828] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:06 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:07.628201 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-5be68b0a-3696-43ac-9811-f5496a8e334c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:07.628834 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-5be68b0a-3696-43ac-9811-f5496a8e334c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:07.635326 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5be68b0a-3696-43ac-9811-f5496a8e334c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:07.635771 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5be68b0a-3696-43ac-9811-f5496a8e334c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:07.636559 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5be68b0a-3696-43ac-9811-f5496a8e334c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:07.636988 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5be68b0a-3696-43ac-9811-f5496a8e334c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:07.696257 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-5be68b0a-3696-43ac-9811-f5496a8e334c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:07.704522 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-5be68b0a-3696-43ac-9811-f5496a8e334c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:07.705998 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-5be68b0a-3696-43ac-9811-f5496a8e334c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:07.707113 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-5be68b0a-3696-43ac-9811-f5496a8e334c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.082847 May 24 15:38:07.707694 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 923/1829] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:38:07 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:38:07.855859 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e9831203-de7c-468e-8936-49fbbd2d22d2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:07.856501 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-e9831203-de7c-468e-8936-49fbbd2d22d2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:07.862985 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e9831203-de7c-468e-8936-49fbbd2d22d2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:07.863428 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e9831203-de7c-468e-8936-49fbbd2d22d2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:07.864826 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e9831203-de7c-468e-8936-49fbbd2d22d2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:07.865525 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e9831203-de7c-468e-8936-49fbbd2d22d2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:07.992702 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-e9831203-de7c-468e-8936-49fbbd2d22d2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:08.000680 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-e9831203-de7c-468e-8936-49fbbd2d22d2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.148661 May 24 15:38:08.001242 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 907/1830] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:07 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:08.724269 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c0d7665a-1515-4276-9c36-e9bd3dc68ac9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:08.724899 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-c0d7665a-1515-4276-9c36-e9bd3dc68ac9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:08.731317 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c0d7665a-1515-4276-9c36-e9bd3dc68ac9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:08.731762 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c0d7665a-1515-4276-9c36-e9bd3dc68ac9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:08.732548 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c0d7665a-1515-4276-9c36-e9bd3dc68ac9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:08.732977 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c0d7665a-1515-4276-9c36-e9bd3dc68ac9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:08.792711 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-c0d7665a-1515-4276-9c36-e9bd3dc68ac9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:08.801254 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-c0d7665a-1515-4276-9c36-e9bd3dc68ac9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:08.803243 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-c0d7665a-1515-4276-9c36-e9bd3dc68ac9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:08.804416 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-c0d7665a-1515-4276-9c36-e9bd3dc68ac9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084071 May 24 15:38:08.804970 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 924/1831] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:38:08 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:38:09.018260 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-715f3417-37bc-44b5-9089-2191d9a9cad3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:09.018802 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-715f3417-37bc-44b5-9089-2191d9a9cad3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:09.021103 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_api:SELECT=52 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:38:09.026342 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-715f3417-37bc-44b5-9089-2191d9a9cad3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:09.026782 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-715f3417-37bc-44b5-9089-2191d9a9cad3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:09.027532 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-715f3417-37bc-44b5-9089-2191d9a9cad3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:09.027957 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-715f3417-37bc-44b5-9089-2191d9a9cad3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:09.155995 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-715f3417-37bc-44b5-9089-2191d9a9cad3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:09.164454 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-715f3417-37bc-44b5-9089-2191d9a9cad3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.150109 May 24 15:38:09.165023 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 908/1832] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:09 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:09.822740 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-fe734b7a-d981-420c-a8fe-2f64c97f01bb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:09.823341 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-fe734b7a-d981-420c-a8fe-2f64c97f01bb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:09.829775 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fe734b7a-d981-420c-a8fe-2f64c97f01bb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:09.830216 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fe734b7a-d981-420c-a8fe-2f64c97f01bb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:09.830964 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fe734b7a-d981-420c-a8fe-2f64c97f01bb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:09.831390 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fe734b7a-d981-420c-a8fe-2f64c97f01bb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:09.891160 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-fe734b7a-d981-420c-a8fe-2f64c97f01bb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:09.900224 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-fe734b7a-d981-420c-a8fe-2f64c97f01bb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:09.901787 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-fe734b7a-d981-420c-a8fe-2f64c97f01bb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:09.902904 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-fe734b7a-d981-420c-a8fe-2f64c97f01bb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084119 May 24 15:38:09.903452 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 925/1833] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:38:09 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:38:10.181954 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-afee20bb-9e1f-4f19-8172-b7aecfe6469b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:10.182569 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-afee20bb-9e1f-4f19-8172-b7aecfe6469b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:10.188709 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-afee20bb-9e1f-4f19-8172-b7aecfe6469b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:10.189163 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-afee20bb-9e1f-4f19-8172-b7aecfe6469b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:10.189928 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-afee20bb-9e1f-4f19-8172-b7aecfe6469b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:10.190372 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-afee20bb-9e1f-4f19-8172-b7aecfe6469b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:10.322524 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-afee20bb-9e1f-4f19-8172-b7aecfe6469b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:10.330687 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-afee20bb-9e1f-4f19-8172-b7aecfe6469b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.152763 May 24 15:38:10.331359 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 909/1834] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:10 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:38:10.407022 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d2e120c1-965d-4fdf-920d-535752f290b6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:10.407678 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d2e120c1-965d-4fdf-920d-535752f290b6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:10.409594 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_api:SELECT=56 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:38:10.414966 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d2e120c1-965d-4fdf-920d-535752f290b6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:10.415415 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d2e120c1-965d-4fdf-920d-535752f290b6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:10.416184 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d2e120c1-965d-4fdf-920d-535752f290b6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:10.416655 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d2e120c1-965d-4fdf-920d-535752f290b6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:10.442625 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-1269a173-0c44-4e1f-89b0-79876cc84ccd tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:10.443217 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-1269a173-0c44-4e1f-89b0-79876cc84ccd tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 2be15600-c3a4-43ed-bf7d-0960eaf59eb1] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:10.449465 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1269a173-0c44-4e1f-89b0-79876cc84ccd tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:10.449998 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1269a173-0c44-4e1f-89b0-79876cc84ccd tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:10.450475 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d2e120c1-965d-4fdf-920d-535752f290b6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Going to try to terminate instance {{(pid=117698) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 15:38:10.450938 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1269a173-0c44-4e1f-89b0-79876cc84ccd tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:10.451462 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1269a173-0c44-4e1f-89b0-79876cc84ccd tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:10.465937 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.wsgi [None req-1269a173-0c44-4e1f-89b0-79876cc84ccd tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] HTTP exception thrown: Instance 2be15600-c3a4-43ed-bf7d-0960eaf59eb1 could not be found. May 24 15:38:10.467704 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-1269a173-0c44-4e1f-89b0-79876cc84ccd tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Request method failure captured: May 24 15:38:10.467704 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: request: DELETE /compute/v2.1/servers/2be15600-c3a4-43ed-bf7d-0960eaf59eb1 HTTP/1.1 May 24 15:38:10.467704 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Accept: application/json May 24 15:38:10.467704 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Accept-Encoding: identity May 24 15:38:10.467704 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Connection: close May 24 15:38:10.467704 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Content-Length: 0 May 24 15:38:10.467704 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Content-Type: application/json May 24 15:38:10.467704 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Host: 10.222.0.45 May 24 15:38:10.467704 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Openstack-System-Scope: None May 24 15:38:10.467704 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: User-Agent: python-urllib3/1.26.9 May 24 15:38:10.467704 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Auth-Token: gAAAAABijPenpuB3nhOrbi-s3yxL7m-sBG8ZJZ51rBJ3imPzJ57HWeKwFeyebtAB5n2bRdpBGRV3d5i1o5IlYb6fCewd8gSuMgbjsTvWfWnQ_U8M7n-X8RXyXojhl7q-zYypOQ1v7H4itKL87AzjyCIaWDLZ-yW18KI11cscCi_s9fBvwKCcm3E May 24 15:38:10.467704 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Domain-Id: None May 24 15:38:10.467704 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Domain-Name: None May 24 15:38:10.467704 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Identity-Status: Confirmed May 24 15:38:10.467704 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Is-Admin-Project: True May 24 15:38:10.467704 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Domain-Id: default May 24 15:38:10.467704 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Domain-Name: Default May 24 15:38:10.467704 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Id: 0812b13a287c43259d7e09b0c658d4c8 May 24 15:38:10.467704 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Name: tempest-AttachVolumeTestJSON-590500594 May 24 15:38:10.467704 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Role: reader,member May 24 15:38:10.467704 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Roles: reader,member May 24 15:38:10.469226 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0812b13a287c43259d7e09b0c658d4c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0812b13a287c43259d7e09b0c658d4c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0812b13a287c43259d7e09b0c658d4c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0812b13a287c43259d7e09b0c658d4c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 24 15:38:10.469226 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant: tempest-AttachVolumeTestJSON-590500594 May 24 15:38:10.469226 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant-Id: 0812b13a287c43259d7e09b0c658d4c8 May 24 15:38:10.469226 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant-Name: tempest-AttachVolumeTestJSON-590500594 May 24 15:38:10.469226 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User: tempest-AttachVolumeTestJSON-590500594-project May 24 15:38:10.469226 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Domain-Id: default May 24 15:38:10.469226 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Domain-Name: Default May 24 15:38:10.469226 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Id: 2befe74ad06542b785d326101fc06d0b May 24 15:38:10.469226 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Name: tempest-AttachVolumeTestJSON-590500594-project May 24 15:38:10.469226 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: method: > May 24 15:38:10.469226 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: exception: Instance 2be15600-c3a4-43ed-bf7d-0960eaf59eb1 could not be found. May 24 15:38:10.469226 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: action_args: {'id': '2be15600-c3a4-43ed-bf7d-0960eaf59eb1'} May 24 15:38:10.470000 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:38:10.470000 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:38:10.470000 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:38:10.470000 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:38:10.470000 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:38:10.470000 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:38:10.470000 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:38:10.470000 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:38:10.470000 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:38:10.470000 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:38:10.470000 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2be15600-c3a4-43ed-bf7d-0960eaf59eb1 could not be found. May 24 15:38:10.470000 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:38:10.470000 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:38:10.470000 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:38:10.470000 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:38:10.470000 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:38:10.470000 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:38:10.470000 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:38:10.470000 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:38:10.470000 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:38:10.471295 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:38:10.471295 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 24 15:38:10.471295 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 24 15:38:10.471295 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 24 15:38:10.471295 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 24 15:38:10.471295 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:38:10.471295 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:38:10.471295 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:38:10.471295 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:38:10.471295 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2be15600-c3a4-43ed-bf7d-0960eaf59eb1 could not be found. May 24 15:38:10.471295 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:38:10.471295 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:38:10.471295 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:38:10.471295 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:38:10.471295 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:38:10.471295 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:38:10.471295 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:38:10.471295 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:38:10.471295 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2be15600-c3a4-43ed-bf7d-0960eaf59eb1 could not be found. May 24 15:38:10.471295 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:38:10.474083 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-1269a173-0c44-4e1f-89b0-79876cc84ccd tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Returning 404 to user: Instance 2be15600-c3a4-43ed-bf7d-0960eaf59eb1 could not be found. {{(pid=117699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:38:10.474083 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-1269a173-0c44-4e1f-89b0-79876cc84ccd tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "DELETE /compute/v2.1/servers/2be15600-c3a4-43ed-bf7d-0960eaf59eb1" status: 404 len: 111 microversion: 2.1 time: 0.030940 May 24 15:38:10.474083 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 910/1835] 10.222.0.45 () {58 vars in 1238 bytes} [Tue May 24 15:38:10 2022] DELETE /compute/v2.1/servers/2be15600-c3a4-43ed-bf7d-0960eaf59eb1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:38:10.489633 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-574f3a27-431a-4dd4-bf06-bc898d95b100 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:10.490522 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-574f3a27-431a-4dd4-bf06-bc898d95b100 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 2be15600-c3a4-43ed-bf7d-0960eaf59eb1] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:10.505391 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-574f3a27-431a-4dd4-bf06-bc898d95b100 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:10.505391 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-574f3a27-431a-4dd4-bf06-bc898d95b100 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:10.505391 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-574f3a27-431a-4dd4-bf06-bc898d95b100 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:10.505391 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-574f3a27-431a-4dd4-bf06-bc898d95b100 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:10.518704 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.wsgi [None req-574f3a27-431a-4dd4-bf06-bc898d95b100 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] HTTP exception thrown: Instance 2be15600-c3a4-43ed-bf7d-0960eaf59eb1 could not be found. May 24 15:38:10.520279 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-574f3a27-431a-4dd4-bf06-bc898d95b100 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Request method failure captured: May 24 15:38:10.520279 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: request: GET /compute/v2.1/servers/2be15600-c3a4-43ed-bf7d-0960eaf59eb1 HTTP/1.1 May 24 15:38:10.520279 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Accept: application/json May 24 15:38:10.520279 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Accept-Encoding: identity May 24 15:38:10.520279 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Connection: close May 24 15:38:10.520279 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Content-Length: 0 May 24 15:38:10.520279 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Content-Type: application/json May 24 15:38:10.520279 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Host: 10.222.0.45 May 24 15:38:10.520279 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Openstack-System-Scope: None May 24 15:38:10.520279 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: User-Agent: python-urllib3/1.26.9 May 24 15:38:10.520279 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Auth-Token: gAAAAABijPenpuB3nhOrbi-s3yxL7m-sBG8ZJZ51rBJ3imPzJ57HWeKwFeyebtAB5n2bRdpBGRV3d5i1o5IlYb6fCewd8gSuMgbjsTvWfWnQ_U8M7n-X8RXyXojhl7q-zYypOQ1v7H4itKL87AzjyCIaWDLZ-yW18KI11cscCi_s9fBvwKCcm3E May 24 15:38:10.520279 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Domain-Id: None May 24 15:38:10.520279 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Domain-Name: None May 24 15:38:10.520279 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Identity-Status: Confirmed May 24 15:38:10.520279 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Is-Admin-Project: True May 24 15:38:10.520279 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Domain-Id: default May 24 15:38:10.520279 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Domain-Name: Default May 24 15:38:10.520279 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Id: 0812b13a287c43259d7e09b0c658d4c8 May 24 15:38:10.520279 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Name: tempest-AttachVolumeTestJSON-590500594 May 24 15:38:10.520279 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Role: reader,member May 24 15:38:10.520279 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Roles: reader,member May 24 15:38:10.521760 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0812b13a287c43259d7e09b0c658d4c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0812b13a287c43259d7e09b0c658d4c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0812b13a287c43259d7e09b0c658d4c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0812b13a287c43259d7e09b0c658d4c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 24 15:38:10.521760 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant: tempest-AttachVolumeTestJSON-590500594 May 24 15:38:10.521760 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant-Id: 0812b13a287c43259d7e09b0c658d4c8 May 24 15:38:10.521760 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant-Name: tempest-AttachVolumeTestJSON-590500594 May 24 15:38:10.521760 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User: tempest-AttachVolumeTestJSON-590500594-project May 24 15:38:10.521760 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Domain-Id: default May 24 15:38:10.521760 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Domain-Name: Default May 24 15:38:10.521760 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Id: 2befe74ad06542b785d326101fc06d0b May 24 15:38:10.521760 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Name: tempest-AttachVolumeTestJSON-590500594-project May 24 15:38:10.521760 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: method: > May 24 15:38:10.521760 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: exception: Instance 2be15600-c3a4-43ed-bf7d-0960eaf59eb1 could not be found. May 24 15:38:10.521760 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: action_args: {'id': '2be15600-c3a4-43ed-bf7d-0960eaf59eb1'} May 24 15:38:10.522582 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:38:10.522582 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:38:10.522582 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:38:10.522582 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:38:10.522582 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:38:10.522582 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:38:10.522582 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:38:10.522582 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:38:10.522582 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:38:10.522582 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:38:10.522582 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2be15600-c3a4-43ed-bf7d-0960eaf59eb1 could not be found. May 24 15:38:10.522582 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:38:10.522582 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:38:10.522582 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:38:10.522582 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:38:10.522582 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:38:10.522582 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:38:10.522582 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:38:10.522582 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:38:10.522582 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:38:10.523829 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:38:10.523829 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 15:38:10.523829 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 15:38:10.523829 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:38:10.523829 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:38:10.523829 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:38:10.523829 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:38:10.523829 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2be15600-c3a4-43ed-bf7d-0960eaf59eb1 could not be found. May 24 15:38:10.523829 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:38:10.523829 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:38:10.523829 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:38:10.523829 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:38:10.523829 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:38:10.523829 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:38:10.523829 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:38:10.523829 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:38:10.523829 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2be15600-c3a4-43ed-bf7d-0960eaf59eb1 could not be found. May 24 15:38:10.523829 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:38:10.525043 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-574f3a27-431a-4dd4-bf06-bc898d95b100 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Returning 404 to user: Instance 2be15600-c3a4-43ed-bf7d-0960eaf59eb1 could not be found. {{(pid=117699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:38:10.525043 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-574f3a27-431a-4dd4-bf06-bc898d95b100 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/2be15600-c3a4-43ed-bf7d-0960eaf59eb1" status: 404 len: 111 microversion: 2.1 time: 0.047342 May 24 15:38:10.525043 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 911/1836] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:10 2022] GET /compute/v2.1/servers/2be15600-c3a4-43ed-bf7d-0960eaf59eb1 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:38:10.550655 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d2e120c1-965d-4fdf-920d-535752f290b6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 204 len: 0 microversion: 2.1 time: 0.147234 May 24 15:38:10.551264 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 926/1837] 10.222.0.45 () {58 vars in 1238 bytes} [Tue May 24 15:38:10 2022] DELETE /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 15:38:10.560285 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-0b843497-16d7-4c3d-9b2f-a91c2ae1a23a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:10.560914 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-0b843497-16d7-4c3d-9b2f-a91c2ae1a23a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:10.569377 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0b843497-16d7-4c3d-9b2f-a91c2ae1a23a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:10.569821 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0b843497-16d7-4c3d-9b2f-a91c2ae1a23a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:10.570596 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0b843497-16d7-4c3d-9b2f-a91c2ae1a23a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:10.571007 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0b843497-16d7-4c3d-9b2f-a91c2ae1a23a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:10.631170 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-4666c0b7-e141-4df9-8a74-103222d3546c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:10.631746 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-4666c0b7-e141-4df9-8a74-103222d3546c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:10.638623 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4666c0b7-e141-4df9-8a74-103222d3546c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:10.638623 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4666c0b7-e141-4df9-8a74-103222d3546c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:10.639068 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4666c0b7-e141-4df9-8a74-103222d3546c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:10.639641 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4666c0b7-e141-4df9-8a74-103222d3546c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:10.665227 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-4666c0b7-e141-4df9-8a74-103222d3546c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Going to try to terminate instance {{(pid=117698) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 15:38:10.700346 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-0b843497-16d7-4c3d-9b2f-a91c2ae1a23a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:10.708339 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-0b843497-16d7-4c3d-9b2f-a91c2ae1a23a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.152209 May 24 15:38:10.708917 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 912/1838] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:10 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:10.743467 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-4666c0b7-e141-4df9-8a74-103222d3546c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "DELETE /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 204 len: 0 microversion: 2.1 time: 0.116414 May 24 15:38:10.744046 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 927/1839] 10.222.0.45 () {58 vars in 1238 bytes} [Tue May 24 15:38:10 2022] DELETE /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 24 15:38:10.751988 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-ac7da38e-0dff-46f1-b26b-3ba3ea0ef959 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:10.752616 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-ac7da38e-0dff-46f1-b26b-3ba3ea0ef959 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:10.758582 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ac7da38e-0dff-46f1-b26b-3ba3ea0ef959 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:10.759028 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ac7da38e-0dff-46f1-b26b-3ba3ea0ef959 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:10.759785 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ac7da38e-0dff-46f1-b26b-3ba3ea0ef959 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:10.760319 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ac7da38e-0dff-46f1-b26b-3ba3ea0ef959 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:10.889721 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-ac7da38e-0dff-46f1-b26b-3ba3ea0ef959 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:10.898105 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-ac7da38e-0dff-46f1-b26b-3ba3ea0ef959 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.150123 May 24 15:38:10.898663 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 913/1840] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:10 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:10.921206 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-3e2e5dfe-bc07-4919-8a03-206e648b712a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:10.921904 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-3e2e5dfe-bc07-4919-8a03-206e648b712a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:10.927965 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3e2e5dfe-bc07-4919-8a03-206e648b712a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:10.928486 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3e2e5dfe-bc07-4919-8a03-206e648b712a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:10.929246 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3e2e5dfe-bc07-4919-8a03-206e648b712a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:10.929717 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3e2e5dfe-bc07-4919-8a03-206e648b712a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:10.996494 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-3e2e5dfe-bc07-4919-8a03-206e648b712a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:11.004955 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-3e2e5dfe-bc07-4919-8a03-206e648b712a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:11.006462 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-3e2e5dfe-bc07-4919-8a03-206e648b712a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:11.007638 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-3e2e5dfe-bc07-4919-8a03-206e648b712a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.090704 May 24 15:38:11.008185 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 928/1841] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:38:10 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:38:11.347776 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-748474b0-5654-4079-8b93-1c09700dd5d2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:11.348412 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-748474b0-5654-4079-8b93-1c09700dd5d2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:11.355105 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-748474b0-5654-4079-8b93-1c09700dd5d2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:11.355549 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-748474b0-5654-4079-8b93-1c09700dd5d2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:11.356325 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-748474b0-5654-4079-8b93-1c09700dd5d2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:11.356763 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-748474b0-5654-4079-8b93-1c09700dd5d2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:11.481556 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-748474b0-5654-4079-8b93-1c09700dd5d2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:11.489450 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-748474b0-5654-4079-8b93-1c09700dd5d2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.145519 May 24 15:38:11.490253 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 914/1842] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:11 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:11.725415 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-cd34eb70-63e4-4263-9041-b317ff0993b9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:11.726022 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-cd34eb70-63e4-4263-9041-b317ff0993b9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:11.732464 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cd34eb70-63e4-4263-9041-b317ff0993b9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:11.732848 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cd34eb70-63e4-4263-9041-b317ff0993b9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:11.733593 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cd34eb70-63e4-4263-9041-b317ff0993b9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:11.734018 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cd34eb70-63e4-4263-9041-b317ff0993b9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:11.738005 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:38:11.859103 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-cd34eb70-63e4-4263-9041-b317ff0993b9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:11.867638 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-cd34eb70-63e4-4263-9041-b317ff0993b9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.146024 May 24 15:38:11.868190 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 929/1843] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:11 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:11.914837 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-8c6ca89d-2333-475d-91f2-1bc6ccd605a9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:11.915485 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-8c6ca89d-2333-475d-91f2-1bc6ccd605a9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:11.921500 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8c6ca89d-2333-475d-91f2-1bc6ccd605a9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:11.921949 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8c6ca89d-2333-475d-91f2-1bc6ccd605a9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:11.922708 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8c6ca89d-2333-475d-91f2-1bc6ccd605a9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:11.923141 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8c6ca89d-2333-475d-91f2-1bc6ccd605a9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:12.024857 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-12a5f940-dc48-4d26-81ce-e47949c1b28f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:12.025458 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-12a5f940-dc48-4d26-81ce-e47949c1b28f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:12.031524 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-12a5f940-dc48-4d26-81ce-e47949c1b28f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:12.031962 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-12a5f940-dc48-4d26-81ce-e47949c1b28f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:12.032749 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-12a5f940-dc48-4d26-81ce-e47949c1b28f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:12.033177 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-12a5f940-dc48-4d26-81ce-e47949c1b28f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:12.047871 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-8c6ca89d-2333-475d-91f2-1bc6ccd605a9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:12.056516 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-8c6ca89d-2333-475d-91f2-1bc6ccd605a9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.145402 May 24 15:38:12.057107 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 915/1844] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:11 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:12.094520 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-12a5f940-dc48-4d26-81ce-e47949c1b28f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:12.103957 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-12a5f940-dc48-4d26-81ce-e47949c1b28f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:12.105534 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-12a5f940-dc48-4d26-81ce-e47949c1b28f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:12.106681 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-12a5f940-dc48-4d26-81ce-e47949c1b28f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.085670 May 24 15:38:12.107242 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 930/1845] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:38:12 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:38:12.506383 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e173b749-c8b1-486a-8dbc-645b3e951ee3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:12.507078 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-e173b749-c8b1-486a-8dbc-645b3e951ee3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:12.514129 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e173b749-c8b1-486a-8dbc-645b3e951ee3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:12.514575 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e173b749-c8b1-486a-8dbc-645b3e951ee3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:12.515330 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e173b749-c8b1-486a-8dbc-645b3e951ee3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:12.515764 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e173b749-c8b1-486a-8dbc-645b3e951ee3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:12.857989 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-e173b749-c8b1-486a-8dbc-645b3e951ee3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:12.866156 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-e173b749-c8b1-486a-8dbc-645b3e951ee3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.364039 May 24 15:38:12.866730 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 916/1846] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:12 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:12.884725 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-3469effb-41cb-4a00-b70b-86e214c2a0df tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:12.885336 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-3469effb-41cb-4a00-b70b-86e214c2a0df tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:12.891812 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3469effb-41cb-4a00-b70b-86e214c2a0df tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:12.892257 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3469effb-41cb-4a00-b70b-86e214c2a0df tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:12.893046 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3469effb-41cb-4a00-b70b-86e214c2a0df tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:12.893479 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3469effb-41cb-4a00-b70b-86e214c2a0df tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:13.020916 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-3469effb-41cb-4a00-b70b-86e214c2a0df tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:13.028791 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-3469effb-41cb-4a00-b70b-86e214c2a0df tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.147805 May 24 15:38:13.029358 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 931/1847] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:12 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:13.073797 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a8643a0b-c7bf-4ed9-89f1-070c9be03f68 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:13.074412 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a8643a0b-c7bf-4ed9-89f1-070c9be03f68 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:13.080453 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a8643a0b-c7bf-4ed9-89f1-070c9be03f68 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:13.080904 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a8643a0b-c7bf-4ed9-89f1-070c9be03f68 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:13.081665 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a8643a0b-c7bf-4ed9-89f1-070c9be03f68 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:13.082096 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a8643a0b-c7bf-4ed9-89f1-070c9be03f68 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:13.125674 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-4fbd376e-435d-41bc-a358-efef5e4484cb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:13.126390 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-4fbd376e-435d-41bc-a358-efef5e4484cb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:13.133036 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4fbd376e-435d-41bc-a358-efef5e4484cb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:13.133479 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4fbd376e-435d-41bc-a358-efef5e4484cb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:13.134237 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4fbd376e-435d-41bc-a358-efef5e4484cb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:13.134663 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4fbd376e-435d-41bc-a358-efef5e4484cb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:13.195695 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-4fbd376e-435d-41bc-a358-efef5e4484cb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:13.203975 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-4fbd376e-435d-41bc-a358-efef5e4484cb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:13.205528 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-4fbd376e-435d-41bc-a358-efef5e4484cb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:13.206653 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-4fbd376e-435d-41bc-a358-efef5e4484cb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084866 May 24 15:38:13.207212 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 932/1848] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:38:13 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:38:13.209775 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-a8643a0b-c7bf-4ed9-89f1-070c9be03f68 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:13.217944 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a8643a0b-c7bf-4ed9-89f1-070c9be03f68 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.147971 May 24 15:38:13.218501 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 917/1849] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:13 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:13.883564 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-0a829489-38c0-4462-9100-0ef76bdf85dd tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:13.884216 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-0a829489-38c0-4462-9100-0ef76bdf85dd tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:13.890768 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0a829489-38c0-4462-9100-0ef76bdf85dd tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:13.891237 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0a829489-38c0-4462-9100-0ef76bdf85dd tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:13.891988 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0a829489-38c0-4462-9100-0ef76bdf85dd tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:13.892506 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0a829489-38c0-4462-9100-0ef76bdf85dd tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:14.019141 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-0a829489-38c0-4462-9100-0ef76bdf85dd tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:14.027610 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-0a829489-38c0-4462-9100-0ef76bdf85dd tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.148566 May 24 15:38:14.028171 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 933/1850] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:13 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:14.046282 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a9dfd5dc-8e8e-449e-bf9a-e0deec7edd12 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:14.046886 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a9dfd5dc-8e8e-449e-bf9a-e0deec7edd12 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:14.053808 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a9dfd5dc-8e8e-449e-bf9a-e0deec7edd12 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:14.054250 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a9dfd5dc-8e8e-449e-bf9a-e0deec7edd12 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:14.055008 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a9dfd5dc-8e8e-449e-bf9a-e0deec7edd12 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:14.055436 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a9dfd5dc-8e8e-449e-bf9a-e0deec7edd12 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:14.187317 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-a9dfd5dc-8e8e-449e-bf9a-e0deec7edd12 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:14.195252 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a9dfd5dc-8e8e-449e-bf9a-e0deec7edd12 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.153483 May 24 15:38:14.195826 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 918/1851] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:14 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:14.224875 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-2f4366e3-19e0-472f-b53a-f6d7ad91e1cf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:14.225479 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-2f4366e3-19e0-472f-b53a-f6d7ad91e1cf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:14.231599 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2f4366e3-19e0-472f-b53a-f6d7ad91e1cf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:14.232045 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2f4366e3-19e0-472f-b53a-f6d7ad91e1cf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:14.232832 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2f4366e3-19e0-472f-b53a-f6d7ad91e1cf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:14.233262 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2f4366e3-19e0-472f-b53a-f6d7ad91e1cf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:14.234252 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-8da0e63a-0ef5-4348-8108-8bab373c813b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:14.234868 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-8da0e63a-0ef5-4348-8108-8bab373c813b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:14.241143 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8da0e63a-0ef5-4348-8108-8bab373c813b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:14.241596 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8da0e63a-0ef5-4348-8108-8bab373c813b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:14.242355 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8da0e63a-0ef5-4348-8108-8bab373c813b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:14.242790 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8da0e63a-0ef5-4348-8108-8bab373c813b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:14.304935 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-2f4366e3-19e0-472f-b53a-f6d7ad91e1cf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:14.313916 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-2f4366e3-19e0-472f-b53a-f6d7ad91e1cf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:14.315833 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-2f4366e3-19e0-472f-b53a-f6d7ad91e1cf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:14.317972 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-2f4366e3-19e0-472f-b53a-f6d7ad91e1cf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.097691 May 24 15:38:14.318857 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 934/1852] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:38:14 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:38:14.374124 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-8da0e63a-0ef5-4348-8108-8bab373c813b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:14.382669 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-8da0e63a-0ef5-4348-8108-8bab373c813b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.152112 May 24 15:38:14.383552 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 919/1853] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:14 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:38:15.044387 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d681843c-0dc9-4697-bc8b-c34713153a07 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:15.045087 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d681843c-0dc9-4697-bc8b-c34713153a07 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:15.052541 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d681843c-0dc9-4697-bc8b-c34713153a07 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:15.052986 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d681843c-0dc9-4697-bc8b-c34713153a07 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:15.053747 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d681843c-0dc9-4697-bc8b-c34713153a07 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:15.054174 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d681843c-0dc9-4697-bc8b-c34713153a07 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:15.182164 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-d681843c-0dc9-4697-bc8b-c34713153a07 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:15.189982 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d681843c-0dc9-4697-bc8b-c34713153a07 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.149579 May 24 15:38:15.190537 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 935/1854] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:15 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:15.212129 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-303e92ad-7ab4-4be3-9709-cc6c4f8b554a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:15.212774 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-303e92ad-7ab4-4be3-9709-cc6c4f8b554a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:15.219245 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-303e92ad-7ab4-4be3-9709-cc6c4f8b554a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:15.219705 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-303e92ad-7ab4-4be3-9709-cc6c4f8b554a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:15.220500 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-303e92ad-7ab4-4be3-9709-cc6c4f8b554a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:15.220935 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-303e92ad-7ab4-4be3-9709-cc6c4f8b554a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:15.335607 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e2d48d09-f3d1-4d84-be23-68c292861763 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:15.336218 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e2d48d09-f3d1-4d84-be23-68c292861763 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:15.342227 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e2d48d09-f3d1-4d84-be23-68c292861763 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:15.342672 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e2d48d09-f3d1-4d84-be23-68c292861763 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:15.343432 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e2d48d09-f3d1-4d84-be23-68c292861763 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:15.343864 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e2d48d09-f3d1-4d84-be23-68c292861763 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:15.347904 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-303e92ad-7ab4-4be3-9709-cc6c4f8b554a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:15.356493 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-303e92ad-7ab4-4be3-9709-cc6c4f8b554a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.148121 May 24 15:38:15.357071 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 920/1855] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:15 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:15.399352 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-84d2a616-b263-4031-8c54-59da28efa8ae tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:15.400005 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-84d2a616-b263-4031-8c54-59da28efa8ae tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:15.406056 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-84d2a616-b263-4031-8c54-59da28efa8ae tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:15.406510 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-84d2a616-b263-4031-8c54-59da28efa8ae tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:15.407281 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-84d2a616-b263-4031-8c54-59da28efa8ae tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:15.407715 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-84d2a616-b263-4031-8c54-59da28efa8ae tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:15.412759 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:38:15.415642 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e2d48d09-f3d1-4d84-be23-68c292861763 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:15.424129 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e2d48d09-f3d1-4d84-be23-68c292861763 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:15.425668 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e2d48d09-f3d1-4d84-be23-68c292861763 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:15.426853 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e2d48d09-f3d1-4d84-be23-68c292861763 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.095120 May 24 15:38:15.427424 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 936/1856] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:38:15 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:38:15.546282 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-84d2a616-b263-4031-8c54-59da28efa8ae tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:15.554842 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-84d2a616-b263-4031-8c54-59da28efa8ae tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.159795 May 24 15:38:15.555410 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 921/1857] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:15 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:38:16.207003 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e9c63388-411d-4aec-bb7c-4c55efaa6b4a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:16.207528 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e9c63388-411d-4aec-bb7c-4c55efaa6b4a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:16.214114 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e9c63388-411d-4aec-bb7c-4c55efaa6b4a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:16.214558 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e9c63388-411d-4aec-bb7c-4c55efaa6b4a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:16.215311 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e9c63388-411d-4aec-bb7c-4c55efaa6b4a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:16.215743 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e9c63388-411d-4aec-bb7c-4c55efaa6b4a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:16.341776 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e9c63388-411d-4aec-bb7c-4c55efaa6b4a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:16.349935 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e9c63388-411d-4aec-bb7c-4c55efaa6b4a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.146867 May 24 15:38:16.350496 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 937/1858] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:16 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:16.374098 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-c591b1bf-4cdc-4c11-a1e0-04f560172306 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:16.374705 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-c591b1bf-4cdc-4c11-a1e0-04f560172306 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:16.381739 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c591b1bf-4cdc-4c11-a1e0-04f560172306 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:16.382180 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c591b1bf-4cdc-4c11-a1e0-04f560172306 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:16.382926 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c591b1bf-4cdc-4c11-a1e0-04f560172306 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:16.383352 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c591b1bf-4cdc-4c11-a1e0-04f560172306 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:16.444871 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-93fbbf61-cf3a-462f-ad25-eb8094e793b8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:16.445763 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-93fbbf61-cf3a-462f-ad25-eb8094e793b8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:16.451553 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-93fbbf61-cf3a-462f-ad25-eb8094e793b8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:16.452035 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-93fbbf61-cf3a-462f-ad25-eb8094e793b8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:16.452841 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-93fbbf61-cf3a-462f-ad25-eb8094e793b8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:16.453278 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-93fbbf61-cf3a-462f-ad25-eb8094e793b8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:16.511701 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-c591b1bf-4cdc-4c11-a1e0-04f560172306 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:16.514674 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-93fbbf61-cf3a-462f-ad25-eb8094e793b8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:16.521330 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-c591b1bf-4cdc-4c11-a1e0-04f560172306 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.149990 May 24 15:38:16.522002 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 922/1859] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:16 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:16.523872 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-93fbbf61-cf3a-462f-ad25-eb8094e793b8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:16.525394 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-93fbbf61-cf3a-462f-ad25-eb8094e793b8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:16.526535 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-93fbbf61-cf3a-462f-ad25-eb8094e793b8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.085552 May 24 15:38:16.527079 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 938/1860] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:38:16 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:38:16.570980 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-908dce48-f322-4cf5-b1d0-591490eaae61 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:16.571587 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-908dce48-f322-4cf5-b1d0-591490eaae61 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:16.577570 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-908dce48-f322-4cf5-b1d0-591490eaae61 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:16.578020 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-908dce48-f322-4cf5-b1d0-591490eaae61 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:16.578786 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-908dce48-f322-4cf5-b1d0-591490eaae61 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:16.579231 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-908dce48-f322-4cf5-b1d0-591490eaae61 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:16.710750 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-908dce48-f322-4cf5-b1d0-591490eaae61 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:16.718619 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-908dce48-f322-4cf5-b1d0-591490eaae61 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.151815 May 24 15:38:16.719186 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 923/1861] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:16 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:17.367768 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-40786224-c918-4e27-9ec8-a00efa1abee0 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:17.368311 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-40786224-c918-4e27-9ec8-a00efa1abee0 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:17.374948 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-40786224-c918-4e27-9ec8-a00efa1abee0 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:17.375394 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-40786224-c918-4e27-9ec8-a00efa1abee0 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:17.376151 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-40786224-c918-4e27-9ec8-a00efa1abee0 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:17.376615 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-40786224-c918-4e27-9ec8-a00efa1abee0 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:17.502616 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-40786224-c918-4e27-9ec8-a00efa1abee0 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:17.510518 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-40786224-c918-4e27-9ec8-a00efa1abee0 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.147504 May 24 15:38:17.511073 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 939/1862] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:17 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:17.538546 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-7b154e92-e68d-41dd-8a40-50d3b0952612 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:17.539171 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-7b154e92-e68d-41dd-8a40-50d3b0952612 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:17.543868 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c44bce94-4427-4ef6-8ed1-312be038b131 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:17.544513 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-c44bce94-4427-4ef6-8ed1-312be038b131 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:17.545800 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7b154e92-e68d-41dd-8a40-50d3b0952612 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:17.546252 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7b154e92-e68d-41dd-8a40-50d3b0952612 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:17.547057 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7b154e92-e68d-41dd-8a40-50d3b0952612 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:17.547494 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7b154e92-e68d-41dd-8a40-50d3b0952612 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:17.550511 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c44bce94-4427-4ef6-8ed1-312be038b131 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:17.551021 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c44bce94-4427-4ef6-8ed1-312be038b131 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:17.552382 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c44bce94-4427-4ef6-8ed1-312be038b131 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:17.552813 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c44bce94-4427-4ef6-8ed1-312be038b131 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:17.616510 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-c44bce94-4427-4ef6-8ed1-312be038b131 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:17.625015 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-c44bce94-4427-4ef6-8ed1-312be038b131 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:17.627214 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-c44bce94-4427-4ef6-8ed1-312be038b131 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:17.628405 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-c44bce94-4427-4ef6-8ed1-312be038b131 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.088225 May 24 15:38:17.628965 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 940/1863] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:38:17 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:38:17.674671 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-7b154e92-e68d-41dd-8a40-50d3b0952612 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:17.682618 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-7b154e92-e68d-41dd-8a40-50d3b0952612 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.148386 May 24 15:38:17.683183 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 924/1864] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:17 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:17.735223 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-bbcd3900-68df-4b64-843e-3d1673452690 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:17.735855 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-bbcd3900-68df-4b64-843e-3d1673452690 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:17.742183 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bbcd3900-68df-4b64-843e-3d1673452690 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:17.742634 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bbcd3900-68df-4b64-843e-3d1673452690 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:17.743395 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bbcd3900-68df-4b64-843e-3d1673452690 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:17.743831 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bbcd3900-68df-4b64-843e-3d1673452690 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:17.869261 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-bbcd3900-68df-4b64-843e-3d1673452690 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:17.877252 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-bbcd3900-68df-4b64-843e-3d1673452690 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.145740 May 24 15:38:17.877755 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 941/1865] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:17 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:18.527159 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-78d3d2e9-e429-4506-923a-b527c2ab4a1d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:18.527770 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-78d3d2e9-e429-4506-923a-b527c2ab4a1d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:18.533878 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-78d3d2e9-e429-4506-923a-b527c2ab4a1d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:18.534324 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-78d3d2e9-e429-4506-923a-b527c2ab4a1d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:18.535080 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-78d3d2e9-e429-4506-923a-b527c2ab4a1d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:18.535516 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-78d3d2e9-e429-4506-923a-b527c2ab4a1d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:18.646561 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-b3881f48-ac6d-4a0e-ad00-606a88ed130c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:18.647081 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-b3881f48-ac6d-4a0e-ad00-606a88ed130c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:18.653526 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b3881f48-ac6d-4a0e-ad00-606a88ed130c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:18.653971 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b3881f48-ac6d-4a0e-ad00-606a88ed130c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:18.654730 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b3881f48-ac6d-4a0e-ad00-606a88ed130c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:18.655161 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b3881f48-ac6d-4a0e-ad00-606a88ed130c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:18.665048 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-78d3d2e9-e429-4506-923a-b527c2ab4a1d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:18.673306 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-78d3d2e9-e429-4506-923a-b527c2ab4a1d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.149992 May 24 15:38:18.673974 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 925/1866] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:18 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:18.698799 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e3dc26a3-0489-48ea-8d0e-cd11526a8212 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:18.699408 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-e3dc26a3-0489-48ea-8d0e-cd11526a8212 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:18.705608 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e3dc26a3-0489-48ea-8d0e-cd11526a8212 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:18.706052 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e3dc26a3-0489-48ea-8d0e-cd11526a8212 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:18.706814 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e3dc26a3-0489-48ea-8d0e-cd11526a8212 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:18.707248 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e3dc26a3-0489-48ea-8d0e-cd11526a8212 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:18.717476 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-b3881f48-ac6d-4a0e-ad00-606a88ed130c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:18.726832 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-b3881f48-ac6d-4a0e-ad00-606a88ed130c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:18.728436 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-b3881f48-ac6d-4a0e-ad00-606a88ed130c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:18.729622 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-b3881f48-ac6d-4a0e-ad00-606a88ed130c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.087091 May 24 15:38:18.730180 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 942/1867] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:38:18 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:38:18.833360 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-e3dc26a3-0489-48ea-8d0e-cd11526a8212 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:18.841222 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-e3dc26a3-0489-48ea-8d0e-cd11526a8212 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.146168 May 24 15:38:18.841787 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 926/1868] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:18 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:38:18.894022 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-44ac1cab-f293-4c28-a9c2-b8edc41ee7c8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:18.894638 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-44ac1cab-f293-4c28-a9c2-b8edc41ee7c8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:18.900779 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-44ac1cab-f293-4c28-a9c2-b8edc41ee7c8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:18.901176 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-44ac1cab-f293-4c28-a9c2-b8edc41ee7c8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:18.901940 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-44ac1cab-f293-4c28-a9c2-b8edc41ee7c8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:18.902379 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-44ac1cab-f293-4c28-a9c2-b8edc41ee7c8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:19.029938 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-44ac1cab-f293-4c28-a9c2-b8edc41ee7c8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:19.038357 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-44ac1cab-f293-4c28-a9c2-b8edc41ee7c8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.148212 May 24 15:38:19.038931 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 943/1869] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:18 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:19.691037 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-cad2e877-753c-4754-b1ae-9933927ef455 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:19.691642 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-cad2e877-753c-4754-b1ae-9933927ef455 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:19.698625 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cad2e877-753c-4754-b1ae-9933927ef455 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:19.699073 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cad2e877-753c-4754-b1ae-9933927ef455 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:19.699829 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cad2e877-753c-4754-b1ae-9933927ef455 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:19.700263 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cad2e877-753c-4754-b1ae-9933927ef455 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:19.748315 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-81a1b540-2aa7-4411-87f5-1f5b57a118f2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:19.748905 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-81a1b540-2aa7-4411-87f5-1f5b57a118f2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:19.755810 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-81a1b540-2aa7-4411-87f5-1f5b57a118f2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:19.756247 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-81a1b540-2aa7-4411-87f5-1f5b57a118f2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:19.757019 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-81a1b540-2aa7-4411-87f5-1f5b57a118f2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:19.757453 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-81a1b540-2aa7-4411-87f5-1f5b57a118f2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:19.819444 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-81a1b540-2aa7-4411-87f5-1f5b57a118f2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:19.827948 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-81a1b540-2aa7-4411-87f5-1f5b57a118f2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:19.828385 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-cad2e877-753c-4754-b1ae-9933927ef455 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:19.829461 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-81a1b540-2aa7-4411-87f5-1f5b57a118f2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:19.830590 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-81a1b540-2aa7-4411-87f5-1f5b57a118f2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.086212 May 24 15:38:19.831138 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 944/1870] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:38:19 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:38:19.837838 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-cad2e877-753c-4754-b1ae-9933927ef455 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.150673 May 24 15:38:19.838401 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 927/1871] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:19 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:19.857401 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-13bd13b5-cb22-42ef-bad2-945a21a0e64c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:19.858006 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-13bd13b5-cb22-42ef-bad2-945a21a0e64c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:19.864564 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-13bd13b5-cb22-42ef-bad2-945a21a0e64c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:19.865007 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-13bd13b5-cb22-42ef-bad2-945a21a0e64c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:19.866020 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-13bd13b5-cb22-42ef-bad2-945a21a0e64c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:19.866444 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-13bd13b5-cb22-42ef-bad2-945a21a0e64c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:19.996858 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-13bd13b5-cb22-42ef-bad2-945a21a0e64c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:20.000208 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:38:20.006093 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-13bd13b5-cb22-42ef-bad2-945a21a0e64c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.152462 May 24 15:38:20.006651 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 945/1872] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:19 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:20.055760 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-1b02d6cd-e986-4546-b029-3570bba9c3c0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:20.056404 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-1b02d6cd-e986-4546-b029-3570bba9c3c0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:20.062322 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1b02d6cd-e986-4546-b029-3570bba9c3c0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:20.062757 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1b02d6cd-e986-4546-b029-3570bba9c3c0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:20.063504 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1b02d6cd-e986-4546-b029-3570bba9c3c0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:20.063929 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1b02d6cd-e986-4546-b029-3570bba9c3c0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:20.194453 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-1b02d6cd-e986-4546-b029-3570bba9c3c0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:20.202380 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-1b02d6cd-e986-4546-b029-3570bba9c3c0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.151189 May 24 15:38:20.202939 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 928/1873] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:20 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:20.849805 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-09a1605e-f607-4b98-a3c7-1d94d237e56b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:20.850330 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-09a1605e-f607-4b98-a3c7-1d94d237e56b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:20.855112 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a2683ccb-73ac-4ea6-8458-c1361c2202b3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:20.855750 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a2683ccb-73ac-4ea6-8458-c1361c2202b3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:20.856997 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-09a1605e-f607-4b98-a3c7-1d94d237e56b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:20.857445 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-09a1605e-f607-4b98-a3c7-1d94d237e56b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:20.858204 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-09a1605e-f607-4b98-a3c7-1d94d237e56b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:20.858636 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-09a1605e-f607-4b98-a3c7-1d94d237e56b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:20.862187 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a2683ccb-73ac-4ea6-8458-c1361c2202b3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:20.862625 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a2683ccb-73ac-4ea6-8458-c1361c2202b3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:20.863378 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a2683ccb-73ac-4ea6-8458-c1361c2202b3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:20.863872 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a2683ccb-73ac-4ea6-8458-c1361c2202b3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:20.923118 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-09a1605e-f607-4b98-a3c7-1d94d237e56b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:20.931505 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-09a1605e-f607-4b98-a3c7-1d94d237e56b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:20.933063 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-09a1605e-f607-4b98-a3c7-1d94d237e56b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:20.934203 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-09a1605e-f607-4b98-a3c7-1d94d237e56b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.089254 May 24 15:38:20.934760 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 946/1874] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:38:20 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:38:20.994136 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-a2683ccb-73ac-4ea6-8458-c1361c2202b3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:21.002236 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a2683ccb-73ac-4ea6-8458-c1361c2202b3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.150974 May 24 15:38:21.002845 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 929/1875] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:20 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:38:21.023531 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-8bbcff91-c243-418f-8239-33ef843d250a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:21.024142 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-8bbcff91-c243-418f-8239-33ef843d250a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:21.030516 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8bbcff91-c243-418f-8239-33ef843d250a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:21.030967 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8bbcff91-c243-418f-8239-33ef843d250a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:21.031727 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8bbcff91-c243-418f-8239-33ef843d250a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:21.032161 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8bbcff91-c243-418f-8239-33ef843d250a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:21.160475 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-8bbcff91-c243-418f-8239-33ef843d250a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:21.168618 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-8bbcff91-c243-418f-8239-33ef843d250a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.149434 May 24 15:38:21.169188 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 947/1876] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:21 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:21.220331 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-db8eab03-d1c6-4e3b-8260-8c9f491522dc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:21.220971 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-db8eab03-d1c6-4e3b-8260-8c9f491522dc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:21.227097 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-db8eab03-d1c6-4e3b-8260-8c9f491522dc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:21.227544 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-db8eab03-d1c6-4e3b-8260-8c9f491522dc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:21.228323 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-db8eab03-d1c6-4e3b-8260-8c9f491522dc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:21.228760 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-db8eab03-d1c6-4e3b-8260-8c9f491522dc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:21.356904 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-db8eab03-d1c6-4e3b-8260-8c9f491522dc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:21.365625 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-db8eab03-d1c6-4e3b-8260-8c9f491522dc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.148891 May 24 15:38:21.366133 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 930/1877] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:21 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:21.952048 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-7ecf533f-408b-40e6-9fd8-fb6345dd16aa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:21.952688 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-7ecf533f-408b-40e6-9fd8-fb6345dd16aa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:21.959310 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7ecf533f-408b-40e6-9fd8-fb6345dd16aa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:21.959757 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7ecf533f-408b-40e6-9fd8-fb6345dd16aa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:21.960573 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7ecf533f-408b-40e6-9fd8-fb6345dd16aa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:21.961010 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7ecf533f-408b-40e6-9fd8-fb6345dd16aa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:22.020367 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-3ebcb0b4-4a43-40c6-bde5-16471cbd4e2c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:22.020976 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-3ebcb0b4-4a43-40c6-bde5-16471cbd4e2c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:22.021381 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-7ecf533f-408b-40e6-9fd8-fb6345dd16aa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:22.027292 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3ebcb0b4-4a43-40c6-bde5-16471cbd4e2c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:22.027732 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3ebcb0b4-4a43-40c6-bde5-16471cbd4e2c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:22.028526 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3ebcb0b4-4a43-40c6-bde5-16471cbd4e2c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:22.028952 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3ebcb0b4-4a43-40c6-bde5-16471cbd4e2c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:22.029790 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-7ecf533f-408b-40e6-9fd8-fb6345dd16aa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:22.031298 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-7ecf533f-408b-40e6-9fd8-fb6345dd16aa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:22.032465 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-7ecf533f-408b-40e6-9fd8-fb6345dd16aa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084282 May 24 15:38:22.033021 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 948/1878] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:38:21 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:38:22.155731 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-3ebcb0b4-4a43-40c6-bde5-16471cbd4e2c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:22.164371 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-3ebcb0b4-4a43-40c6-bde5-16471cbd4e2c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.147761 May 24 15:38:22.164946 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 931/1879] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:22 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:22.185298 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-044616f0-ac8e-4994-92e8-7c6c307b3c27 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:22.185913 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-044616f0-ac8e-4994-92e8-7c6c307b3c27 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:22.191911 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-044616f0-ac8e-4994-92e8-7c6c307b3c27 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:22.192401 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-044616f0-ac8e-4994-92e8-7c6c307b3c27 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:22.193163 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-044616f0-ac8e-4994-92e8-7c6c307b3c27 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:22.193600 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-044616f0-ac8e-4994-92e8-7c6c307b3c27 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:22.320208 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-044616f0-ac8e-4994-92e8-7c6c307b3c27 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:22.328324 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-044616f0-ac8e-4994-92e8-7c6c307b3c27 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.146832 May 24 15:38:22.328902 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 949/1880] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:22 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:22.382378 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-4c754cc2-5bc9-4617-af1b-0886e398b538 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:22.382980 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-4c754cc2-5bc9-4617-af1b-0886e398b538 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:22.388938 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4c754cc2-5bc9-4617-af1b-0886e398b538 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:22.389378 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4c754cc2-5bc9-4617-af1b-0886e398b538 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:22.390127 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4c754cc2-5bc9-4617-af1b-0886e398b538 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:22.390559 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4c754cc2-5bc9-4617-af1b-0886e398b538 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:22.522983 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-4c754cc2-5bc9-4617-af1b-0886e398b538 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:22.530947 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-4c754cc2-5bc9-4617-af1b-0886e398b538 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.152431 May 24 15:38:22.531519 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 932/1881] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:22 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:23.050933 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-3eab6065-9f02-4b65-b653-5c9f3c3a35f4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:23.052099 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-3eab6065-9f02-4b65-b653-5c9f3c3a35f4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:23.058629 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3eab6065-9f02-4b65-b653-5c9f3c3a35f4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:23.059076 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3eab6065-9f02-4b65-b653-5c9f3c3a35f4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:23.059832 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3eab6065-9f02-4b65-b653-5c9f3c3a35f4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:23.060268 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3eab6065-9f02-4b65-b653-5c9f3c3a35f4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:23.120744 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-3eab6065-9f02-4b65-b653-5c9f3c3a35f4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:23.129019 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-3eab6065-9f02-4b65-b653-5c9f3c3a35f4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:23.131112 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-3eab6065-9f02-4b65-b653-5c9f3c3a35f4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:23.132243 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-3eab6065-9f02-4b65-b653-5c9f3c3a35f4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.085245 May 24 15:38:23.132828 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 950/1882] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:38:23 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:38:23.181266 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-527c0ed7-8ff4-4cbb-a264-c1d581d4b5d1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:23.181808 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-527c0ed7-8ff4-4cbb-a264-c1d581d4b5d1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:23.188225 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-527c0ed7-8ff4-4cbb-a264-c1d581d4b5d1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:23.188703 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-527c0ed7-8ff4-4cbb-a264-c1d581d4b5d1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:23.189452 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-527c0ed7-8ff4-4cbb-a264-c1d581d4b5d1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:23.189883 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-527c0ed7-8ff4-4cbb-a264-c1d581d4b5d1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:23.315695 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-527c0ed7-8ff4-4cbb-a264-c1d581d4b5d1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:23.323654 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-527c0ed7-8ff4-4cbb-a264-c1d581d4b5d1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.146188 May 24 15:38:23.324222 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 933/1883] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:23 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:23.344692 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-603d0271-5f21-4466-ab54-f8786887f7b4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:23.345293 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-603d0271-5f21-4466-ab54-f8786887f7b4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:23.351725 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-603d0271-5f21-4466-ab54-f8786887f7b4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:23.352166 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-603d0271-5f21-4466-ab54-f8786887f7b4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:23.352947 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-603d0271-5f21-4466-ab54-f8786887f7b4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:23.353376 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-603d0271-5f21-4466-ab54-f8786887f7b4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:23.482992 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-603d0271-5f21-4466-ab54-f8786887f7b4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:23.491680 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-603d0271-5f21-4466-ab54-f8786887f7b4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.150765 May 24 15:38:23.492242 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 951/1884] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:23 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:23.547644 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f797e113-f6f0-4aa1-84d7-ae5b0612acf9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:23.548245 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f797e113-f6f0-4aa1-84d7-ae5b0612acf9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:23.554880 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f797e113-f6f0-4aa1-84d7-ae5b0612acf9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:23.555316 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f797e113-f6f0-4aa1-84d7-ae5b0612acf9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:23.556067 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f797e113-f6f0-4aa1-84d7-ae5b0612acf9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:23.556545 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f797e113-f6f0-4aa1-84d7-ae5b0612acf9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:23.682356 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-f797e113-f6f0-4aa1-84d7-ae5b0612acf9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:23.690262 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f797e113-f6f0-4aa1-84d7-ae5b0612acf9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.146308 May 24 15:38:23.690764 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 934/1885] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:23 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:24.153593 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-b7df3dc3-266d-4dc7-85e1-35816848ec5d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:24.154200 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-b7df3dc3-266d-4dc7-85e1-35816848ec5d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:24.160753 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b7df3dc3-266d-4dc7-85e1-35816848ec5d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:24.161195 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b7df3dc3-266d-4dc7-85e1-35816848ec5d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:24.161949 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b7df3dc3-266d-4dc7-85e1-35816848ec5d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:24.162375 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b7df3dc3-266d-4dc7-85e1-35816848ec5d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:24.228549 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-b7df3dc3-266d-4dc7-85e1-35816848ec5d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:24.236856 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-b7df3dc3-266d-4dc7-85e1-35816848ec5d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:24.238335 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-b7df3dc3-266d-4dc7-85e1-35816848ec5d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:24.239471 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-b7df3dc3-266d-4dc7-85e1-35816848ec5d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.089806 May 24 15:38:24.240026 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 952/1886] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:38:24 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:38:24.340076 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-99ae587b-affe-4358-92e4-aef37501a38f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:24.340637 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-99ae587b-affe-4358-92e4-aef37501a38f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:24.347155 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-99ae587b-affe-4358-92e4-aef37501a38f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:24.347601 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-99ae587b-affe-4358-92e4-aef37501a38f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:24.348397 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-99ae587b-affe-4358-92e4-aef37501a38f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:24.348843 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-99ae587b-affe-4358-92e4-aef37501a38f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:24.477139 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-99ae587b-affe-4358-92e4-aef37501a38f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:24.485184 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-99ae587b-affe-4358-92e4-aef37501a38f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.149031 May 24 15:38:24.485752 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 935/1887] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:24 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:24.510127 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-7566aa5f-28dc-426b-912d-ef2f33371df4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:24.510768 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-7566aa5f-28dc-426b-912d-ef2f33371df4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:24.516803 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7566aa5f-28dc-426b-912d-ef2f33371df4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:24.517249 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7566aa5f-28dc-426b-912d-ef2f33371df4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:24.518004 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7566aa5f-28dc-426b-912d-ef2f33371df4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:24.518435 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7566aa5f-28dc-426b-912d-ef2f33371df4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:24.643672 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-7566aa5f-28dc-426b-912d-ef2f33371df4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:24.651812 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-7566aa5f-28dc-426b-912d-ef2f33371df4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.146543 May 24 15:38:24.652392 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 953/1888] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:24 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:24.706628 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-8078b96c-7a00-4eb6-b87d-da9343ea9c4f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:24.707242 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-8078b96c-7a00-4eb6-b87d-da9343ea9c4f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:24.713185 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8078b96c-7a00-4eb6-b87d-da9343ea9c4f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:24.713624 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8078b96c-7a00-4eb6-b87d-da9343ea9c4f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:24.714368 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8078b96c-7a00-4eb6-b87d-da9343ea9c4f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:24.714796 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8078b96c-7a00-4eb6-b87d-da9343ea9c4f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:24.839327 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-8078b96c-7a00-4eb6-b87d-da9343ea9c4f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:24.847399 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-8078b96c-7a00-4eb6-b87d-da9343ea9c4f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.144446 May 24 15:38:24.848476 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 936/1889] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:24 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:25.256924 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e603ccb7-b025-4594-8605-f81e4ab76c20 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:25.257568 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e603ccb7-b025-4594-8605-f81e4ab76c20 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:25.264097 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e603ccb7-b025-4594-8605-f81e4ab76c20 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:25.264577 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e603ccb7-b025-4594-8605-f81e4ab76c20 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:25.265338 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e603ccb7-b025-4594-8605-f81e4ab76c20 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:25.265775 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e603ccb7-b025-4594-8605-f81e4ab76c20 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:25.325418 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e603ccb7-b025-4594-8605-f81e4ab76c20 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:25.334293 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e603ccb7-b025-4594-8605-f81e4ab76c20 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:25.335802 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e603ccb7-b025-4594-8605-f81e4ab76c20 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:25.336978 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e603ccb7-b025-4594-8605-f81e4ab76c20 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084004 May 24 15:38:25.337538 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 954/1890] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:38:25 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:38:25.502719 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f1db6faf-3a4c-4f7f-aceb-14f2393ad6db tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:25.503326 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f1db6faf-3a4c-4f7f-aceb-14f2393ad6db tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:25.510402 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f1db6faf-3a4c-4f7f-aceb-14f2393ad6db tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:25.510792 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f1db6faf-3a4c-4f7f-aceb-14f2393ad6db tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:25.511542 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f1db6faf-3a4c-4f7f-aceb-14f2393ad6db tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:25.511976 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f1db6faf-3a4c-4f7f-aceb-14f2393ad6db tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:25.640156 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-f1db6faf-3a4c-4f7f-aceb-14f2393ad6db tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:25.643577 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:38:25.649490 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f1db6faf-3a4c-4f7f-aceb-14f2393ad6db tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.150601 May 24 15:38:25.650058 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 937/1891] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:25 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:25.668259 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-15c89bbf-84ee-48dc-998c-b2bfaef1dba7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:25.668965 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-15c89bbf-84ee-48dc-998c-b2bfaef1dba7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:25.674928 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-15c89bbf-84ee-48dc-998c-b2bfaef1dba7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:25.675379 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-15c89bbf-84ee-48dc-998c-b2bfaef1dba7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:25.676178 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-15c89bbf-84ee-48dc-998c-b2bfaef1dba7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:25.676656 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-15c89bbf-84ee-48dc-998c-b2bfaef1dba7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:25.801432 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-15c89bbf-84ee-48dc-998c-b2bfaef1dba7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:25.809428 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-15c89bbf-84ee-48dc-998c-b2bfaef1dba7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.144972 May 24 15:38:25.809997 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 955/1892] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:25 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:25.865454 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-b5b0cf5b-c7f5-4931-bcb2-cec7cf2afb2a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:25.866063 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-b5b0cf5b-c7f5-4931-bcb2-cec7cf2afb2a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:25.871917 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b5b0cf5b-c7f5-4931-bcb2-cec7cf2afb2a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:25.872400 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b5b0cf5b-c7f5-4931-bcb2-cec7cf2afb2a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:25.873159 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b5b0cf5b-c7f5-4931-bcb2-cec7cf2afb2a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:25.873593 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b5b0cf5b-c7f5-4931-bcb2-cec7cf2afb2a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:25.997093 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-b5b0cf5b-c7f5-4931-bcb2-cec7cf2afb2a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:26.005671 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-b5b0cf5b-c7f5-4931-bcb2-cec7cf2afb2a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.144959 May 24 15:38:26.006231 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 938/1893] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:25 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:26.354993 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-02940cf4-32ad-443f-b85e-4589a49ecf97 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:26.355516 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-02940cf4-32ad-443f-b85e-4589a49ecf97 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:26.361925 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-02940cf4-32ad-443f-b85e-4589a49ecf97 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:26.362363 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-02940cf4-32ad-443f-b85e-4589a49ecf97 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:26.363107 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-02940cf4-32ad-443f-b85e-4589a49ecf97 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:26.364186 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-02940cf4-32ad-443f-b85e-4589a49ecf97 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:26.423274 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-02940cf4-32ad-443f-b85e-4589a49ecf97 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:26.432018 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-02940cf4-32ad-443f-b85e-4589a49ecf97 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:26.433542 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-02940cf4-32ad-443f-b85e-4589a49ecf97 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:26.434670 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-02940cf4-32ad-443f-b85e-4589a49ecf97 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.083668 May 24 15:38:26.435222 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 956/1894] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:38:26 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:38:26.667871 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e6e5f143-fe2f-4b7c-896b-a642f8603031 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:26.668418 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-e6e5f143-fe2f-4b7c-896b-a642f8603031 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:26.675080 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e6e5f143-fe2f-4b7c-896b-a642f8603031 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:26.675548 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e6e5f143-fe2f-4b7c-896b-a642f8603031 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:26.676310 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e6e5f143-fe2f-4b7c-896b-a642f8603031 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:26.676760 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e6e5f143-fe2f-4b7c-896b-a642f8603031 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:26.802848 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-e6e5f143-fe2f-4b7c-896b-a642f8603031 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:26.810791 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-e6e5f143-fe2f-4b7c-896b-a642f8603031 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.146859 May 24 15:38:26.811351 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 939/1895] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:26 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:26.826583 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-cb9c2798-aff4-406b-854c-6086c1de4e64 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:26.827200 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-cb9c2798-aff4-406b-854c-6086c1de4e64 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:26.833727 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cb9c2798-aff4-406b-854c-6086c1de4e64 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:26.834173 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cb9c2798-aff4-406b-854c-6086c1de4e64 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:26.834936 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cb9c2798-aff4-406b-854c-6086c1de4e64 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:26.835371 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cb9c2798-aff4-406b-854c-6086c1de4e64 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:26.961621 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-cb9c2798-aff4-406b-854c-6086c1de4e64 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:26.969635 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-cb9c2798-aff4-406b-854c-6086c1de4e64 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.146903 May 24 15:38:26.970192 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 957/1896] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:26 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:27.022010 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-9b3204f4-29b0-4b0c-8cd0-f439edda805d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:27.022648 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-9b3204f4-29b0-4b0c-8cd0-f439edda805d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:27.028784 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9b3204f4-29b0-4b0c-8cd0-f439edda805d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:27.029233 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9b3204f4-29b0-4b0c-8cd0-f439edda805d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:27.029993 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9b3204f4-29b0-4b0c-8cd0-f439edda805d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:27.030427 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9b3204f4-29b0-4b0c-8cd0-f439edda805d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:27.160770 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-9b3204f4-29b0-4b0c-8cd0-f439edda805d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:27.168712 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-9b3204f4-29b0-4b0c-8cd0-f439edda805d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.151165 May 24 15:38:27.169272 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 940/1897] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:27 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:27.452252 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-a3362172-e5d4-4141-ba9e-9e8181528957 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:27.452888 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-a3362172-e5d4-4141-ba9e-9e8181528957 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:27.459757 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a3362172-e5d4-4141-ba9e-9e8181528957 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:27.460226 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a3362172-e5d4-4141-ba9e-9e8181528957 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:27.461008 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a3362172-e5d4-4141-ba9e-9e8181528957 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:27.461439 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a3362172-e5d4-4141-ba9e-9e8181528957 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:27.525914 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-a3362172-e5d4-4141-ba9e-9e8181528957 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:27.534910 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-a3362172-e5d4-4141-ba9e-9e8181528957 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:27.536463 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-a3362172-e5d4-4141-ba9e-9e8181528957 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:27.537608 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-a3362172-e5d4-4141-ba9e-9e8181528957 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.089366 May 24 15:38:27.538139 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 958/1898] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:38:27 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:38:27.827844 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-1d93fae1-a950-4d29-96a7-42abe274efa9 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:27.828512 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-1d93fae1-a950-4d29-96a7-42abe274efa9 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:27.835676 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1d93fae1-a950-4d29-96a7-42abe274efa9 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:27.836119 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1d93fae1-a950-4d29-96a7-42abe274efa9 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:27.836906 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1d93fae1-a950-4d29-96a7-42abe274efa9 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:27.837341 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1d93fae1-a950-4d29-96a7-42abe274efa9 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:27.963185 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-1d93fae1-a950-4d29-96a7-42abe274efa9 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:27.970980 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-1d93fae1-a950-4d29-96a7-42abe274efa9 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.147066 May 24 15:38:27.971539 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 941/1899] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:27 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:27.986927 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e2681a9b-b7c0-4128-b722-dd198845bebf tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:27.987537 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e2681a9b-b7c0-4128-b722-dd198845bebf tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:27.993855 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e2681a9b-b7c0-4128-b722-dd198845bebf tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:27.994325 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e2681a9b-b7c0-4128-b722-dd198845bebf tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:27.995081 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e2681a9b-b7c0-4128-b722-dd198845bebf tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:27.995510 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e2681a9b-b7c0-4128-b722-dd198845bebf tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:28.119647 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e2681a9b-b7c0-4128-b722-dd198845bebf tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:28.127475 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e2681a9b-b7c0-4128-b722-dd198845bebf tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.144328 May 24 15:38:28.128037 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 959/1900] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:27 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:28.185241 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-634ce357-beac-4de5-8d81-100fe5cd9117 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:28.185884 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-634ce357-beac-4de5-8d81-100fe5cd9117 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:28.192475 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-634ce357-beac-4de5-8d81-100fe5cd9117 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:28.192924 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-634ce357-beac-4de5-8d81-100fe5cd9117 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:28.193677 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-634ce357-beac-4de5-8d81-100fe5cd9117 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:28.194117 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-634ce357-beac-4de5-8d81-100fe5cd9117 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:28.320631 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-634ce357-beac-4de5-8d81-100fe5cd9117 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:28.328549 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-634ce357-beac-4de5-8d81-100fe5cd9117 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.147141 May 24 15:38:28.329116 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 942/1901] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:28 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:28.555835 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e4195222-4dfd-41f3-88b6-7cba5d615608 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:28.556474 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e4195222-4dfd-41f3-88b6-7cba5d615608 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:28.562867 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e4195222-4dfd-41f3-88b6-7cba5d615608 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:28.563310 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e4195222-4dfd-41f3-88b6-7cba5d615608 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:28.564058 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e4195222-4dfd-41f3-88b6-7cba5d615608 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:28.564521 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e4195222-4dfd-41f3-88b6-7cba5d615608 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:28.626205 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e4195222-4dfd-41f3-88b6-7cba5d615608 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:28.634708 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e4195222-4dfd-41f3-88b6-7cba5d615608 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:28.636211 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e4195222-4dfd-41f3-88b6-7cba5d615608 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:28.637380 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e4195222-4dfd-41f3-88b6-7cba5d615608 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.086132 May 24 15:38:28.637938 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 960/1902] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:38:28 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:38:28.987026 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-5d552b25-8a19-4de2-ac4b-7804f5584bf4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:28.987628 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-5d552b25-8a19-4de2-ac4b-7804f5584bf4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:28.994481 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5d552b25-8a19-4de2-ac4b-7804f5584bf4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:28.994925 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5d552b25-8a19-4de2-ac4b-7804f5584bf4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:28.995672 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5d552b25-8a19-4de2-ac4b-7804f5584bf4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:28.996099 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5d552b25-8a19-4de2-ac4b-7804f5584bf4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:29.122171 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-5d552b25-8a19-4de2-ac4b-7804f5584bf4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:29.130214 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-5d552b25-8a19-4de2-ac4b-7804f5584bf4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.146972 May 24 15:38:29.130778 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 943/1903] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:28 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:29.145373 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-70e2eca6-2782-41b5-8268-ae455b7fcfda tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:29.146001 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-70e2eca6-2782-41b5-8268-ae455b7fcfda tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:29.151931 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-70e2eca6-2782-41b5-8268-ae455b7fcfda tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:29.152413 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-70e2eca6-2782-41b5-8268-ae455b7fcfda tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:29.153143 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-70e2eca6-2782-41b5-8268-ae455b7fcfda tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:29.153567 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-70e2eca6-2782-41b5-8268-ae455b7fcfda tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:29.282690 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-70e2eca6-2782-41b5-8268-ae455b7fcfda tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:29.290547 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-70e2eca6-2782-41b5-8268-ae455b7fcfda tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.149538 May 24 15:38:29.291106 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 961/1904] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:29 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:29.345018 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-6caa5f57-dc67-4efd-955c-a79066e46b37 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:29.345629 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-6caa5f57-dc67-4efd-955c-a79066e46b37 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:29.351622 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6caa5f57-dc67-4efd-955c-a79066e46b37 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:29.352074 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6caa5f57-dc67-4efd-955c-a79066e46b37 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:29.352865 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6caa5f57-dc67-4efd-955c-a79066e46b37 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:29.353299 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6caa5f57-dc67-4efd-955c-a79066e46b37 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:29.481766 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-6caa5f57-dc67-4efd-955c-a79066e46b37 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:29.489705 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-6caa5f57-dc67-4efd-955c-a79066e46b37 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.148449 May 24 15:38:29.490519 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 944/1905] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:29 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:29.654997 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-45792795-6810-4646-9a88-417afea9b888 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:29.655604 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-45792795-6810-4646-9a88-417afea9b888 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:29.662067 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-45792795-6810-4646-9a88-417afea9b888 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:29.662509 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-45792795-6810-4646-9a88-417afea9b888 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:29.663259 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-45792795-6810-4646-9a88-417afea9b888 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:29.663690 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-45792795-6810-4646-9a88-417afea9b888 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:29.681899 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:38:29.724926 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-45792795-6810-4646-9a88-417afea9b888 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:29.733279 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-45792795-6810-4646-9a88-417afea9b888 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:29.734707 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-45792795-6810-4646-9a88-417afea9b888 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:29.735840 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-45792795-6810-4646-9a88-417afea9b888 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084738 May 24 15:38:29.736428 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 962/1906] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:38:29 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:38:30.147771 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-36c9e26e-4c99-49aa-a469-3dd9cff2ac76 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:30.148406 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-36c9e26e-4c99-49aa-a469-3dd9cff2ac76 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:30.154961 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-36c9e26e-4c99-49aa-a469-3dd9cff2ac76 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:30.155406 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-36c9e26e-4c99-49aa-a469-3dd9cff2ac76 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:30.156168 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-36c9e26e-4c99-49aa-a469-3dd9cff2ac76 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:30.156632 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-36c9e26e-4c99-49aa-a469-3dd9cff2ac76 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:30.280582 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-36c9e26e-4c99-49aa-a469-3dd9cff2ac76 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:30.288506 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-36c9e26e-4c99-49aa-a469-3dd9cff2ac76 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.145140 May 24 15:38:30.289072 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 945/1907] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:30 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:30.306809 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-0267d1d1-b113-43e6-94ef-a172179ab5f7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:30.307416 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-0267d1d1-b113-43e6-94ef-a172179ab5f7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:30.313423 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0267d1d1-b113-43e6-94ef-a172179ab5f7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:30.313865 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0267d1d1-b113-43e6-94ef-a172179ab5f7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:30.314614 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0267d1d1-b113-43e6-94ef-a172179ab5f7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:30.315049 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0267d1d1-b113-43e6-94ef-a172179ab5f7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:30.439801 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-0267d1d1-b113-43e6-94ef-a172179ab5f7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:30.448752 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-0267d1d1-b113-43e6-94ef-a172179ab5f7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.145746 May 24 15:38:30.449317 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 963/1908] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:30 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:30.506298 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-402c3b9f-14c8-46e1-8a79-ad8834ed5a0d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:30.506932 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-402c3b9f-14c8-46e1-8a79-ad8834ed5a0d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:30.513088 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-402c3b9f-14c8-46e1-8a79-ad8834ed5a0d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:30.513534 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-402c3b9f-14c8-46e1-8a79-ad8834ed5a0d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:30.514290 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-402c3b9f-14c8-46e1-8a79-ad8834ed5a0d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:30.514722 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-402c3b9f-14c8-46e1-8a79-ad8834ed5a0d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:30.638488 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-402c3b9f-14c8-46e1-8a79-ad8834ed5a0d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:30.646384 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-402c3b9f-14c8-46e1-8a79-ad8834ed5a0d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.144449 May 24 15:38:30.646883 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 946/1909] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:30 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:30.753552 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-36173784-b227-4c1d-abbf-847f60ede080 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:30.754203 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-36173784-b227-4c1d-abbf-847f60ede080 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:30.760559 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-36173784-b227-4c1d-abbf-847f60ede080 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:30.761003 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-36173784-b227-4c1d-abbf-847f60ede080 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:30.761750 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-36173784-b227-4c1d-abbf-847f60ede080 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:30.762175 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-36173784-b227-4c1d-abbf-847f60ede080 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:30.824948 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-36173784-b227-4c1d-abbf-847f60ede080 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:30.833168 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-36173784-b227-4c1d-abbf-847f60ede080 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:30.834650 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-36173784-b227-4c1d-abbf-847f60ede080 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:30.835766 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-36173784-b227-4c1d-abbf-847f60ede080 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.086147 May 24 15:38:30.836347 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 964/1910] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:38:30 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:38:31.305401 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-7a5bb468-706f-4660-9213-584105a99dde tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:31.306007 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-7a5bb468-706f-4660-9213-584105a99dde tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:31.312586 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7a5bb468-706f-4660-9213-584105a99dde tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:31.313032 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7a5bb468-706f-4660-9213-584105a99dde tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:31.313790 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7a5bb468-706f-4660-9213-584105a99dde tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:31.314226 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7a5bb468-706f-4660-9213-584105a99dde tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:31.443855 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-7a5bb468-706f-4660-9213-584105a99dde tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:31.451742 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-7a5bb468-706f-4660-9213-584105a99dde tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.150270 May 24 15:38:31.452319 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 947/1911] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:31 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:31.465827 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-a5fc5b8d-b8b1-4c0a-9174-45f552b93224 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:31.466439 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-a5fc5b8d-b8b1-4c0a-9174-45f552b93224 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:31.472435 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a5fc5b8d-b8b1-4c0a-9174-45f552b93224 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:31.473521 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a5fc5b8d-b8b1-4c0a-9174-45f552b93224 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:31.474272 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a5fc5b8d-b8b1-4c0a-9174-45f552b93224 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:31.474731 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a5fc5b8d-b8b1-4c0a-9174-45f552b93224 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:31.599884 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-a5fc5b8d-b8b1-4c0a-9174-45f552b93224 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:31.607907 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-a5fc5b8d-b8b1-4c0a-9174-45f552b93224 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.146086 May 24 15:38:31.608498 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 965/1912] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:31 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:31.662864 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-91d80b6f-c612-4cac-9636-b5f2c2824dbe tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:31.663475 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-91d80b6f-c612-4cac-9636-b5f2c2824dbe tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:31.669442 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-91d80b6f-c612-4cac-9636-b5f2c2824dbe tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:31.669888 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-91d80b6f-c612-4cac-9636-b5f2c2824dbe tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:31.670649 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-91d80b6f-c612-4cac-9636-b5f2c2824dbe tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:31.671081 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-91d80b6f-c612-4cac-9636-b5f2c2824dbe tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:31.796173 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-91d80b6f-c612-4cac-9636-b5f2c2824dbe tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:31.804161 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-91d80b6f-c612-4cac-9636-b5f2c2824dbe tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.145100 May 24 15:38:31.804699 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 948/1913] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:31 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:31.853837 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-3f7451d6-b58d-49f4-8ae9-f37c19b046d9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:31.854442 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-3f7451d6-b58d-49f4-8ae9-f37c19b046d9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:31.860799 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3f7451d6-b58d-49f4-8ae9-f37c19b046d9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:31.861243 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3f7451d6-b58d-49f4-8ae9-f37c19b046d9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:31.861992 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3f7451d6-b58d-49f4-8ae9-f37c19b046d9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:31.862426 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3f7451d6-b58d-49f4-8ae9-f37c19b046d9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:31.922391 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-3f7451d6-b58d-49f4-8ae9-f37c19b046d9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:31.931270 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-3f7451d6-b58d-49f4-8ae9-f37c19b046d9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:31.932771 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-3f7451d6-b58d-49f4-8ae9-f37c19b046d9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:31.933905 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-3f7451d6-b58d-49f4-8ae9-f37c19b046d9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.083951 May 24 15:38:31.934459 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 966/1914] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:38:31 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:38:32.469029 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f33a1929-4506-4aa9-93e8-e12c09eae5fc tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:32.469677 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f33a1929-4506-4aa9-93e8-e12c09eae5fc tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:32.476675 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f33a1929-4506-4aa9-93e8-e12c09eae5fc tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:32.477113 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f33a1929-4506-4aa9-93e8-e12c09eae5fc tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:32.477863 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f33a1929-4506-4aa9-93e8-e12c09eae5fc tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:32.478306 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f33a1929-4506-4aa9-93e8-e12c09eae5fc tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:32.612640 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-f33a1929-4506-4aa9-93e8-e12c09eae5fc tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:32.621521 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f33a1929-4506-4aa9-93e8-e12c09eae5fc tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.156327 May 24 15:38:32.622088 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 949/1915] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:32 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:32.625117 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-49a6ce78-1729-4136-bcf7-ccbb37a771f0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:32.625745 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-49a6ce78-1729-4136-bcf7-ccbb37a771f0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:32.631596 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-49a6ce78-1729-4136-bcf7-ccbb37a771f0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:32.632039 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-49a6ce78-1729-4136-bcf7-ccbb37a771f0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:32.632821 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-49a6ce78-1729-4136-bcf7-ccbb37a771f0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:32.633272 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-49a6ce78-1729-4136-bcf7-ccbb37a771f0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:32.760001 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-49a6ce78-1729-4136-bcf7-ccbb37a771f0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:32.767894 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-49a6ce78-1729-4136-bcf7-ccbb37a771f0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.146802 May 24 15:38:32.768483 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 967/1916] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:32 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:38:32.820042 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a5a94dc6-032d-4a81-9954-e0843f08af5a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:32.820701 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a5a94dc6-032d-4a81-9954-e0843f08af5a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:32.826690 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a5a94dc6-032d-4a81-9954-e0843f08af5a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:32.827132 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a5a94dc6-032d-4a81-9954-e0843f08af5a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:32.827878 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a5a94dc6-032d-4a81-9954-e0843f08af5a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:32.828322 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a5a94dc6-032d-4a81-9954-e0843f08af5a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:32.952269 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-ba06be48-a85d-4d6c-baa5-5f8337f3faf4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:32.952983 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-ba06be48-a85d-4d6c-baa5-5f8337f3faf4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:32.959951 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ba06be48-a85d-4d6c-baa5-5f8337f3faf4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:32.960420 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ba06be48-a85d-4d6c-baa5-5f8337f3faf4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:32.961176 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ba06be48-a85d-4d6c-baa5-5f8337f3faf4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:32.961608 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ba06be48-a85d-4d6c-baa5-5f8337f3faf4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:32.968604 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-a5a94dc6-032d-4a81-9954-e0843f08af5a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:32.977040 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a5a94dc6-032d-4a81-9954-e0843f08af5a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.160789 May 24 15:38:32.977606 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 950/1917] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:32 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:33.023652 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ba06be48-a85d-4d6c-baa5-5f8337f3faf4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:33.031941 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ba06be48-a85d-4d6c-baa5-5f8337f3faf4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:33.033455 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ba06be48-a85d-4d6c-baa5-5f8337f3faf4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:33.034580 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-ba06be48-a85d-4d6c-baa5-5f8337f3faf4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.086260 May 24 15:38:33.035129 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 968/1918] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:38:32 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:38:33.638557 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-2d05e17a-2340-4fd9-bbe3-d28324c1f3d8 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:33.639162 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-2d05e17a-2340-4fd9-bbe3-d28324c1f3d8 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:33.646255 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2d05e17a-2340-4fd9-bbe3-d28324c1f3d8 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:33.646699 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2d05e17a-2340-4fd9-bbe3-d28324c1f3d8 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:33.647444 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2d05e17a-2340-4fd9-bbe3-d28324c1f3d8 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:33.647872 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2d05e17a-2340-4fd9-bbe3-d28324c1f3d8 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:33.772937 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-2d05e17a-2340-4fd9-bbe3-d28324c1f3d8 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:33.781148 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-2d05e17a-2340-4fd9-bbe3-d28324c1f3d8 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.146467 May 24 15:38:33.781725 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 951/1919] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:33 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:33.785047 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-67834b35-4681-44fc-a475-b74c41094a66 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:33.785660 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-67834b35-4681-44fc-a475-b74c41094a66 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:33.791619 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-67834b35-4681-44fc-a475-b74c41094a66 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:33.792063 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-67834b35-4681-44fc-a475-b74c41094a66 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:33.792856 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-67834b35-4681-44fc-a475-b74c41094a66 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:33.793291 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-67834b35-4681-44fc-a475-b74c41094a66 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:33.917345 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-67834b35-4681-44fc-a475-b74c41094a66 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:33.925282 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-67834b35-4681-44fc-a475-b74c41094a66 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.144012 May 24 15:38:33.925843 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 969/1920] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:33 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:38:33.994140 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-1239799a-fd7a-47bb-983f-940a9c01a345 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:33.994781 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-1239799a-fd7a-47bb-983f-940a9c01a345 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:34.000797 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1239799a-fd7a-47bb-983f-940a9c01a345 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:34.001243 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1239799a-fd7a-47bb-983f-940a9c01a345 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:34.002002 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1239799a-fd7a-47bb-983f-940a9c01a345 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:34.002438 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1239799a-fd7a-47bb-983f-940a9c01a345 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:34.052144 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-4a597268-625e-4c60-a75b-e31c340493ef tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:34.052927 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-4a597268-625e-4c60-a75b-e31c340493ef tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:34.055211 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:38:34.060472 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4a597268-625e-4c60-a75b-e31c340493ef tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:34.060917 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4a597268-625e-4c60-a75b-e31c340493ef tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:34.061677 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4a597268-625e-4c60-a75b-e31c340493ef tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:34.062110 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4a597268-625e-4c60-a75b-e31c340493ef tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:34.127757 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-4a597268-625e-4c60-a75b-e31c340493ef tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:34.136862 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-4a597268-625e-4c60-a75b-e31c340493ef tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:34.137681 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-1239799a-fd7a-47bb-983f-940a9c01a345 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:34.138388 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-4a597268-625e-4c60-a75b-e31c340493ef tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:34.139529 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-4a597268-625e-4c60-a75b-e31c340493ef tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.091296 May 24 15:38:34.140085 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 970/1921] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:38:34 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:38:34.145828 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-1239799a-fd7a-47bb-983f-940a9c01a345 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.155821 May 24 15:38:34.146385 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 952/1922] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:33 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:34.798084 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-575a60ef-b0f2-46b0-86d7-d6394b74cb45 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:34.798711 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-575a60ef-b0f2-46b0-86d7-d6394b74cb45 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:34.805444 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-575a60ef-b0f2-46b0-86d7-d6394b74cb45 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:34.805885 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-575a60ef-b0f2-46b0-86d7-d6394b74cb45 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:34.806636 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-575a60ef-b0f2-46b0-86d7-d6394b74cb45 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:34.807094 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-575a60ef-b0f2-46b0-86d7-d6394b74cb45 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:34.931269 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-575a60ef-b0f2-46b0-86d7-d6394b74cb45 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:34.939632 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-575a60ef-b0f2-46b0-86d7-d6394b74cb45 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.145381 May 24 15:38:34.940202 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 971/1923] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:34 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:34.941929 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-0173dec5-369a-428c-80b0-8ef8715029f7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:34.942548 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-0173dec5-369a-428c-80b0-8ef8715029f7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:34.949019 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0173dec5-369a-428c-80b0-8ef8715029f7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:34.949453 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0173dec5-369a-428c-80b0-8ef8715029f7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:34.950212 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0173dec5-369a-428c-80b0-8ef8715029f7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:34.950638 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0173dec5-369a-428c-80b0-8ef8715029f7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:35.075176 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-0173dec5-369a-428c-80b0-8ef8715029f7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:35.083528 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-0173dec5-369a-428c-80b0-8ef8715029f7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.145498 May 24 15:38:35.084093 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 953/1924] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:34 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:38:35.157305 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d30aeb00-1776-4250-8af8-2094a5d52723 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:35.158018 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d30aeb00-1776-4250-8af8-2094a5d52723 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:35.163212 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-1278c386-e35b-4afa-88e3-7896d235d5c6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:35.163822 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-1278c386-e35b-4afa-88e3-7896d235d5c6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:35.165142 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d30aeb00-1776-4250-8af8-2094a5d52723 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:35.165583 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d30aeb00-1776-4250-8af8-2094a5d52723 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:35.166333 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d30aeb00-1776-4250-8af8-2094a5d52723 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:35.166764 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d30aeb00-1776-4250-8af8-2094a5d52723 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:35.169654 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1278c386-e35b-4afa-88e3-7896d235d5c6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:35.170104 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1278c386-e35b-4afa-88e3-7896d235d5c6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:35.170873 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1278c386-e35b-4afa-88e3-7896d235d5c6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:35.171307 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1278c386-e35b-4afa-88e3-7896d235d5c6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:35.188950 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:38:35.227828 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-d30aeb00-1776-4250-8af8-2094a5d52723 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:35.238289 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-d30aeb00-1776-4250-8af8-2094a5d52723 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:35.239854 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-d30aeb00-1776-4250-8af8-2094a5d52723 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:35.241280 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d30aeb00-1776-4250-8af8-2094a5d52723 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.087875 May 24 15:38:35.241837 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 972/1925] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:38:35 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:38:35.302707 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-1278c386-e35b-4afa-88e3-7896d235d5c6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:35.310666 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-1278c386-e35b-4afa-88e3-7896d235d5c6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.152212 May 24 15:38:35.311228 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 954/1926] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:35 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:38:36.006863 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-5e73db80-e8d5-4a53-bf45-8be5c655ecbb tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:36.007510 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-5e73db80-e8d5-4a53-bf45-8be5c655ecbb tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:36.013491 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5e73db80-e8d5-4a53-bf45-8be5c655ecbb tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:36.013959 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5e73db80-e8d5-4a53-bf45-8be5c655ecbb tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:36.014708 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5e73db80-e8d5-4a53-bf45-8be5c655ecbb tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:36.015135 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5e73db80-e8d5-4a53-bf45-8be5c655ecbb tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:36.100638 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-85579401-84d4-401a-bbf0-1a992fcda65e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:36.101249 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-85579401-84d4-401a-bbf0-1a992fcda65e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:36.107600 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-85579401-84d4-401a-bbf0-1a992fcda65e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:36.108043 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-85579401-84d4-401a-bbf0-1a992fcda65e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:36.108837 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-85579401-84d4-401a-bbf0-1a992fcda65e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:36.109266 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-85579401-84d4-401a-bbf0-1a992fcda65e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:36.143638 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-5e73db80-e8d5-4a53-bf45-8be5c655ecbb tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:36.151995 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-5e73db80-e8d5-4a53-bf45-8be5c655ecbb tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.199286 May 24 15:38:36.152797 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 973/1927] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:35 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:36.238324 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-85579401-84d4-401a-bbf0-1a992fcda65e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:36.247191 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-85579401-84d4-401a-bbf0-1a992fcda65e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.150852 May 24 15:38:36.247736 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 955/1928] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:36 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:38:36.258830 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-dd825c14-c241-48c4-b670-0010182d4a22 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:36.259446 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-dd825c14-c241-48c4-b670-0010182d4a22 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:36.265899 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dd825c14-c241-48c4-b670-0010182d4a22 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:36.266347 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dd825c14-c241-48c4-b670-0010182d4a22 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:36.267111 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dd825c14-c241-48c4-b670-0010182d4a22 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:36.267554 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dd825c14-c241-48c4-b670-0010182d4a22 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:36.327724 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-dd825c14-c241-48c4-b670-0010182d4a22 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:36.327974 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-4a89e664-51fa-4fd8-8d7d-663d923c84ff tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:36.328650 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-4a89e664-51fa-4fd8-8d7d-663d923c84ff tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:36.334615 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4a89e664-51fa-4fd8-8d7d-663d923c84ff tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:36.335061 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4a89e664-51fa-4fd8-8d7d-663d923c84ff tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:36.335820 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4a89e664-51fa-4fd8-8d7d-663d923c84ff tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:36.336252 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4a89e664-51fa-4fd8-8d7d-663d923c84ff tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:36.336546 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-dd825c14-c241-48c4-b670-0010182d4a22 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:36.338076 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-dd825c14-c241-48c4-b670-0010182d4a22 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:36.339215 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-dd825c14-c241-48c4-b670-0010182d4a22 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084296 May 24 15:38:36.339775 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 974/1929] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:38:36 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:38:36.465742 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-4a89e664-51fa-4fd8-8d7d-663d923c84ff tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:36.474288 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-4a89e664-51fa-4fd8-8d7d-663d923c84ff tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.150114 May 24 15:38:36.474856 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 956/1930] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:36 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:38:37.169737 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-a8feeff8-3ea1-4d00-8c63-3ad723e1a957 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:37.170344 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-a8feeff8-3ea1-4d00-8c63-3ad723e1a957 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:37.176417 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a8feeff8-3ea1-4d00-8c63-3ad723e1a957 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:37.177355 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a8feeff8-3ea1-4d00-8c63-3ad723e1a957 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:37.178150 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a8feeff8-3ea1-4d00-8c63-3ad723e1a957 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:37.178526 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a8feeff8-3ea1-4d00-8c63-3ad723e1a957 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:37.264140 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-1077ca12-18be-465b-959f-2dca27c6cae0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:37.264868 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-1077ca12-18be-465b-959f-2dca27c6cae0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:37.271417 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1077ca12-18be-465b-959f-2dca27c6cae0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:37.271965 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1077ca12-18be-465b-959f-2dca27c6cae0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:37.272845 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1077ca12-18be-465b-959f-2dca27c6cae0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:37.273385 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1077ca12-18be-465b-959f-2dca27c6cae0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:37.304452 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-a8feeff8-3ea1-4d00-8c63-3ad723e1a957 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:37.312374 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-a8feeff8-3ea1-4d00-8c63-3ad723e1a957 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.146428 May 24 15:38:37.312944 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 975/1931] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:37 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:37.357484 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-3dfb1e64-e0be-4ee2-8154-a015271e6b23 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:37.358172 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-3dfb1e64-e0be-4ee2-8154-a015271e6b23 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:37.365148 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3dfb1e64-e0be-4ee2-8154-a015271e6b23 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:37.365933 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3dfb1e64-e0be-4ee2-8154-a015271e6b23 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:37.366764 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3dfb1e64-e0be-4ee2-8154-a015271e6b23 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:37.367265 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3dfb1e64-e0be-4ee2-8154-a015271e6b23 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:37.400594 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-1077ca12-18be-465b-959f-2dca27c6cae0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:37.408630 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-1077ca12-18be-465b-959f-2dca27c6cae0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.148340 May 24 15:38:37.409206 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 957/1932] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:37 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:38:37.431211 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-3dfb1e64-e0be-4ee2-8154-a015271e6b23 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:37.439630 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-3dfb1e64-e0be-4ee2-8154-a015271e6b23 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:37.441154 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-3dfb1e64-e0be-4ee2-8154-a015271e6b23 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:37.442895 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-3dfb1e64-e0be-4ee2-8154-a015271e6b23 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.088673 May 24 15:38:37.443453 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 976/1933] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:38:37 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:38:37.491495 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-46374e4d-b890-4ef6-8d38-3e6a5ba17787 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:37.492097 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-46374e4d-b890-4ef6-8d38-3e6a5ba17787 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:37.493935 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_api:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:38:37.499096 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-46374e4d-b890-4ef6-8d38-3e6a5ba17787 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:37.499537 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-46374e4d-b890-4ef6-8d38-3e6a5ba17787 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:37.500290 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-46374e4d-b890-4ef6-8d38-3e6a5ba17787 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:37.500740 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-46374e4d-b890-4ef6-8d38-3e6a5ba17787 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:37.625274 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-46374e4d-b890-4ef6-8d38-3e6a5ba17787 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:37.633092 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-46374e4d-b890-4ef6-8d38-3e6a5ba17787 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.146282 May 24 15:38:37.633654 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 958/1934] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:37 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:38.329820 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-8b601e19-d618-424e-9eef-c3c69537ce85 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:38.330364 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-8b601e19-d618-424e-9eef-c3c69537ce85 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:38.337653 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8b601e19-d618-424e-9eef-c3c69537ce85 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:38.338100 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8b601e19-d618-424e-9eef-c3c69537ce85 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:38.338862 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8b601e19-d618-424e-9eef-c3c69537ce85 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:38.339299 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8b601e19-d618-424e-9eef-c3c69537ce85 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:38.424867 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-3ba8c9c6-0c01-4908-b510-686db3a4b64e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:38.425481 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-3ba8c9c6-0c01-4908-b510-686db3a4b64e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:38.431964 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3ba8c9c6-0c01-4908-b510-686db3a4b64e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:38.432452 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3ba8c9c6-0c01-4908-b510-686db3a4b64e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:38.433217 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3ba8c9c6-0c01-4908-b510-686db3a4b64e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:38.433651 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3ba8c9c6-0c01-4908-b510-686db3a4b64e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:38.466961 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-8b601e19-d618-424e-9eef-c3c69537ce85 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:38.475031 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-8b601e19-d618-424e-9eef-c3c69537ce85 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.149109 May 24 15:38:38.475599 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 977/1935] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:38 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:38.480051 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-7171211b-1538-4b24-a959-8c486a998625 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:38.480668 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-7171211b-1538-4b24-a959-8c486a998625 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:38.486477 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7171211b-1538-4b24-a959-8c486a998625 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:38.486919 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7171211b-1538-4b24-a959-8c486a998625 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:38.487664 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7171211b-1538-4b24-a959-8c486a998625 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:38.488092 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7171211b-1538-4b24-a959-8c486a998625 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:38.547850 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-7171211b-1538-4b24-a959-8c486a998625 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:38.556154 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-7171211b-1538-4b24-a959-8c486a998625 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:38.557665 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-7171211b-1538-4b24-a959-8c486a998625 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:38.558794 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-7171211b-1538-4b24-a959-8c486a998625 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.082293 May 24 15:38:38.559352 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 978/1936] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:38:38 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:38:38.565990 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-3ba8c9c6-0c01-4908-b510-686db3a4b64e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:38.574555 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-3ba8c9c6-0c01-4908-b510-686db3a4b64e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.153530 May 24 15:38:38.575106 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 959/1937] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:38 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:38:38.649628 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c3c6e1ca-b52d-4704-beee-09a6b5a528eb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:38.650168 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-c3c6e1ca-b52d-4704-beee-09a6b5a528eb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:38.656091 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c3c6e1ca-b52d-4704-beee-09a6b5a528eb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:38.656568 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c3c6e1ca-b52d-4704-beee-09a6b5a528eb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:38.657315 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c3c6e1ca-b52d-4704-beee-09a6b5a528eb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:38.657744 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c3c6e1ca-b52d-4704-beee-09a6b5a528eb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:38.661598 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:38:39.000382 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-c3c6e1ca-b52d-4704-beee-09a6b5a528eb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:39.008532 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-c3c6e1ca-b52d-4704-beee-09a6b5a528eb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.362683 May 24 15:38:39.009088 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 979/1938] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:38 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:38:39.492212 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-21a6465c-cf2f-4487-8af3-6a93f31bdd45 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:39.492846 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-21a6465c-cf2f-4487-8af3-6a93f31bdd45 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:39.499979 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-21a6465c-cf2f-4487-8af3-6a93f31bdd45 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:39.500460 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-21a6465c-cf2f-4487-8af3-6a93f31bdd45 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:39.501222 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-21a6465c-cf2f-4487-8af3-6a93f31bdd45 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:39.501654 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-21a6465c-cf2f-4487-8af3-6a93f31bdd45 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:39.577028 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-05e11840-cda9-4e2f-9eef-168122c48f2d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:39.577672 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-05e11840-cda9-4e2f-9eef-168122c48f2d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:39.585104 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-05e11840-cda9-4e2f-9eef-168122c48f2d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:39.585559 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-05e11840-cda9-4e2f-9eef-168122c48f2d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:39.586423 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-05e11840-cda9-4e2f-9eef-168122c48f2d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:39.586859 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-05e11840-cda9-4e2f-9eef-168122c48f2d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:39.630774 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-21a6465c-cf2f-4487-8af3-6a93f31bdd45 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:39.638859 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-21a6465c-cf2f-4487-8af3-6a93f31bdd45 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.150695 May 24 15:38:39.639437 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 960/1939] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:39 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:39.643852 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e5c48339-9fdc-4482-97be-5ff298eed65d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:39.644489 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-e5c48339-9fdc-4482-97be-5ff298eed65d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:39.649510 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-05e11840-cda9-4e2f-9eef-168122c48f2d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:39.651118 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e5c48339-9fdc-4482-97be-5ff298eed65d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:39.651570 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e5c48339-9fdc-4482-97be-5ff298eed65d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:39.652375 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e5c48339-9fdc-4482-97be-5ff298eed65d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:39.652818 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e5c48339-9fdc-4482-97be-5ff298eed65d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:39.658416 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-05e11840-cda9-4e2f-9eef-168122c48f2d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:39.659939 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-05e11840-cda9-4e2f-9eef-168122c48f2d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:39.661732 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-05e11840-cda9-4e2f-9eef-168122c48f2d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.087954 May 24 15:38:39.662496 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 980/1940] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:38:39 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:38:39.780943 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-e5c48339-9fdc-4482-97be-5ff298eed65d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:39.789015 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-e5c48339-9fdc-4482-97be-5ff298eed65d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.148640 May 24 15:38:39.789581 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 961/1941] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:39 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:40.025891 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-7a5088f3-6a52-4e60-ba35-3b13a29d5e10 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:40.026538 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-7a5088f3-6a52-4e60-ba35-3b13a29d5e10 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:40.032735 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7a5088f3-6a52-4e60-ba35-3b13a29d5e10 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:40.033183 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7a5088f3-6a52-4e60-ba35-3b13a29d5e10 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:40.033943 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7a5088f3-6a52-4e60-ba35-3b13a29d5e10 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:40.034377 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7a5088f3-6a52-4e60-ba35-3b13a29d5e10 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:40.165916 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-7a5088f3-6a52-4e60-ba35-3b13a29d5e10 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:40.173884 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-7a5088f3-6a52-4e60-ba35-3b13a29d5e10 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.151835 May 24 15:38:40.174451 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 981/1942] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:40 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:40.656550 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e8066978-ebf1-4e6c-8188-ae1d774b3a10 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:40.657177 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-e8066978-ebf1-4e6c-8188-ae1d774b3a10 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:40.664172 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e8066978-ebf1-4e6c-8188-ae1d774b3a10 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:40.664659 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e8066978-ebf1-4e6c-8188-ae1d774b3a10 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:40.665424 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e8066978-ebf1-4e6c-8188-ae1d774b3a10 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:40.665860 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e8066978-ebf1-4e6c-8188-ae1d774b3a10 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:40.679479 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e5c2e826-21c9-48db-ab53-09ed9ddc73aa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:40.680094 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e5c2e826-21c9-48db-ab53-09ed9ddc73aa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:40.686075 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e5c2e826-21c9-48db-ab53-09ed9ddc73aa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:40.686520 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e5c2e826-21c9-48db-ab53-09ed9ddc73aa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:40.687286 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e5c2e826-21c9-48db-ab53-09ed9ddc73aa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:40.687718 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e5c2e826-21c9-48db-ab53-09ed9ddc73aa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:40.751320 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e5c2e826-21c9-48db-ab53-09ed9ddc73aa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:40.760101 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e5c2e826-21c9-48db-ab53-09ed9ddc73aa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:40.761653 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e5c2e826-21c9-48db-ab53-09ed9ddc73aa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:40.762801 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e5c2e826-21c9-48db-ab53-09ed9ddc73aa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.087915 May 24 15:38:40.763358 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 982/1943] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:38:40 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:38:40.794429 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-e8066978-ebf1-4e6c-8188-ae1d774b3a10 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:40.802966 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-e8066978-ebf1-4e6c-8188-ae1d774b3a10 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.150357 May 24 15:38:40.803529 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 962/1944] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:40 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:40.806149 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d96be438-e236-498b-b887-ec40ab5aae00 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:40.806757 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d96be438-e236-498b-b887-ec40ab5aae00 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:40.812733 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d96be438-e236-498b-b887-ec40ab5aae00 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:40.813172 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d96be438-e236-498b-b887-ec40ab5aae00 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:40.813915 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d96be438-e236-498b-b887-ec40ab5aae00 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:40.814340 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d96be438-e236-498b-b887-ec40ab5aae00 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:40.938099 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-d96be438-e236-498b-b887-ec40ab5aae00 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:40.945974 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d96be438-e236-498b-b887-ec40ab5aae00 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.144125 May 24 15:38:40.946524 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 983/1945] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:40 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:38:41.191036 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-5c918a67-2feb-4bb9-8e8c-619e5291c929 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:41.191575 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-5c918a67-2feb-4bb9-8e8c-619e5291c929 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:41.197826 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5c918a67-2feb-4bb9-8e8c-619e5291c929 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:41.198273 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5c918a67-2feb-4bb9-8e8c-619e5291c929 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:41.199028 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5c918a67-2feb-4bb9-8e8c-619e5291c929 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:41.199483 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5c918a67-2feb-4bb9-8e8c-619e5291c929 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:41.324404 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-5c918a67-2feb-4bb9-8e8c-619e5291c929 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:41.332422 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-5c918a67-2feb-4bb9-8e8c-619e5291c929 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.145310 May 24 15:38:41.333607 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 963/1946] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:41 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:41.780161 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-a7ad0ed4-e5c4-4d83-b07d-7205bccb6f2b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:41.780807 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-a7ad0ed4-e5c4-4d83-b07d-7205bccb6f2b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:41.789642 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a7ad0ed4-e5c4-4d83-b07d-7205bccb6f2b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:41.790359 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a7ad0ed4-e5c4-4d83-b07d-7205bccb6f2b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:41.791196 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a7ad0ed4-e5c4-4d83-b07d-7205bccb6f2b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:41.791633 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a7ad0ed4-e5c4-4d83-b07d-7205bccb6f2b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:41.820049 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-38035d66-d459-4cff-9648-ee313bd233e3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:41.820702 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-38035d66-d459-4cff-9648-ee313bd233e3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:41.827326 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-38035d66-d459-4cff-9648-ee313bd233e3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:41.827765 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-38035d66-d459-4cff-9648-ee313bd233e3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:41.828554 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-38035d66-d459-4cff-9648-ee313bd233e3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:41.828988 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-38035d66-d459-4cff-9648-ee313bd233e3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:41.852142 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-a7ad0ed4-e5c4-4d83-b07d-7205bccb6f2b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:41.860695 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-a7ad0ed4-e5c4-4d83-b07d-7205bccb6f2b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:41.862187 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-a7ad0ed4-e5c4-4d83-b07d-7205bccb6f2b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:41.863326 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-a7ad0ed4-e5c4-4d83-b07d-7205bccb6f2b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.087057 May 24 15:38:41.863888 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 984/1947] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:38:41 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:38:41.958293 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-38035d66-d459-4cff-9648-ee313bd233e3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:41.962590 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-b68e9a5b-0ba4-4d96-be4a-f9d95bc84d63 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:41.963194 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-b68e9a5b-0ba4-4d96-be4a-f9d95bc84d63 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:41.966444 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-38035d66-d459-4cff-9648-ee313bd233e3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.150850 May 24 15:38:41.967022 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 964/1948] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:41 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:38:41.969566 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b68e9a5b-0ba4-4d96-be4a-f9d95bc84d63 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:41.970007 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b68e9a5b-0ba4-4d96-be4a-f9d95bc84d63 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:41.970760 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b68e9a5b-0ba4-4d96-be4a-f9d95bc84d63 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:41.971187 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b68e9a5b-0ba4-4d96-be4a-f9d95bc84d63 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:42.100395 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-b68e9a5b-0ba4-4d96-be4a-f9d95bc84d63 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:42.108342 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-b68e9a5b-0ba4-4d96-be4a-f9d95bc84d63 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.149651 May 24 15:38:42.108907 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 985/1949] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:41 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:38:42.351008 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-8576ee97-a12a-41b6-b033-a0f9cd6b3a8f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:42.351549 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-8576ee97-a12a-41b6-b033-a0f9cd6b3a8f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:42.357584 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8576ee97-a12a-41b6-b033-a0f9cd6b3a8f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:42.358037 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8576ee97-a12a-41b6-b033-a0f9cd6b3a8f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:42.358796 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8576ee97-a12a-41b6-b033-a0f9cd6b3a8f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:42.359233 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8576ee97-a12a-41b6-b033-a0f9cd6b3a8f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:42.484407 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-8576ee97-a12a-41b6-b033-a0f9cd6b3a8f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:42.492600 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-8576ee97-a12a-41b6-b033-a0f9cd6b3a8f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.146148 May 24 15:38:42.493175 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 965/1950] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:42 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:42.882396 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-f2f05936-3957-40bc-bc54-a869788eac39 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:42.883007 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-f2f05936-3957-40bc-bc54-a869788eac39 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:42.889625 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f2f05936-3957-40bc-bc54-a869788eac39 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:42.890077 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f2f05936-3957-40bc-bc54-a869788eac39 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:42.890813 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f2f05936-3957-40bc-bc54-a869788eac39 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:42.891242 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f2f05936-3957-40bc-bc54-a869788eac39 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:42.953034 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-f2f05936-3957-40bc-bc54-a869788eac39 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:42.962190 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-f2f05936-3957-40bc-bc54-a869788eac39 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:42.963688 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-f2f05936-3957-40bc-bc54-a869788eac39 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:42.964863 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-f2f05936-3957-40bc-bc54-a869788eac39 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.086869 May 24 15:38:42.965426 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 986/1951] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:38:42 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:38:42.982692 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-3175105c-1550-4f4d-8f72-e81cf7c6bfc6 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:42.983298 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-3175105c-1550-4f4d-8f72-e81cf7c6bfc6 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:42.989821 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3175105c-1550-4f4d-8f72-e81cf7c6bfc6 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:42.990511 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3175105c-1550-4f4d-8f72-e81cf7c6bfc6 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:42.991260 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3175105c-1550-4f4d-8f72-e81cf7c6bfc6 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:42.991686 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3175105c-1550-4f4d-8f72-e81cf7c6bfc6 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:43.123067 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-3175105c-1550-4f4d-8f72-e81cf7c6bfc6 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:43.125292 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-f5a7d3e6-e71c-40f3-97aa-67238e11e97d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:43.125896 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-f5a7d3e6-e71c-40f3-97aa-67238e11e97d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:43.132014 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-3175105c-1550-4f4d-8f72-e81cf7c6bfc6 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.153059 May 24 15:38:43.132557 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f5a7d3e6-e71c-40f3-97aa-67238e11e97d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:43.132672 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 966/1952] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:42 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:43.132946 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f5a7d3e6-e71c-40f3-97aa-67238e11e97d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:43.133773 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f5a7d3e6-e71c-40f3-97aa-67238e11e97d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:43.134213 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f5a7d3e6-e71c-40f3-97aa-67238e11e97d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:43.256796 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-f5a7d3e6-e71c-40f3-97aa-67238e11e97d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:43.264561 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-f5a7d3e6-e71c-40f3-97aa-67238e11e97d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.143005 May 24 15:38:43.265119 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 987/1953] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:43 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:38:43.509272 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f9df6d02-a075-44b2-91fa-01d548797376 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:43.509877 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f9df6d02-a075-44b2-91fa-01d548797376 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:43.515879 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f9df6d02-a075-44b2-91fa-01d548797376 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:43.516351 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f9df6d02-a075-44b2-91fa-01d548797376 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:43.517105 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f9df6d02-a075-44b2-91fa-01d548797376 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:43.517533 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f9df6d02-a075-44b2-91fa-01d548797376 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:43.642588 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-f9df6d02-a075-44b2-91fa-01d548797376 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:43.650664 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f9df6d02-a075-44b2-91fa-01d548797376 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.145208 May 24 15:38:43.651273 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 967/1954] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:43 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:43.982064 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-186c4b0d-532f-464e-a4db-2a6379ecfd19 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:43.982708 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-186c4b0d-532f-464e-a4db-2a6379ecfd19 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:43.989262 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-186c4b0d-532f-464e-a4db-2a6379ecfd19 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:43.989710 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-186c4b0d-532f-464e-a4db-2a6379ecfd19 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:43.990720 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-186c4b0d-532f-464e-a4db-2a6379ecfd19 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:43.991153 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-186c4b0d-532f-464e-a4db-2a6379ecfd19 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:44.024904 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 15:38:44.025467 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Tue May 24 15:38:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 15:38:44.054301 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-186c4b0d-532f-464e-a4db-2a6379ecfd19 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:44.062746 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-186c4b0d-532f-464e-a4db-2a6379ecfd19 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:44.064238 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-186c4b0d-532f-464e-a4db-2a6379ecfd19 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:44.065414 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-186c4b0d-532f-464e-a4db-2a6379ecfd19 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.087221 May 24 15:38:44.065970 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 988/1955] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:38:43 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:38:44.149442 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-444d0c32-8ef7-49a6-acb1-b12b9d33bee1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:44.150060 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-444d0c32-8ef7-49a6-acb1-b12b9d33bee1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:44.156672 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-444d0c32-8ef7-49a6-acb1-b12b9d33bee1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:44.157124 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-444d0c32-8ef7-49a6-acb1-b12b9d33bee1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:44.157883 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-444d0c32-8ef7-49a6-acb1-b12b9d33bee1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:44.158318 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-444d0c32-8ef7-49a6-acb1-b12b9d33bee1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:44.281217 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-fa331809-33fd-45da-affb-6905d138fe3f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:44.281827 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-fa331809-33fd-45da-affb-6905d138fe3f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:44.287824 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fa331809-33fd-45da-affb-6905d138fe3f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:44.288257 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fa331809-33fd-45da-affb-6905d138fe3f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:44.289051 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fa331809-33fd-45da-affb-6905d138fe3f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:44.289487 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fa331809-33fd-45da-affb-6905d138fe3f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:44.289637 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-444d0c32-8ef7-49a6-acb1-b12b9d33bee1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:44.297565 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-444d0c32-8ef7-49a6-acb1-b12b9d33bee1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.152614 May 24 15:38:44.298165 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 968/1956] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:44 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:44.416606 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-fa331809-33fd-45da-affb-6905d138fe3f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:44.424667 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-fa331809-33fd-45da-affb-6905d138fe3f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.147279 May 24 15:38:44.425235 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 989/1957] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:44 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:38:44.667537 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-fbfd1a87-99cb-4cef-a031-994ddb97e8fb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:44.668070 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-fbfd1a87-99cb-4cef-a031-994ddb97e8fb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:44.674103 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fbfd1a87-99cb-4cef-a031-994ddb97e8fb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:44.674555 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fbfd1a87-99cb-4cef-a031-994ddb97e8fb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:44.675314 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fbfd1a87-99cb-4cef-a031-994ddb97e8fb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:44.675751 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fbfd1a87-99cb-4cef-a031-994ddb97e8fb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:44.799167 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-fbfd1a87-99cb-4cef-a031-994ddb97e8fb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:44.807911 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-fbfd1a87-99cb-4cef-a031-994ddb97e8fb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.144279 May 24 15:38:44.808503 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 969/1958] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:44 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:45.082909 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-839034f3-3c0c-4dab-93e4-919190da4064 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:45.083515 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-839034f3-3c0c-4dab-93e4-919190da4064 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:45.090078 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-839034f3-3c0c-4dab-93e4-919190da4064 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:45.090526 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-839034f3-3c0c-4dab-93e4-919190da4064 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:45.091279 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-839034f3-3c0c-4dab-93e4-919190da4064 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:45.091711 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-839034f3-3c0c-4dab-93e4-919190da4064 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:45.152110 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-839034f3-3c0c-4dab-93e4-919190da4064 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:45.160444 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-839034f3-3c0c-4dab-93e4-919190da4064 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:45.162479 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-839034f3-3c0c-4dab-93e4-919190da4064 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:45.163613 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-839034f3-3c0c-4dab-93e4-919190da4064 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084617 May 24 15:38:45.164166 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 990/1959] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:38:45 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:38:45.314301 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-3236ebd2-57bf-46cb-ae15-5ad24a22edd7 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:45.314916 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-3236ebd2-57bf-46cb-ae15-5ad24a22edd7 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:45.321429 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3236ebd2-57bf-46cb-ae15-5ad24a22edd7 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:45.321879 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3236ebd2-57bf-46cb-ae15-5ad24a22edd7 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:45.322644 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3236ebd2-57bf-46cb-ae15-5ad24a22edd7 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:45.323081 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3236ebd2-57bf-46cb-ae15-5ad24a22edd7 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:45.441487 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-b1f50d87-d2b6-4af3-8b23-af327ceb74a2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:45.442129 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-b1f50d87-d2b6-4af3-8b23-af327ceb74a2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:45.448480 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b1f50d87-d2b6-4af3-8b23-af327ceb74a2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:45.448930 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b1f50d87-d2b6-4af3-8b23-af327ceb74a2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:45.449192 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-3236ebd2-57bf-46cb-ae15-5ad24a22edd7 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:45.449695 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b1f50d87-d2b6-4af3-8b23-af327ceb74a2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:45.450127 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b1f50d87-d2b6-4af3-8b23-af327ceb74a2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:45.457329 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-3236ebd2-57bf-46cb-ae15-5ad24a22edd7 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.146844 May 24 15:38:45.465084 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 970/1960] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:45 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:45.582592 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-b1f50d87-d2b6-4af3-8b23-af327ceb74a2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:45.591084 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-b1f50d87-d2b6-4af3-8b23-af327ceb74a2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.153443 May 24 15:38:45.591642 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 991/1961] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:45 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:38:45.825450 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-47e155c2-e052-4e08-9a91-754109e9d2c6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:45.826118 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-47e155c2-e052-4e08-9a91-754109e9d2c6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:45.832065 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-47e155c2-e052-4e08-9a91-754109e9d2c6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:45.832560 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-47e155c2-e052-4e08-9a91-754109e9d2c6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:45.833884 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-47e155c2-e052-4e08-9a91-754109e9d2c6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:45.834343 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-47e155c2-e052-4e08-9a91-754109e9d2c6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:45.838230 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:38:45.962118 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-47e155c2-e052-4e08-9a91-754109e9d2c6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:45.970060 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-47e155c2-e052-4e08-9a91-754109e9d2c6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.148522 May 24 15:38:45.970676 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 971/1962] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:45 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:46.182045 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-ac972a98-284d-4dc2-94af-f3f610111e16 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:46.182581 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-ac972a98-284d-4dc2-94af-f3f610111e16 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:46.189073 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ac972a98-284d-4dc2-94af-f3f610111e16 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:46.189519 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ac972a98-284d-4dc2-94af-f3f610111e16 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:46.190266 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ac972a98-284d-4dc2-94af-f3f610111e16 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:46.190693 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ac972a98-284d-4dc2-94af-f3f610111e16 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:46.250431 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ac972a98-284d-4dc2-94af-f3f610111e16 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:46.259349 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ac972a98-284d-4dc2-94af-f3f610111e16 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:46.260867 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ac972a98-284d-4dc2-94af-f3f610111e16 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:46.261992 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-ac972a98-284d-4dc2-94af-f3f610111e16 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.083953 May 24 15:38:46.262540 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 992/1963] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:38:46 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:38:46.263607 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 15:38:46.263749 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Tue May 24 15:38:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 15:38:46.482103 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f80e47d3-0697-4fc7-889b-3cf452f58615 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:46.482754 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f80e47d3-0697-4fc7-889b-3cf452f58615 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:46.489311 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f80e47d3-0697-4fc7-889b-3cf452f58615 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:46.489764 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f80e47d3-0697-4fc7-889b-3cf452f58615 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:46.490782 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f80e47d3-0697-4fc7-889b-3cf452f58615 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:46.491221 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f80e47d3-0697-4fc7-889b-3cf452f58615 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:46.609203 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-40f25bac-355b-4f09-9543-a107a4ac155a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:46.609953 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-40f25bac-355b-4f09-9543-a107a4ac155a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:46.616601 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-40f25bac-355b-4f09-9543-a107a4ac155a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:46.617078 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-40f25bac-355b-4f09-9543-a107a4ac155a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:46.617838 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-40f25bac-355b-4f09-9543-a107a4ac155a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:46.618048 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-f80e47d3-0697-4fc7-889b-3cf452f58615 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:46.618266 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-40f25bac-355b-4f09-9543-a107a4ac155a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:46.626027 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f80e47d3-0697-4fc7-889b-3cf452f58615 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.147826 May 24 15:38:46.626577 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 972/1964] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:46 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:46.741913 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-40f25bac-355b-4f09-9543-a107a4ac155a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:46.749714 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-40f25bac-355b-4f09-9543-a107a4ac155a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.144358 May 24 15:38:46.750265 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 993/1965] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:46 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:38:46.986654 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-4b612e15-a3c6-4c35-842b-9f6a6e280e66 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:46.987263 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-4b612e15-a3c6-4c35-842b-9f6a6e280e66 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:46.994194 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4b612e15-a3c6-4c35-842b-9f6a6e280e66 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:46.994580 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4b612e15-a3c6-4c35-842b-9f6a6e280e66 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:46.995327 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4b612e15-a3c6-4c35-842b-9f6a6e280e66 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:46.995753 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4b612e15-a3c6-4c35-842b-9f6a6e280e66 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:47.129138 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-4b612e15-a3c6-4c35-842b-9f6a6e280e66 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:47.137780 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-4b612e15-a3c6-4c35-842b-9f6a6e280e66 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.154947 May 24 15:38:47.138343 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 973/1966] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:46 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:47.278820 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-6c3474be-911f-4efb-af1d-8fd548c6622c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:47.279367 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-6c3474be-911f-4efb-af1d-8fd548c6622c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:47.286424 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6c3474be-911f-4efb-af1d-8fd548c6622c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:47.286870 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6c3474be-911f-4efb-af1d-8fd548c6622c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:47.287623 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6c3474be-911f-4efb-af1d-8fd548c6622c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:47.288054 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6c3474be-911f-4efb-af1d-8fd548c6622c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:47.352763 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-6c3474be-911f-4efb-af1d-8fd548c6622c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:47.361361 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-6c3474be-911f-4efb-af1d-8fd548c6622c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:47.362852 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-6c3474be-911f-4efb-af1d-8fd548c6622c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:47.364657 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-6c3474be-911f-4efb-af1d-8fd548c6622c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.089070 May 24 15:38:47.365212 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 994/1967] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:38:47 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:38:47.642574 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-99e0df5e-8fe1-469a-a3b8-b157ffe3e404 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:47.643118 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-99e0df5e-8fe1-469a-a3b8-b157ffe3e404 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:47.650177 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-99e0df5e-8fe1-469a-a3b8-b157ffe3e404 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:47.650617 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-99e0df5e-8fe1-469a-a3b8-b157ffe3e404 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:47.651376 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-99e0df5e-8fe1-469a-a3b8-b157ffe3e404 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:47.651807 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-99e0df5e-8fe1-469a-a3b8-b157ffe3e404 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:47.766830 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-b04a1e47-fe62-441b-949a-90577a5d0c8f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:47.767444 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-b04a1e47-fe62-441b-949a-90577a5d0c8f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:47.773910 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b04a1e47-fe62-441b-949a-90577a5d0c8f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:47.774356 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b04a1e47-fe62-441b-949a-90577a5d0c8f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:47.775129 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b04a1e47-fe62-441b-949a-90577a5d0c8f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:47.775559 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b04a1e47-fe62-441b-949a-90577a5d0c8f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:47.778468 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-99e0df5e-8fe1-469a-a3b8-b157ffe3e404 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:47.787129 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-99e0df5e-8fe1-469a-a3b8-b157ffe3e404 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.148457 May 24 15:38:47.787784 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 974/1968] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:47 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:47.899104 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-b04a1e47-fe62-441b-949a-90577a5d0c8f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:47.902504 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:38:47.907912 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-b04a1e47-fe62-441b-949a-90577a5d0c8f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.144937 May 24 15:38:47.908506 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 995/1969] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:47 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:38:48.154562 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-9c39a20f-7c6b-4c7d-90e9-5606e5fc8a7f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:48.155112 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-9c39a20f-7c6b-4c7d-90e9-5606e5fc8a7f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:48.161707 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9c39a20f-7c6b-4c7d-90e9-5606e5fc8a7f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:48.162149 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9c39a20f-7c6b-4c7d-90e9-5606e5fc8a7f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:48.162904 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9c39a20f-7c6b-4c7d-90e9-5606e5fc8a7f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:48.163336 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9c39a20f-7c6b-4c7d-90e9-5606e5fc8a7f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:48.288407 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-9c39a20f-7c6b-4c7d-90e9-5606e5fc8a7f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:48.296388 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-9c39a20f-7c6b-4c7d-90e9-5606e5fc8a7f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.145660 May 24 15:38:48.296957 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 975/1970] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:48 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:48.382267 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-8dc66b5b-29b9-43ad-a8b8-af7769c29918 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:48.383012 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-8dc66b5b-29b9-43ad-a8b8-af7769c29918 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:48.389775 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8dc66b5b-29b9-43ad-a8b8-af7769c29918 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:48.390227 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8dc66b5b-29b9-43ad-a8b8-af7769c29918 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:48.390992 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8dc66b5b-29b9-43ad-a8b8-af7769c29918 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:48.391426 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8dc66b5b-29b9-43ad-a8b8-af7769c29918 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:48.452065 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-8dc66b5b-29b9-43ad-a8b8-af7769c29918 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:48.461045 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-8dc66b5b-29b9-43ad-a8b8-af7769c29918 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:48.462586 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-8dc66b5b-29b9-43ad-a8b8-af7769c29918 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:48.463727 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-8dc66b5b-29b9-43ad-a8b8-af7769c29918 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.085392 May 24 15:38:48.464285 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 996/1971] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:38:48 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:38:48.803580 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-c5f6f066-a223-481d-bc03-b28255ef2aac tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:48.804191 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-c5f6f066-a223-481d-bc03-b28255ef2aac tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:48.810737 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c5f6f066-a223-481d-bc03-b28255ef2aac tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:48.811185 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c5f6f066-a223-481d-bc03-b28255ef2aac tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:48.811942 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c5f6f066-a223-481d-bc03-b28255ef2aac tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:48.812403 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c5f6f066-a223-481d-bc03-b28255ef2aac tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:48.926201 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c133e6ce-6a5e-44f1-b841-41d3178d19e2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:48.926914 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-c133e6ce-6a5e-44f1-b841-41d3178d19e2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:48.933030 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c133e6ce-6a5e-44f1-b841-41d3178d19e2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:48.933548 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c133e6ce-6a5e-44f1-b841-41d3178d19e2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:48.934377 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c133e6ce-6a5e-44f1-b841-41d3178d19e2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:48.935200 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c133e6ce-6a5e-44f1-b841-41d3178d19e2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:48.947546 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-c5f6f066-a223-481d-bc03-b28255ef2aac tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:48.955497 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-c5f6f066-a223-481d-bc03-b28255ef2aac tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.155780 May 24 15:38:48.956071 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 976/1972] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:48 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:49.063914 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-c133e6ce-6a5e-44f1-b841-41d3178d19e2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:49.072382 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-c133e6ce-6a5e-44f1-b841-41d3178d19e2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.150104 May 24 15:38:49.072942 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 997/1973] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:48 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:38:49.313148 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-8d0a3a14-58b8-4d25-8e6b-d3a2f9a92575 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:49.313685 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-8d0a3a14-58b8-4d25-8e6b-d3a2f9a92575 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:49.320644 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8d0a3a14-58b8-4d25-8e6b-d3a2f9a92575 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:49.321097 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8d0a3a14-58b8-4d25-8e6b-d3a2f9a92575 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:49.321867 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8d0a3a14-58b8-4d25-8e6b-d3a2f9a92575 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:49.322298 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8d0a3a14-58b8-4d25-8e6b-d3a2f9a92575 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:49.447504 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-8d0a3a14-58b8-4d25-8e6b-d3a2f9a92575 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:49.455303 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-8d0a3a14-58b8-4d25-8e6b-d3a2f9a92575 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.146064 May 24 15:38:49.455863 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 977/1974] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:49 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:49.481992 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-0b4e8d2a-baa0-42fa-99fd-b351c3dff168 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:49.482597 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-0b4e8d2a-baa0-42fa-99fd-b351c3dff168 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:49.489914 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0b4e8d2a-baa0-42fa-99fd-b351c3dff168 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:49.490630 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0b4e8d2a-baa0-42fa-99fd-b351c3dff168 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:49.491387 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0b4e8d2a-baa0-42fa-99fd-b351c3dff168 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:49.491820 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0b4e8d2a-baa0-42fa-99fd-b351c3dff168 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:49.553090 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-0b4e8d2a-baa0-42fa-99fd-b351c3dff168 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:49.561390 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-0b4e8d2a-baa0-42fa-99fd-b351c3dff168 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:49.562972 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-0b4e8d2a-baa0-42fa-99fd-b351c3dff168 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:49.564157 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-0b4e8d2a-baa0-42fa-99fd-b351c3dff168 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.085974 May 24 15:38:49.564691 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 998/1975] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:38:49 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:38:49.974271 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e8c2b1ee-1213-4f06-b437-d3521ecb9a14 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:49.974885 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-e8c2b1ee-1213-4f06-b437-d3521ecb9a14 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:49.981396 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e8c2b1ee-1213-4f06-b437-d3521ecb9a14 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:49.981839 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e8c2b1ee-1213-4f06-b437-d3521ecb9a14 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:49.982596 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e8c2b1ee-1213-4f06-b437-d3521ecb9a14 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:49.983027 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e8c2b1ee-1213-4f06-b437-d3521ecb9a14 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:50.089479 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-25fdec31-418f-44ab-a14f-9f02507860a4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:50.090094 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-25fdec31-418f-44ab-a14f-9f02507860a4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:50.096617 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-25fdec31-418f-44ab-a14f-9f02507860a4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:50.097058 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-25fdec31-418f-44ab-a14f-9f02507860a4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:50.097876 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-25fdec31-418f-44ab-a14f-9f02507860a4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:50.098878 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-25fdec31-418f-44ab-a14f-9f02507860a4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:50.113279 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-e8c2b1ee-1213-4f06-b437-d3521ecb9a14 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:50.121587 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-e8c2b1ee-1213-4f06-b437-d3521ecb9a14 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.151812 May 24 15:38:50.122161 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 978/1976] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:49 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:50.222316 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-25fdec31-418f-44ab-a14f-9f02507860a4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:50.231049 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-25fdec31-418f-44ab-a14f-9f02507860a4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.145274 May 24 15:38:50.231558 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 999/1977] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:50 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:38:50.473424 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-053c4d2e-5cc6-4fff-b0de-6aec7471c4b5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:50.474029 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-053c4d2e-5cc6-4fff-b0de-6aec7471c4b5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:50.479977 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-053c4d2e-5cc6-4fff-b0de-6aec7471c4b5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:50.480447 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-053c4d2e-5cc6-4fff-b0de-6aec7471c4b5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:50.481274 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-053c4d2e-5cc6-4fff-b0de-6aec7471c4b5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:50.481652 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-053c4d2e-5cc6-4fff-b0de-6aec7471c4b5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:50.582282 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d318be9d-9228-4abc-828a-5f34826f89c1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:50.583463 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d318be9d-9228-4abc-828a-5f34826f89c1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:50.589908 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d318be9d-9228-4abc-828a-5f34826f89c1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:50.590358 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d318be9d-9228-4abc-828a-5f34826f89c1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:50.591120 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d318be9d-9228-4abc-828a-5f34826f89c1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:50.591555 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d318be9d-9228-4abc-828a-5f34826f89c1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:50.609149 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-053c4d2e-5cc6-4fff-b0de-6aec7471c4b5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:50.617685 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-053c4d2e-5cc6-4fff-b0de-6aec7471c4b5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.148108 May 24 15:38:50.626985 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 979/1978] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:50 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:50.656920 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-d318be9d-9228-4abc-828a-5f34826f89c1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:50.665221 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-d318be9d-9228-4abc-828a-5f34826f89c1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:50.666697 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-d318be9d-9228-4abc-828a-5f34826f89c1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:50.667828 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d318be9d-9228-4abc-828a-5f34826f89c1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.089467 May 24 15:38:50.668406 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1000/1979] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:38:50 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:38:51.138468 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f645919c-2ede-4ba5-9cc6-efa683bbad2b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:51.139073 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f645919c-2ede-4ba5-9cc6-efa683bbad2b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:51.145561 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f645919c-2ede-4ba5-9cc6-efa683bbad2b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:51.146029 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f645919c-2ede-4ba5-9cc6-efa683bbad2b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:51.146786 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f645919c-2ede-4ba5-9cc6-efa683bbad2b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:51.147213 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f645919c-2ede-4ba5-9cc6-efa683bbad2b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:51.247031 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e6fdf1c6-a6e5-48fd-9ce6-ae03d2e8f3ca tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:51.247759 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e6fdf1c6-a6e5-48fd-9ce6-ae03d2e8f3ca tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:51.253836 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e6fdf1c6-a6e5-48fd-9ce6-ae03d2e8f3ca tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:51.254414 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e6fdf1c6-a6e5-48fd-9ce6-ae03d2e8f3ca tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:51.255279 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e6fdf1c6-a6e5-48fd-9ce6-ae03d2e8f3ca tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:51.255785 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e6fdf1c6-a6e5-48fd-9ce6-ae03d2e8f3ca tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:51.277180 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-f645919c-2ede-4ba5-9cc6-efa683bbad2b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:51.285092 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f645919c-2ede-4ba5-9cc6-efa683bbad2b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.150503 May 24 15:38:51.288861 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 980/1980] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:51 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:51.379340 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e6fdf1c6-a6e5-48fd-9ce6-ae03d2e8f3ca tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:51.387305 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e6fdf1c6-a6e5-48fd-9ce6-ae03d2e8f3ca tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.144100 May 24 15:38:51.387871 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1001/1981] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:51 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:38:51.634116 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-9a40d328-7b37-4a91-971c-ea069312ad09 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:51.634636 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-9a40d328-7b37-4a91-971c-ea069312ad09 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:51.640633 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9a40d328-7b37-4a91-971c-ea069312ad09 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:51.641103 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9a40d328-7b37-4a91-971c-ea069312ad09 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:51.641860 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9a40d328-7b37-4a91-971c-ea069312ad09 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:51.642285 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9a40d328-7b37-4a91-971c-ea069312ad09 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:51.686131 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-f8305858-17b1-4035-8245-6d7b829cf6e3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:51.686830 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-f8305858-17b1-4035-8245-6d7b829cf6e3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:51.693417 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f8305858-17b1-4035-8245-6d7b829cf6e3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:51.693863 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f8305858-17b1-4035-8245-6d7b829cf6e3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:51.694621 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f8305858-17b1-4035-8245-6d7b829cf6e3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:51.695058 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f8305858-17b1-4035-8245-6d7b829cf6e3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:51.756194 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-f8305858-17b1-4035-8245-6d7b829cf6e3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:51.764665 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-f8305858-17b1-4035-8245-6d7b829cf6e3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:51.766158 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-f8305858-17b1-4035-8245-6d7b829cf6e3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:51.767300 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-f8305858-17b1-4035-8245-6d7b829cf6e3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.085055 May 24 15:38:51.768111 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1002/1982] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:38:51 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:38:51.769425 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-9a40d328-7b37-4a91-971c-ea069312ad09 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:51.777993 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-9a40d328-7b37-4a91-971c-ea069312ad09 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.147849 May 24 15:38:51.778573 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 981/1983] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:51 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:52.302573 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-0b0c0f6e-64a3-4044-9e17-a2cf59efe24d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:52.303186 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-0b0c0f6e-64a3-4044-9e17-a2cf59efe24d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:52.309259 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0b0c0f6e-64a3-4044-9e17-a2cf59efe24d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:52.309702 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0b0c0f6e-64a3-4044-9e17-a2cf59efe24d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:52.310460 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0b0c0f6e-64a3-4044-9e17-a2cf59efe24d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:52.310890 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0b0c0f6e-64a3-4044-9e17-a2cf59efe24d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:52.404635 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-36684e44-58bc-47b8-a904-0c3bb1c75991 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:52.405256 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-36684e44-58bc-47b8-a904-0c3bb1c75991 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:52.411738 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-36684e44-58bc-47b8-a904-0c3bb1c75991 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:52.412184 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-36684e44-58bc-47b8-a904-0c3bb1c75991 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:52.412994 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-36684e44-58bc-47b8-a904-0c3bb1c75991 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:52.413428 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-36684e44-58bc-47b8-a904-0c3bb1c75991 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:52.441169 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-0b0c0f6e-64a3-4044-9e17-a2cf59efe24d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:52.449899 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-0b0c0f6e-64a3-4044-9e17-a2cf59efe24d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.151639 May 24 15:38:52.450468 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1003/1984] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:52 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:52.540274 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-36684e44-58bc-47b8-a904-0c3bb1c75991 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:52.548054 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-36684e44-58bc-47b8-a904-0c3bb1c75991 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.147396 May 24 15:38:52.548656 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 982/1985] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:52 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:38:52.785508 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-ceda2703-35ba-43ce-8f36-b1e37ddc2cd6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:52.786622 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-ceda2703-35ba-43ce-8f36-b1e37ddc2cd6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:52.793112 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ceda2703-35ba-43ce-8f36-b1e37ddc2cd6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:52.793569 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ceda2703-35ba-43ce-8f36-b1e37ddc2cd6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:52.794337 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ceda2703-35ba-43ce-8f36-b1e37ddc2cd6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:52.794566 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-3b33bae7-5434-492c-9080-cfcdb1311c25 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:52.794773 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ceda2703-35ba-43ce-8f36-b1e37ddc2cd6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:52.795196 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-3b33bae7-5434-492c-9080-cfcdb1311c25 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:52.801121 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3b33bae7-5434-492c-9080-cfcdb1311c25 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:52.802148 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3b33bae7-5434-492c-9080-cfcdb1311c25 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:52.802934 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3b33bae7-5434-492c-9080-cfcdb1311c25 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:52.803370 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3b33bae7-5434-492c-9080-cfcdb1311c25 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:52.858004 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ceda2703-35ba-43ce-8f36-b1e37ddc2cd6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:52.867218 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ceda2703-35ba-43ce-8f36-b1e37ddc2cd6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:52.868773 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ceda2703-35ba-43ce-8f36-b1e37ddc2cd6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:52.869930 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-ceda2703-35ba-43ce-8f36-b1e37ddc2cd6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.088399 May 24 15:38:52.870494 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1004/1986] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:38:52 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:38:52.936348 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-3b33bae7-5434-492c-9080-cfcdb1311c25 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:52.944418 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-3b33bae7-5434-492c-9080-cfcdb1311c25 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.153705 May 24 15:38:52.944984 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 983/1987] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:52 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:38:53.466834 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-406e07c7-f734-4c83-9e1d-559bef458184 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:53.467448 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-406e07c7-f734-4c83-9e1d-559bef458184 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:53.473494 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-406e07c7-f734-4c83-9e1d-559bef458184 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:53.473933 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-406e07c7-f734-4c83-9e1d-559bef458184 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:53.474720 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-406e07c7-f734-4c83-9e1d-559bef458184 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:53.475149 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-406e07c7-f734-4c83-9e1d-559bef458184 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:53.565878 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-02119160-e970-4ca2-babe-69629a082b59 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:53.566490 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-02119160-e970-4ca2-babe-69629a082b59 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:53.573689 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-02119160-e970-4ca2-babe-69629a082b59 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:53.574138 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-02119160-e970-4ca2-babe-69629a082b59 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:53.574913 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-02119160-e970-4ca2-babe-69629a082b59 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:53.575349 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-02119160-e970-4ca2-babe-69629a082b59 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:53.602107 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-406e07c7-f734-4c83-9e1d-559bef458184 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:53.611233 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-406e07c7-f734-4c83-9e1d-559bef458184 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.148303 May 24 15:38:53.620865 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1005/1988] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:53 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:53.702852 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-02119160-e970-4ca2-babe-69629a082b59 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:53.710755 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-02119160-e970-4ca2-babe-69629a082b59 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.148803 May 24 15:38:53.711312 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 984/1989] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:53 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:38:53.887059 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-b0c16785-0ed3-42ab-b069-5ae2fbac2967 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:53.887591 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-b0c16785-0ed3-42ab-b069-5ae2fbac2967 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:53.894058 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b0c16785-0ed3-42ab-b069-5ae2fbac2967 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:53.894495 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b0c16785-0ed3-42ab-b069-5ae2fbac2967 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:53.895242 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b0c16785-0ed3-42ab-b069-5ae2fbac2967 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:53.895670 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b0c16785-0ed3-42ab-b069-5ae2fbac2967 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:53.959408 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-b0c16785-0ed3-42ab-b069-5ae2fbac2967 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:53.961314 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-eb1a4233-b1e2-4009-935b-06c5cc3a35ac tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:53.961928 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-eb1a4233-b1e2-4009-935b-06c5cc3a35ac tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:53.967883 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-eb1a4233-b1e2-4009-935b-06c5cc3a35ac tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:53.968043 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-b0c16785-0ed3-42ab-b069-5ae2fbac2967 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:53.968349 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-eb1a4233-b1e2-4009-935b-06c5cc3a35ac tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:53.969116 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-eb1a4233-b1e2-4009-935b-06c5cc3a35ac tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:53.969442 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-b0c16785-0ed3-42ab-b069-5ae2fbac2967 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:53.969554 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-eb1a4233-b1e2-4009-935b-06c5cc3a35ac tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:53.970571 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-b0c16785-0ed3-42ab-b069-5ae2fbac2967 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.087475 May 24 15:38:53.971120 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1006/1990] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:38:53 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:38:54.097793 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-eb1a4233-b1e2-4009-935b-06c5cc3a35ac tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:54.106282 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-eb1a4233-b1e2-4009-935b-06c5cc3a35ac tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.148883 May 24 15:38:54.106846 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 985/1991] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:53 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:38:54.629201 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-71cb75cb-2c6f-4982-90d7-3bce7daec660 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:54.629801 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-71cb75cb-2c6f-4982-90d7-3bce7daec660 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:54.635772 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-71cb75cb-2c6f-4982-90d7-3bce7daec660 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:54.636215 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-71cb75cb-2c6f-4982-90d7-3bce7daec660 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:54.636992 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-71cb75cb-2c6f-4982-90d7-3bce7daec660 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:54.637448 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-71cb75cb-2c6f-4982-90d7-3bce7daec660 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:54.727525 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-602ab546-2d4c-484d-958a-b5e7946832af tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:54.728151 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-602ab546-2d4c-484d-958a-b5e7946832af tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:54.734696 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-602ab546-2d4c-484d-958a-b5e7946832af tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:54.735144 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-602ab546-2d4c-484d-958a-b5e7946832af tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:54.735906 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-602ab546-2d4c-484d-958a-b5e7946832af tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:54.736485 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-602ab546-2d4c-484d-958a-b5e7946832af tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:54.762467 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-71cb75cb-2c6f-4982-90d7-3bce7daec660 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:54.771321 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-71cb75cb-2c6f-4982-90d7-3bce7daec660 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.145925 May 24 15:38:54.771906 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1007/1992] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:54 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:54.863167 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-602ab546-2d4c-484d-958a-b5e7946832af tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:54.871461 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-602ab546-2d4c-484d-958a-b5e7946832af tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.148491 May 24 15:38:54.872019 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 986/1993] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:54 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:38:54.988727 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-2d77465c-acab-4af9-aae7-817e3c4d1b0b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:54.989343 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-2d77465c-acab-4af9-aae7-817e3c4d1b0b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:54.996024 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2d77465c-acab-4af9-aae7-817e3c4d1b0b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:54.996518 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2d77465c-acab-4af9-aae7-817e3c4d1b0b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:54.997279 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2d77465c-acab-4af9-aae7-817e3c4d1b0b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:54.997715 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2d77465c-acab-4af9-aae7-817e3c4d1b0b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:55.057743 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-2d77465c-acab-4af9-aae7-817e3c4d1b0b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:55.066124 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-2d77465c-acab-4af9-aae7-817e3c4d1b0b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:55.068173 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-2d77465c-acab-4af9-aae7-817e3c4d1b0b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:55.069342 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-2d77465c-acab-4af9-aae7-817e3c4d1b0b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084552 May 24 15:38:55.069903 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1008/1994] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:38:54 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:38:55.123833 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-ddd1be2b-0bd3-4d86-9b55-2af0bb88ae79 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:55.124467 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-ddd1be2b-0bd3-4d86-9b55-2af0bb88ae79 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:55.131069 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ddd1be2b-0bd3-4d86-9b55-2af0bb88ae79 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:55.131507 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ddd1be2b-0bd3-4d86-9b55-2af0bb88ae79 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:55.132256 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ddd1be2b-0bd3-4d86-9b55-2af0bb88ae79 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:55.132710 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ddd1be2b-0bd3-4d86-9b55-2af0bb88ae79 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:55.258676 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-ddd1be2b-0bd3-4d86-9b55-2af0bb88ae79 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:55.262119 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:38:55.267747 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-ddd1be2b-0bd3-4d86-9b55-2af0bb88ae79 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.147705 May 24 15:38:55.268341 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 987/1995] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:55 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:55.788642 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-3f3c7fa9-93d8-4ad2-a3bb-5a7c7f12edd6 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:55.789271 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-3f3c7fa9-93d8-4ad2-a3bb-5a7c7f12edd6 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:55.795300 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3f3c7fa9-93d8-4ad2-a3bb-5a7c7f12edd6 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:55.795744 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3f3c7fa9-93d8-4ad2-a3bb-5a7c7f12edd6 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:55.796530 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3f3c7fa9-93d8-4ad2-a3bb-5a7c7f12edd6 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:55.796966 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3f3c7fa9-93d8-4ad2-a3bb-5a7c7f12edd6 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:55.890882 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f7e88c22-f17b-4021-ba35-94ee22dea82f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:55.891597 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f7e88c22-f17b-4021-ba35-94ee22dea82f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:55.899043 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f7e88c22-f17b-4021-ba35-94ee22dea82f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:55.899515 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f7e88c22-f17b-4021-ba35-94ee22dea82f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:55.900278 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f7e88c22-f17b-4021-ba35-94ee22dea82f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:55.900732 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f7e88c22-f17b-4021-ba35-94ee22dea82f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:55.927271 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-3f3c7fa9-93d8-4ad2-a3bb-5a7c7f12edd6 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:55.935384 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-3f3c7fa9-93d8-4ad2-a3bb-5a7c7f12edd6 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.151126 May 24 15:38:55.936045 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1009/1996] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:55 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:56.029921 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-f7e88c22-f17b-4021-ba35-94ee22dea82f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:56.038457 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f7e88c22-f17b-4021-ba35-94ee22dea82f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.151460 May 24 15:38:56.039085 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 988/1997] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:55 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:38:56.087380 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-42b7044e-8c75-48cf-8414-03f47a85dad8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:56.087992 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-42b7044e-8c75-48cf-8414-03f47a85dad8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:56.094485 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-42b7044e-8c75-48cf-8414-03f47a85dad8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:56.094940 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-42b7044e-8c75-48cf-8414-03f47a85dad8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:56.095701 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-42b7044e-8c75-48cf-8414-03f47a85dad8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:56.096140 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-42b7044e-8c75-48cf-8414-03f47a85dad8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:56.156186 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-42b7044e-8c75-48cf-8414-03f47a85dad8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:56.165129 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-42b7044e-8c75-48cf-8414-03f47a85dad8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:56.166619 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-42b7044e-8c75-48cf-8414-03f47a85dad8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:56.167765 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-42b7044e-8c75-48cf-8414-03f47a85dad8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084245 May 24 15:38:56.168339 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1010/1998] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:38:56 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:38:56.284596 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-0c81a73f-7f1c-4c2b-b541-d4e7dd89fede tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:56.285211 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-0c81a73f-7f1c-4c2b-b541-d4e7dd89fede tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:56.291226 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0c81a73f-7f1c-4c2b-b541-d4e7dd89fede tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:56.291612 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0c81a73f-7f1c-4c2b-b541-d4e7dd89fede tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:56.292395 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0c81a73f-7f1c-4c2b-b541-d4e7dd89fede tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:56.292832 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0c81a73f-7f1c-4c2b-b541-d4e7dd89fede tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:56.418105 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-0c81a73f-7f1c-4c2b-b541-d4e7dd89fede tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:56.426078 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-0c81a73f-7f1c-4c2b-b541-d4e7dd89fede tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.145378 May 24 15:38:56.426678 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 989/1999] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:56 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:56.952320 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-a05aa556-7463-491a-b7dc-9ce118076150 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:56.952972 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-a05aa556-7463-491a-b7dc-9ce118076150 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:56.959119 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a05aa556-7463-491a-b7dc-9ce118076150 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:56.959571 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a05aa556-7463-491a-b7dc-9ce118076150 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:56.960354 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a05aa556-7463-491a-b7dc-9ce118076150 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:56.960793 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a05aa556-7463-491a-b7dc-9ce118076150 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:57.055489 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-cf44c3bc-f918-4591-8777-0f92151c3629 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:57.056103 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-cf44c3bc-f918-4591-8777-0f92151c3629 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:57.062672 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cf44c3bc-f918-4591-8777-0f92151c3629 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:57.063116 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cf44c3bc-f918-4591-8777-0f92151c3629 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:57.063896 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cf44c3bc-f918-4591-8777-0f92151c3629 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:57.064331 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cf44c3bc-f918-4591-8777-0f92151c3629 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:57.089845 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-a05aa556-7463-491a-b7dc-9ce118076150 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:57.098755 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-a05aa556-7463-491a-b7dc-9ce118076150 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.149797 May 24 15:38:57.099328 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1011/2000] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:56 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:57.185920 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-2c550bde-4695-43d9-a4aa-6bddccac21b4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:57.186561 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-2c550bde-4695-43d9-a4aa-6bddccac21b4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:57.192495 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2c550bde-4695-43d9-a4aa-6bddccac21b4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:57.192943 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2c550bde-4695-43d9-a4aa-6bddccac21b4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:57.193703 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2c550bde-4695-43d9-a4aa-6bddccac21b4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:57.194013 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-cf44c3bc-f918-4591-8777-0f92151c3629 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:57.194146 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2c550bde-4695-43d9-a4aa-6bddccac21b4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:57.202057 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-cf44c3bc-f918-4591-8777-0f92151c3629 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.150947 May 24 15:38:57.202730 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 990/2001] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:57 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:38:57.211848 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:38:57.261313 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-2c550bde-4695-43d9-a4aa-6bddccac21b4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:57.269733 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-2c550bde-4695-43d9-a4aa-6bddccac21b4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:57.271263 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-2c550bde-4695-43d9-a4aa-6bddccac21b4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:57.272430 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-2c550bde-4695-43d9-a4aa-6bddccac21b4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.090388 May 24 15:38:57.272986 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1012/2002] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:38:57 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:38:57.442986 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-527138c3-d1d1-4768-8843-ce92713f5610 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:57.443516 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-527138c3-d1d1-4768-8843-ce92713f5610 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:57.449677 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-527138c3-d1d1-4768-8843-ce92713f5610 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:57.450127 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-527138c3-d1d1-4768-8843-ce92713f5610 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:57.450886 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-527138c3-d1d1-4768-8843-ce92713f5610 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:57.451318 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-527138c3-d1d1-4768-8843-ce92713f5610 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:57.574717 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-527138c3-d1d1-4768-8843-ce92713f5610 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:57.583590 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-527138c3-d1d1-4768-8843-ce92713f5610 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.144598 May 24 15:38:57.584157 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 991/2003] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:57 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:58.116420 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-30eb0617-2750-4aa1-82d3-f907a42e2224 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:58.117026 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-30eb0617-2750-4aa1-82d3-f907a42e2224 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:58.123534 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-30eb0617-2750-4aa1-82d3-f907a42e2224 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:58.123974 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-30eb0617-2750-4aa1-82d3-f907a42e2224 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:58.124748 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-30eb0617-2750-4aa1-82d3-f907a42e2224 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:58.125175 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-30eb0617-2750-4aa1-82d3-f907a42e2224 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:58.218963 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-4336ec8e-b7fb-43f2-bfdc-d5fecb20ddd5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:58.219575 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-4336ec8e-b7fb-43f2-bfdc-d5fecb20ddd5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:58.226065 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4336ec8e-b7fb-43f2-bfdc-d5fecb20ddd5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:58.226510 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4336ec8e-b7fb-43f2-bfdc-d5fecb20ddd5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:58.227269 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4336ec8e-b7fb-43f2-bfdc-d5fecb20ddd5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:58.227703 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4336ec8e-b7fb-43f2-bfdc-d5fecb20ddd5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:58.251120 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-30eb0617-2750-4aa1-82d3-f907a42e2224 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:58.259615 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-30eb0617-2750-4aa1-82d3-f907a42e2224 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.147829 May 24 15:38:58.260186 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1013/2004] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:58 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:58.290078 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-f51ece54-7922-43bd-a3ee-4b6fd19d6528 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:58.290691 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-f51ece54-7922-43bd-a3ee-4b6fd19d6528 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:58.296647 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f51ece54-7922-43bd-a3ee-4b6fd19d6528 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:58.297099 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f51ece54-7922-43bd-a3ee-4b6fd19d6528 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:58.297882 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f51ece54-7922-43bd-a3ee-4b6fd19d6528 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:58.298295 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f51ece54-7922-43bd-a3ee-4b6fd19d6528 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:58.358196 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-4336ec8e-b7fb-43f2-bfdc-d5fecb20ddd5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:58.358770 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-f51ece54-7922-43bd-a3ee-4b6fd19d6528 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:58.367328 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-4336ec8e-b7fb-43f2-bfdc-d5fecb20ddd5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.152205 May 24 15:38:58.367902 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 992/2005] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:58 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:38:58.368044 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-f51ece54-7922-43bd-a3ee-4b6fd19d6528 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:58.369555 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-f51ece54-7922-43bd-a3ee-4b6fd19d6528 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:58.370690 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-f51ece54-7922-43bd-a3ee-4b6fd19d6528 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084502 May 24 15:38:58.371334 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1014/2006] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:38:58 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:38:58.601153 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-c650d4d4-20a6-461b-adf4-545c80399229 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:58.601774 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-c650d4d4-20a6-461b-adf4-545c80399229 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:58.607793 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c650d4d4-20a6-461b-adf4-545c80399229 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:58.608184 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c650d4d4-20a6-461b-adf4-545c80399229 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:58.608975 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c650d4d4-20a6-461b-adf4-545c80399229 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:58.609405 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c650d4d4-20a6-461b-adf4-545c80399229 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:58.733732 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-c650d4d4-20a6-461b-adf4-545c80399229 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:58.742572 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-c650d4d4-20a6-461b-adf4-545c80399229 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.146030 May 24 15:38:58.743131 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 993/2007] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:58 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:38:59.276869 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-ee3af356-762c-4db1-b433-666792609e1d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:59.277476 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-ee3af356-762c-4db1-b433-666792609e1d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:59.284179 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ee3af356-762c-4db1-b433-666792609e1d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:59.284652 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ee3af356-762c-4db1-b433-666792609e1d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:59.285403 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ee3af356-762c-4db1-b433-666792609e1d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:59.285835 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ee3af356-762c-4db1-b433-666792609e1d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:59.384967 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-cf4462b2-233f-4fff-a6ad-67eb26c73e43 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:59.385675 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-cf4462b2-233f-4fff-a6ad-67eb26c73e43 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:59.392248 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cf4462b2-233f-4fff-a6ad-67eb26c73e43 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:59.392724 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cf4462b2-233f-4fff-a6ad-67eb26c73e43 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:59.393490 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cf4462b2-233f-4fff-a6ad-67eb26c73e43 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:59.393924 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cf4462b2-233f-4fff-a6ad-67eb26c73e43 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:59.415548 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ee3af356-762c-4db1-b433-666792609e1d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:59.423493 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-ee3af356-762c-4db1-b433-666792609e1d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.150401 May 24 15:38:59.424254 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1015/2008] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:59 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:59.428542 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-1e200c03-b24c-469b-9c86-ebcbfe3a0975 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:59.429136 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-1e200c03-b24c-469b-9c86-ebcbfe3a0975 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:59.434973 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1e200c03-b24c-469b-9c86-ebcbfe3a0975 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:59.435416 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1e200c03-b24c-469b-9c86-ebcbfe3a0975 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:59.436176 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1e200c03-b24c-469b-9c86-ebcbfe3a0975 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:59.436633 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1e200c03-b24c-469b-9c86-ebcbfe3a0975 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:59.498057 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-1e200c03-b24c-469b-9c86-ebcbfe3a0975 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:59.506924 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-1e200c03-b24c-469b-9c86-ebcbfe3a0975 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:59.508448 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-1e200c03-b24c-469b-9c86-ebcbfe3a0975 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:59.509606 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-1e200c03-b24c-469b-9c86-ebcbfe3a0975 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084553 May 24 15:38:59.510160 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1016/2009] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:38:59 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:38:59.523208 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-cf4462b2-233f-4fff-a6ad-67eb26c73e43 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:59.531273 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-cf4462b2-233f-4fff-a6ad-67eb26c73e43 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.150210 May 24 15:38:59.531777 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 994/2010] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:59 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:38:59.760252 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-7bfe8b50-45b4-4cbe-be74-5481e2793cd5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:59.760886 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-7bfe8b50-45b4-4cbe-be74-5481e2793cd5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:59.766988 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7bfe8b50-45b4-4cbe-be74-5481e2793cd5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:59.767436 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7bfe8b50-45b4-4cbe-be74-5481e2793cd5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:59.768194 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7bfe8b50-45b4-4cbe-be74-5481e2793cd5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:59.768653 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7bfe8b50-45b4-4cbe-be74-5481e2793cd5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:59.892265 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-7bfe8b50-45b4-4cbe-be74-5481e2793cd5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:59.900234 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-7bfe8b50-45b4-4cbe-be74-5481e2793cd5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.143882 May 24 15:38:59.900825 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1017/2011] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:38:59 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:00.440631 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-2af35b44-0041-40ef-a61f-5d86394c9ea1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:00.441244 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-2af35b44-0041-40ef-a61f-5d86394c9ea1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:00.448605 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2af35b44-0041-40ef-a61f-5d86394c9ea1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:00.449056 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2af35b44-0041-40ef-a61f-5d86394c9ea1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:00.449849 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2af35b44-0041-40ef-a61f-5d86394c9ea1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:00.450285 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2af35b44-0041-40ef-a61f-5d86394c9ea1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:00.527274 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-1b5cebf0-8023-4300-bcec-0db16e3c33cc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:00.527909 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-1b5cebf0-8023-4300-bcec-0db16e3c33cc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:00.534616 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1b5cebf0-8023-4300-bcec-0db16e3c33cc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:00.535061 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1b5cebf0-8023-4300-bcec-0db16e3c33cc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:00.535819 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1b5cebf0-8023-4300-bcec-0db16e3c33cc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:00.536253 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1b5cebf0-8023-4300-bcec-0db16e3c33cc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:00.581071 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-2af35b44-0041-40ef-a61f-5d86394c9ea1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:00.588984 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-2af35b44-0041-40ef-a61f-5d86394c9ea1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.152249 May 24 15:39:00.589560 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 995/2012] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:00 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:00.593920 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-55fe7f98-1687-4d70-b886-516012645768 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:00.594529 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-55fe7f98-1687-4d70-b886-516012645768 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:00.600745 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-55fe7f98-1687-4d70-b886-516012645768 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:00.601261 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-55fe7f98-1687-4d70-b886-516012645768 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:00.601819 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-1b5cebf0-8023-4300-bcec-0db16e3c33cc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:00.602190 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-55fe7f98-1687-4d70-b886-516012645768 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:00.602696 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-55fe7f98-1687-4d70-b886-516012645768 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:00.610256 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-1b5cebf0-8023-4300-bcec-0db16e3c33cc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:00.611747 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-1b5cebf0-8023-4300-bcec-0db16e3c33cc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:00.612905 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-1b5cebf0-8023-4300-bcec-0db16e3c33cc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.089627 May 24 15:39:00.613454 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1018/2013] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:39:00 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:39:00.726657 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-55fe7f98-1687-4d70-b886-516012645768 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:00.734568 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-55fe7f98-1687-4d70-b886-516012645768 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.144073 May 24 15:39:00.735141 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 996/2014] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:00 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:00.917326 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-b87d9101-00ab-464a-b7c4-d5c438621eaa tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:00.917930 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-b87d9101-00ab-464a-b7c4-d5c438621eaa tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:00.924204 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b87d9101-00ab-464a-b7c4-d5c438621eaa tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:00.924684 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b87d9101-00ab-464a-b7c4-d5c438621eaa tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:00.925433 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b87d9101-00ab-464a-b7c4-d5c438621eaa tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:00.925859 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b87d9101-00ab-464a-b7c4-d5c438621eaa tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:01.050504 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-b87d9101-00ab-464a-b7c4-d5c438621eaa tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:01.058944 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-b87d9101-00ab-464a-b7c4-d5c438621eaa tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.145400 May 24 15:39:01.059498 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1019/2015] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:00 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:01.606268 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-19ead764-3b1a-47ea-9712-ea72a10a9b8c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:01.607019 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-19ead764-3b1a-47ea-9712-ea72a10a9b8c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:01.613342 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-19ead764-3b1a-47ea-9712-ea72a10a9b8c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:01.613782 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-19ead764-3b1a-47ea-9712-ea72a10a9b8c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:01.614579 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-19ead764-3b1a-47ea-9712-ea72a10a9b8c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:01.614966 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-19ead764-3b1a-47ea-9712-ea72a10a9b8c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:01.631445 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-6bfb0c3a-e377-4e6a-b1ef-d7c0eb7d51e1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:01.633165 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-6bfb0c3a-e377-4e6a-b1ef-d7c0eb7d51e1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:01.635605 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_api:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:39:01.641324 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6bfb0c3a-e377-4e6a-b1ef-d7c0eb7d51e1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:01.641769 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6bfb0c3a-e377-4e6a-b1ef-d7c0eb7d51e1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:01.642588 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6bfb0c3a-e377-4e6a-b1ef-d7c0eb7d51e1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:01.643022 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6bfb0c3a-e377-4e6a-b1ef-d7c0eb7d51e1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:01.719614 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-6bfb0c3a-e377-4e6a-b1ef-d7c0eb7d51e1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:01.728727 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-6bfb0c3a-e377-4e6a-b1ef-d7c0eb7d51e1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:01.730210 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-6bfb0c3a-e377-4e6a-b1ef-d7c0eb7d51e1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:01.731395 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-6bfb0c3a-e377-4e6a-b1ef-d7c0eb7d51e1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.104420 May 24 15:39:01.731962 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1020/2016] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:39:01 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:39:01.752368 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-40f3d4c0-0d34-4aa2-bde2-c23f3febca9d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:01.753090 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-40f3d4c0-0d34-4aa2-bde2-c23f3febca9d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:01.760028 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-40f3d4c0-0d34-4aa2-bde2-c23f3febca9d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:01.760511 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-40f3d4c0-0d34-4aa2-bde2-c23f3febca9d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:01.761290 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-40f3d4c0-0d34-4aa2-bde2-c23f3febca9d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:01.761719 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-40f3d4c0-0d34-4aa2-bde2-c23f3febca9d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:01.895366 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-40f3d4c0-0d34-4aa2-bde2-c23f3febca9d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:01.903516 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-40f3d4c0-0d34-4aa2-bde2-c23f3febca9d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.155067 May 24 15:39:01.904088 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1021/2017] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:01 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:39:01.911705 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-19ead764-3b1a-47ea-9712-ea72a10a9b8c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:01.919783 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-19ead764-3b1a-47ea-9712-ea72a10a9b8c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.317425 May 24 15:39:01.920352 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 997/2018] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:01 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:02.074910 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-893f8b9a-994d-48cc-b765-08d13051eeab tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:02.075530 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-893f8b9a-994d-48cc-b765-08d13051eeab tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:02.081729 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-893f8b9a-994d-48cc-b765-08d13051eeab tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:02.082180 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-893f8b9a-994d-48cc-b765-08d13051eeab tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:02.082944 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-893f8b9a-994d-48cc-b765-08d13051eeab tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:02.083389 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-893f8b9a-994d-48cc-b765-08d13051eeab tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:02.208522 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-893f8b9a-994d-48cc-b765-08d13051eeab tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:02.216439 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-893f8b9a-994d-48cc-b765-08d13051eeab tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.145406 May 24 15:39:02.217000 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1022/2019] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:02 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:02.749723 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-41e16f22-5960-4ecd-b1df-35308c12a308 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:02.750322 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-41e16f22-5960-4ecd-b1df-35308c12a308 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:02.756858 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-41e16f22-5960-4ecd-b1df-35308c12a308 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:02.757296 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-41e16f22-5960-4ecd-b1df-35308c12a308 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:02.758062 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-41e16f22-5960-4ecd-b1df-35308c12a308 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:02.758471 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-41e16f22-5960-4ecd-b1df-35308c12a308 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:02.817667 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-41e16f22-5960-4ecd-b1df-35308c12a308 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:02.826452 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-41e16f22-5960-4ecd-b1df-35308c12a308 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:02.827951 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-41e16f22-5960-4ecd-b1df-35308c12a308 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:02.829130 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-41e16f22-5960-4ecd-b1df-35308c12a308 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.083341 May 24 15:39:02.829682 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 998/2020] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:39:02 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:39:02.920116 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-07ffafd3-a70c-4c6a-b066-bd1561676397 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:02.920750 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-07ffafd3-a70c-4c6a-b066-bd1561676397 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:02.927236 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-07ffafd3-a70c-4c6a-b066-bd1561676397 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:02.927676 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-07ffafd3-a70c-4c6a-b066-bd1561676397 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:02.928454 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-07ffafd3-a70c-4c6a-b066-bd1561676397 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:02.928881 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-07ffafd3-a70c-4c6a-b066-bd1561676397 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:02.937132 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-114316f1-6fda-4981-bf12-e0ac538c1942 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:02.937745 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-114316f1-6fda-4981-bf12-e0ac538c1942 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:02.943675 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-114316f1-6fda-4981-bf12-e0ac538c1942 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:02.944131 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-114316f1-6fda-4981-bf12-e0ac538c1942 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:02.944940 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-114316f1-6fda-4981-bf12-e0ac538c1942 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:02.945375 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-114316f1-6fda-4981-bf12-e0ac538c1942 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:03.057440 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-07ffafd3-a70c-4c6a-b066-bd1561676397 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:03.065683 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-07ffafd3-a70c-4c6a-b066-bd1561676397 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.148991 May 24 15:39:03.066571 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1023/2021] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:02 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:03.075875 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-114316f1-6fda-4981-bf12-e0ac538c1942 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:03.084906 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-114316f1-6fda-4981-bf12-e0ac538c1942 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.151648 May 24 15:39:03.085461 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 999/2022] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:02 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:39:03.233627 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-58ddf6f5-9aba-4585-ac27-63c59fa1bcb7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:03.234240 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-58ddf6f5-9aba-4585-ac27-63c59fa1bcb7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:03.240183 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-58ddf6f5-9aba-4585-ac27-63c59fa1bcb7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:03.240903 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-58ddf6f5-9aba-4585-ac27-63c59fa1bcb7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:03.241649 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-58ddf6f5-9aba-4585-ac27-63c59fa1bcb7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:03.242073 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-58ddf6f5-9aba-4585-ac27-63c59fa1bcb7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:03.372701 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-58ddf6f5-9aba-4585-ac27-63c59fa1bcb7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:03.381355 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-58ddf6f5-9aba-4585-ac27-63c59fa1bcb7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.151623 May 24 15:39:03.381920 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1024/2023] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:03 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:03.846985 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-30de9af3-12a4-4713-85b8-24e5292f1047 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:03.847648 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-30de9af3-12a4-4713-85b8-24e5292f1047 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:03.854840 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-30de9af3-12a4-4713-85b8-24e5292f1047 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:03.855291 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-30de9af3-12a4-4713-85b8-24e5292f1047 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:03.856061 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-30de9af3-12a4-4713-85b8-24e5292f1047 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:03.856542 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-30de9af3-12a4-4713-85b8-24e5292f1047 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:03.920374 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-30de9af3-12a4-4713-85b8-24e5292f1047 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:03.929669 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-30de9af3-12a4-4713-85b8-24e5292f1047 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:03.931171 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-30de9af3-12a4-4713-85b8-24e5292f1047 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:03.932645 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-30de9af3-12a4-4713-85b8-24e5292f1047 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.089595 May 24 15:39:03.933193 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1000/2024] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:39:03 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:39:04.081809 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-390f73e0-bd0f-430b-b1bd-3b9adbb589e3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:04.082914 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-390f73e0-bd0f-430b-b1bd-3b9adbb589e3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:04.089484 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-390f73e0-bd0f-430b-b1bd-3b9adbb589e3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:04.089933 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-390f73e0-bd0f-430b-b1bd-3b9adbb589e3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:04.090690 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-390f73e0-bd0f-430b-b1bd-3b9adbb589e3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:04.091121 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-390f73e0-bd0f-430b-b1bd-3b9adbb589e3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:04.102306 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-8872d33a-99c4-4d77-8f05-76831bc3ccb5 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:04.102850 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-8872d33a-99c4-4d77-8f05-76831bc3ccb5 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:04.108809 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8872d33a-99c4-4d77-8f05-76831bc3ccb5 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:04.109255 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8872d33a-99c4-4d77-8f05-76831bc3ccb5 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:04.110020 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8872d33a-99c4-4d77-8f05-76831bc3ccb5 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:04.110451 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8872d33a-99c4-4d77-8f05-76831bc3ccb5 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:04.219336 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-390f73e0-bd0f-430b-b1bd-3b9adbb589e3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:04.227885 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-390f73e0-bd0f-430b-b1bd-3b9adbb589e3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.149852 May 24 15:39:04.228549 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1025/2025] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:04 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:04.238353 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-8872d33a-99c4-4d77-8f05-76831bc3ccb5 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:04.246773 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-8872d33a-99c4-4d77-8f05-76831bc3ccb5 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.148890 May 24 15:39:04.247329 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1001/2026] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:04 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:39:04.398443 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-8ed061b5-c74b-4553-ba2d-ff6a7ca79a34 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:04.398977 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-8ed061b5-c74b-4553-ba2d-ff6a7ca79a34 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:04.405049 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8ed061b5-c74b-4553-ba2d-ff6a7ca79a34 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:04.405498 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8ed061b5-c74b-4553-ba2d-ff6a7ca79a34 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:04.406253 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8ed061b5-c74b-4553-ba2d-ff6a7ca79a34 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:04.406687 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8ed061b5-c74b-4553-ba2d-ff6a7ca79a34 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:04.535365 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-8ed061b5-c74b-4553-ba2d-ff6a7ca79a34 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:04.543282 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-8ed061b5-c74b-4553-ba2d-ff6a7ca79a34 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.149206 May 24 15:39:04.543843 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1026/2027] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:04 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:04.950525 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-9a6f6be8-e4b2-42aa-9600-8d413da6fb9c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:04.951136 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-9a6f6be8-e4b2-42aa-9600-8d413da6fb9c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:04.957707 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9a6f6be8-e4b2-42aa-9600-8d413da6fb9c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:04.958154 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9a6f6be8-e4b2-42aa-9600-8d413da6fb9c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:04.958924 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9a6f6be8-e4b2-42aa-9600-8d413da6fb9c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:04.959358 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9a6f6be8-e4b2-42aa-9600-8d413da6fb9c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:05.021198 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-9a6f6be8-e4b2-42aa-9600-8d413da6fb9c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:05.029546 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-9a6f6be8-e4b2-42aa-9600-8d413da6fb9c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:05.031052 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-9a6f6be8-e4b2-42aa-9600-8d413da6fb9c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:05.032209 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-9a6f6be8-e4b2-42aa-9600-8d413da6fb9c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.085711 May 24 15:39:05.032803 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1002/2028] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:39:04 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:39:05.245784 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c3c8900d-93bd-4deb-8bdc-ae9704eebc45 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:05.246400 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-c3c8900d-93bd-4deb-8bdc-ae9704eebc45 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:05.253133 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c3c8900d-93bd-4deb-8bdc-ae9704eebc45 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:05.253575 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c3c8900d-93bd-4deb-8bdc-ae9704eebc45 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:05.254324 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c3c8900d-93bd-4deb-8bdc-ae9704eebc45 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:05.254752 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c3c8900d-93bd-4deb-8bdc-ae9704eebc45 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:05.264066 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-75110a72-a39f-477e-996d-55fceb2739ee tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:05.264713 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-75110a72-a39f-477e-996d-55fceb2739ee tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:05.270799 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-75110a72-a39f-477e-996d-55fceb2739ee tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:05.271252 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-75110a72-a39f-477e-996d-55fceb2739ee tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:05.272022 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-75110a72-a39f-477e-996d-55fceb2739ee tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:05.272497 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-75110a72-a39f-477e-996d-55fceb2739ee tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:05.383796 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-c3c8900d-93bd-4deb-8bdc-ae9704eebc45 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:05.391922 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-c3c8900d-93bd-4deb-8bdc-ae9704eebc45 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.149918 May 24 15:39:05.392740 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1027/2029] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:05 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:05.406882 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-75110a72-a39f-477e-996d-55fceb2739ee tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:05.415281 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-75110a72-a39f-477e-996d-55fceb2739ee tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.155147 May 24 15:39:05.415845 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1003/2030] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:05 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:39:05.560033 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-9beba11d-d7d9-49bb-b8ee-91bd0afeef36 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:05.560589 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-9beba11d-d7d9-49bb-b8ee-91bd0afeef36 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:05.566596 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9beba11d-d7d9-49bb-b8ee-91bd0afeef36 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:05.567039 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9beba11d-d7d9-49bb-b8ee-91bd0afeef36 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:05.567794 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9beba11d-d7d9-49bb-b8ee-91bd0afeef36 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:05.568226 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9beba11d-d7d9-49bb-b8ee-91bd0afeef36 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:05.698477 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-9beba11d-d7d9-49bb-b8ee-91bd0afeef36 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:05.706320 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-9beba11d-d7d9-49bb-b8ee-91bd0afeef36 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.150174 May 24 15:39:05.706896 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1028/2031] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:05 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:06.050127 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-087f5e1b-27cc-4e88-8029-51eb93fd7192 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:06.050744 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-087f5e1b-27cc-4e88-8029-51eb93fd7192 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:06.057388 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-087f5e1b-27cc-4e88-8029-51eb93fd7192 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:06.057834 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-087f5e1b-27cc-4e88-8029-51eb93fd7192 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:06.058594 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-087f5e1b-27cc-4e88-8029-51eb93fd7192 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:06.059026 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-087f5e1b-27cc-4e88-8029-51eb93fd7192 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:06.077062 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:39:06.120060 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-087f5e1b-27cc-4e88-8029-51eb93fd7192 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:06.128425 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-087f5e1b-27cc-4e88-8029-51eb93fd7192 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:06.130414 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-087f5e1b-27cc-4e88-8029-51eb93fd7192 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:06.131549 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-087f5e1b-27cc-4e88-8029-51eb93fd7192 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.085381 May 24 15:39:06.132102 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1004/2032] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:39:06 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:39:06.408758 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-1053236b-fa1a-4993-b4ed-848982d220e4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:06.409381 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-1053236b-fa1a-4993-b4ed-848982d220e4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:06.415721 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1053236b-fa1a-4993-b4ed-848982d220e4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:06.416163 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1053236b-fa1a-4993-b4ed-848982d220e4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:06.416949 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1053236b-fa1a-4993-b4ed-848982d220e4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:06.417384 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1053236b-fa1a-4993-b4ed-848982d220e4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:06.421247 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:39:06.431715 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-5bdbc11a-f732-480c-a404-4aabfaa17e4f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:06.432361 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-5bdbc11a-f732-480c-a404-4aabfaa17e4f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:06.438365 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5bdbc11a-f732-480c-a404-4aabfaa17e4f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:06.438819 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5bdbc11a-f732-480c-a404-4aabfaa17e4f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:06.439587 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5bdbc11a-f732-480c-a404-4aabfaa17e4f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:06.440026 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5bdbc11a-f732-480c-a404-4aabfaa17e4f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:06.545585 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-1053236b-fa1a-4993-b4ed-848982d220e4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:06.554014 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-1053236b-fa1a-4993-b4ed-848982d220e4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.149125 May 24 15:39:06.554579 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1029/2033] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:06 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:06.569424 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-5bdbc11a-f732-480c-a404-4aabfaa17e4f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:06.577394 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-5bdbc11a-f732-480c-a404-4aabfaa17e4f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.149569 May 24 15:39:06.577954 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1005/2034] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:06 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:39:06.723850 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-fb9bb1ed-c7ca-4931-8f4d-419d3f070452 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:06.724487 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-fb9bb1ed-c7ca-4931-8f4d-419d3f070452 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:06.730389 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fb9bb1ed-c7ca-4931-8f4d-419d3f070452 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:06.730835 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fb9bb1ed-c7ca-4931-8f4d-419d3f070452 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:06.731589 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fb9bb1ed-c7ca-4931-8f4d-419d3f070452 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:06.732030 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fb9bb1ed-c7ca-4931-8f4d-419d3f070452 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:06.858664 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-fb9bb1ed-c7ca-4931-8f4d-419d3f070452 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:06.867805 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-fb9bb1ed-c7ca-4931-8f4d-419d3f070452 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.148229 May 24 15:39:06.868374 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1030/2035] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:06 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:07.149684 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-7671f50a-dbb5-40e6-86cf-2f98da6f88b3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:07.150290 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-7671f50a-dbb5-40e6-86cf-2f98da6f88b3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:07.156813 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7671f50a-dbb5-40e6-86cf-2f98da6f88b3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:07.157255 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7671f50a-dbb5-40e6-86cf-2f98da6f88b3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:07.158013 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7671f50a-dbb5-40e6-86cf-2f98da6f88b3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:07.158444 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7671f50a-dbb5-40e6-86cf-2f98da6f88b3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:07.220835 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-7671f50a-dbb5-40e6-86cf-2f98da6f88b3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:07.229792 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-7671f50a-dbb5-40e6-86cf-2f98da6f88b3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:07.231279 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-7671f50a-dbb5-40e6-86cf-2f98da6f88b3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:07.232447 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-7671f50a-dbb5-40e6-86cf-2f98da6f88b3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.086653 May 24 15:39:07.233009 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1006/2036] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:39:07 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:39:07.570802 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-674512cd-317f-4388-a8f1-f1524a50371e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:07.571420 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-674512cd-317f-4388-a8f1-f1524a50371e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:07.578271 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-674512cd-317f-4388-a8f1-f1524a50371e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:07.578719 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-674512cd-317f-4388-a8f1-f1524a50371e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:07.579479 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-674512cd-317f-4388-a8f1-f1524a50371e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:07.579914 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-674512cd-317f-4388-a8f1-f1524a50371e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:07.594056 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-35d657b7-7e88-4030-a78a-8d56ec0598f9 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:07.594661 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-35d657b7-7e88-4030-a78a-8d56ec0598f9 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:07.596517 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_api:SELECT=98 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:39:07.601839 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-35d657b7-7e88-4030-a78a-8d56ec0598f9 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:07.602283 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-35d657b7-7e88-4030-a78a-8d56ec0598f9 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:07.603039 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-35d657b7-7e88-4030-a78a-8d56ec0598f9 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:07.603467 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-35d657b7-7e88-4030-a78a-8d56ec0598f9 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:07.711666 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-674512cd-317f-4388-a8f1-f1524a50371e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:07.719601 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-674512cd-317f-4388-a8f1-f1524a50371e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.153140 May 24 15:39:07.720163 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1031/2037] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:07 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:07.732125 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-35d657b7-7e88-4030-a78a-8d56ec0598f9 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:07.740982 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-35d657b7-7e88-4030-a78a-8d56ec0598f9 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.150380 May 24 15:39:07.741536 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1007/2038] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:07 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:39:07.884434 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-ff0275a9-1e94-45d0-ba13-b63f163d459f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:07.884961 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-ff0275a9-1e94-45d0-ba13-b63f163d459f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:07.890959 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ff0275a9-1e94-45d0-ba13-b63f163d459f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:07.891405 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ff0275a9-1e94-45d0-ba13-b63f163d459f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:07.892170 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ff0275a9-1e94-45d0-ba13-b63f163d459f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:07.892632 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ff0275a9-1e94-45d0-ba13-b63f163d459f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:08.017183 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ff0275a9-1e94-45d0-ba13-b63f163d459f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:08.025791 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-ff0275a9-1e94-45d0-ba13-b63f163d459f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.145218 May 24 15:39:08.026361 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1032/2039] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:07 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:08.250230 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-bd7dc6c6-538f-4c1b-ab19-131d5acb9f16 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:08.250837 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-bd7dc6c6-538f-4c1b-ab19-131d5acb9f16 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:08.257759 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bd7dc6c6-538f-4c1b-ab19-131d5acb9f16 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:08.258200 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bd7dc6c6-538f-4c1b-ab19-131d5acb9f16 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:08.258950 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bd7dc6c6-538f-4c1b-ab19-131d5acb9f16 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:08.259379 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bd7dc6c6-538f-4c1b-ab19-131d5acb9f16 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:08.319927 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-bd7dc6c6-538f-4c1b-ab19-131d5acb9f16 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:08.328154 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-bd7dc6c6-538f-4c1b-ab19-131d5acb9f16 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:08.329659 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-bd7dc6c6-538f-4c1b-ab19-131d5acb9f16 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:08.330784 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-bd7dc6c6-538f-4c1b-ab19-131d5acb9f16 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084453 May 24 15:39:08.331339 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1008/2040] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:39:08 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:39:08.736437 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-785866a2-0769-4ae1-9b5e-66fcadbc4fe2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:08.737058 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-785866a2-0769-4ae1-9b5e-66fcadbc4fe2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:08.744424 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-785866a2-0769-4ae1-9b5e-66fcadbc4fe2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:08.744876 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-785866a2-0769-4ae1-9b5e-66fcadbc4fe2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:08.745634 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-785866a2-0769-4ae1-9b5e-66fcadbc4fe2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:08.746070 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-785866a2-0769-4ae1-9b5e-66fcadbc4fe2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:08.758474 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-45065b6a-990e-4821-8be1-d129ad5d421b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:08.759084 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-45065b6a-990e-4821-8be1-d129ad5d421b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:08.765188 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-45065b6a-990e-4821-8be1-d129ad5d421b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:08.765630 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-45065b6a-990e-4821-8be1-d129ad5d421b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:08.766391 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-45065b6a-990e-4821-8be1-d129ad5d421b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:08.766826 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-45065b6a-990e-4821-8be1-d129ad5d421b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:08.875573 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-785866a2-0769-4ae1-9b5e-66fcadbc4fe2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:08.884094 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-785866a2-0769-4ae1-9b5e-66fcadbc4fe2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.151495 May 24 15:39:08.884688 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1033/2041] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:08 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:08.896944 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-45065b6a-990e-4821-8be1-d129ad5d421b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:08.905065 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-45065b6a-990e-4821-8be1-d129ad5d421b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.150969 May 24 15:39:08.905628 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1009/2042] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:08 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:39:09.042565 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-79e216dc-d14b-4c22-a891-0b11757e06e6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:09.043106 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-79e216dc-d14b-4c22-a891-0b11757e06e6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:09.049102 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-79e216dc-d14b-4c22-a891-0b11757e06e6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:09.049573 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-79e216dc-d14b-4c22-a891-0b11757e06e6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:09.050326 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-79e216dc-d14b-4c22-a891-0b11757e06e6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:09.050757 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-79e216dc-d14b-4c22-a891-0b11757e06e6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:09.175619 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-79e216dc-d14b-4c22-a891-0b11757e06e6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:09.184171 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-79e216dc-d14b-4c22-a891-0b11757e06e6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.145449 May 24 15:39:09.184766 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1034/2043] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:09 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:09.350354 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a3db920f-e154-4cb8-8317-5fb1766376b2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:09.350896 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a3db920f-e154-4cb8-8317-5fb1766376b2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:09.357432 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a3db920f-e154-4cb8-8317-5fb1766376b2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:09.357878 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a3db920f-e154-4cb8-8317-5fb1766376b2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:09.358643 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a3db920f-e154-4cb8-8317-5fb1766376b2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:09.359090 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a3db920f-e154-4cb8-8317-5fb1766376b2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:09.419035 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-a3db920f-e154-4cb8-8317-5fb1766376b2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:09.427422 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-a3db920f-e154-4cb8-8317-5fb1766376b2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:09.428960 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-a3db920f-e154-4cb8-8317-5fb1766376b2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:09.430094 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a3db920f-e154-4cb8-8317-5fb1766376b2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084411 May 24 15:39:09.430649 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1010/2044] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:39:09 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:39:09.901170 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e9ed238f-47a3-4d61-87b1-7ba7afa5b751 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:09.901877 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e9ed238f-47a3-4d61-87b1-7ba7afa5b751 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:09.908180 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e9ed238f-47a3-4d61-87b1-7ba7afa5b751 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:09.908647 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e9ed238f-47a3-4d61-87b1-7ba7afa5b751 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:09.909397 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e9ed238f-47a3-4d61-87b1-7ba7afa5b751 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:09.909826 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e9ed238f-47a3-4d61-87b1-7ba7afa5b751 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:09.922384 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-0894ec6a-141a-4207-ac2c-316caa5170f1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:09.922995 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-0894ec6a-141a-4207-ac2c-316caa5170f1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:09.929232 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0894ec6a-141a-4207-ac2c-316caa5170f1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:09.929758 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0894ec6a-141a-4207-ac2c-316caa5170f1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:09.930519 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0894ec6a-141a-4207-ac2c-316caa5170f1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:09.930958 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0894ec6a-141a-4207-ac2c-316caa5170f1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:10.038166 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e9ed238f-47a3-4d61-87b1-7ba7afa5b751 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:10.046292 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e9ed238f-47a3-4d61-87b1-7ba7afa5b751 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.148894 May 24 15:39:10.046872 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1035/2045] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:09 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:10.057867 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-0894ec6a-141a-4207-ac2c-316caa5170f1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:10.065829 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-0894ec6a-141a-4207-ac2c-316caa5170f1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.147743 May 24 15:39:10.066395 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1011/2046] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:09 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:39:10.201033 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-1767f99d-46d4-4b28-948a-f9dabedf4425 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:10.201614 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-1767f99d-46d4-4b28-948a-f9dabedf4425 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:10.207626 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1767f99d-46d4-4b28-948a-f9dabedf4425 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:10.208076 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1767f99d-46d4-4b28-948a-f9dabedf4425 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:10.208869 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1767f99d-46d4-4b28-948a-f9dabedf4425 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:10.209310 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1767f99d-46d4-4b28-948a-f9dabedf4425 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:10.339481 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-1767f99d-46d4-4b28-948a-f9dabedf4425 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:10.347393 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-1767f99d-46d4-4b28-948a-f9dabedf4425 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.150299 May 24 15:39:10.347961 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1036/2047] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:10 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:10.448351 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e3d519b6-529e-48a8-bb53-18fc1be89aef tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:10.449011 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-e3d519b6-529e-48a8-bb53-18fc1be89aef tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:10.455026 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e3d519b6-529e-48a8-bb53-18fc1be89aef tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:10.455407 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e3d519b6-529e-48a8-bb53-18fc1be89aef tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:10.456158 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e3d519b6-529e-48a8-bb53-18fc1be89aef tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:10.456618 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e3d519b6-529e-48a8-bb53-18fc1be89aef tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:10.521867 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-e3d519b6-529e-48a8-bb53-18fc1be89aef tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:10.539555 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-e3d519b6-529e-48a8-bb53-18fc1be89aef tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:10.541137 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-e3d519b6-529e-48a8-bb53-18fc1be89aef tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:10.542379 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-e3d519b6-529e-48a8-bb53-18fc1be89aef tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.097952 May 24 15:39:10.542954 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1012/2048] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:39:10 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:39:11.063216 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e1ef7ce9-a2de-4896-aab1-a5cd02532245 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:11.063832 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e1ef7ce9-a2de-4896-aab1-a5cd02532245 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:11.070508 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e1ef7ce9-a2de-4896-aab1-a5cd02532245 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:11.070961 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e1ef7ce9-a2de-4896-aab1-a5cd02532245 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:11.071726 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e1ef7ce9-a2de-4896-aab1-a5cd02532245 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:11.072162 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e1ef7ce9-a2de-4896-aab1-a5cd02532245 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:11.083252 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-43ebc5e4-ffad-4180-9ed3-e747aad41407 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:11.083899 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-43ebc5e4-ffad-4180-9ed3-e747aad41407 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:11.090457 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-43ebc5e4-ffad-4180-9ed3-e747aad41407 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:11.090915 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-43ebc5e4-ffad-4180-9ed3-e747aad41407 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:11.091692 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-43ebc5e4-ffad-4180-9ed3-e747aad41407 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:11.092132 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-43ebc5e4-ffad-4180-9ed3-e747aad41407 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:11.206719 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e1ef7ce9-a2de-4896-aab1-a5cd02532245 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:11.215309 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e1ef7ce9-a2de-4896-aab1-a5cd02532245 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.155904 May 24 15:39:11.215986 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1037/2049] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:11 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:11.221972 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-43ebc5e4-ffad-4180-9ed3-e747aad41407 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:11.230466 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-43ebc5e4-ffad-4180-9ed3-e747aad41407 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.151512 May 24 15:39:11.231024 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1013/2050] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:11 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:39:11.363333 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-369d507a-e792-41ae-8aaf-247b99d68cf3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:11.363952 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-369d507a-e792-41ae-8aaf-247b99d68cf3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:11.370293 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-369d507a-e792-41ae-8aaf-247b99d68cf3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:11.370748 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-369d507a-e792-41ae-8aaf-247b99d68cf3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:11.371513 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-369d507a-e792-41ae-8aaf-247b99d68cf3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:11.371947 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-369d507a-e792-41ae-8aaf-247b99d68cf3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:11.500769 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-369d507a-e792-41ae-8aaf-247b99d68cf3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:11.509160 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-369d507a-e792-41ae-8aaf-247b99d68cf3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.149670 May 24 15:39:11.509723 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1038/2051] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:11 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:11.560896 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-8d7ea798-33a9-4bf1-b578-3796683eebf8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:11.561506 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-8d7ea798-33a9-4bf1-b578-3796683eebf8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:11.567971 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8d7ea798-33a9-4bf1-b578-3796683eebf8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:11.568443 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8d7ea798-33a9-4bf1-b578-3796683eebf8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:11.569201 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8d7ea798-33a9-4bf1-b578-3796683eebf8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:11.569634 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8d7ea798-33a9-4bf1-b578-3796683eebf8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:11.629869 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-8d7ea798-33a9-4bf1-b578-3796683eebf8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:11.642874 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-8d7ea798-33a9-4bf1-b578-3796683eebf8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:11.644383 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-8d7ea798-33a9-4bf1-b578-3796683eebf8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:11.645553 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-8d7ea798-33a9-4bf1-b578-3796683eebf8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.088574 May 24 15:39:11.646113 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1014/2052] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:39:11 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:39:12.232997 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e415ee84-6c40-4f85-96b7-9dd10c4c768c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:12.233609 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e415ee84-6c40-4f85-96b7-9dd10c4c768c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:12.240190 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e415ee84-6c40-4f85-96b7-9dd10c4c768c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:12.240932 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e415ee84-6c40-4f85-96b7-9dd10c4c768c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:12.241687 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e415ee84-6c40-4f85-96b7-9dd10c4c768c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:12.242124 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e415ee84-6c40-4f85-96b7-9dd10c4c768c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:12.247307 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-8d856013-f19c-4aa0-9b8a-6bc2e663a24b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:12.247920 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-8d856013-f19c-4aa0-9b8a-6bc2e663a24b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:12.255139 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8d856013-f19c-4aa0-9b8a-6bc2e663a24b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:12.255583 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8d856013-f19c-4aa0-9b8a-6bc2e663a24b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:12.256378 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8d856013-f19c-4aa0-9b8a-6bc2e663a24b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:12.256812 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8d856013-f19c-4aa0-9b8a-6bc2e663a24b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:12.370666 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e415ee84-6c40-4f85-96b7-9dd10c4c768c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:12.378594 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e415ee84-6c40-4f85-96b7-9dd10c4c768c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.149445 May 24 15:39:12.379757 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1039/2053] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:12 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:12.388454 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-8d856013-f19c-4aa0-9b8a-6bc2e663a24b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:12.397013 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-8d856013-f19c-4aa0-9b8a-6bc2e663a24b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.153532 May 24 15:39:12.397578 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1015/2054] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:12 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:39:12.526309 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-460a6efa-2f7e-404e-be39-d84f832e488c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:12.526916 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-460a6efa-2f7e-404e-be39-d84f832e488c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:12.532883 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-460a6efa-2f7e-404e-be39-d84f832e488c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:12.533331 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-460a6efa-2f7e-404e-be39-d84f832e488c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:12.534090 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-460a6efa-2f7e-404e-be39-d84f832e488c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:12.534521 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-460a6efa-2f7e-404e-be39-d84f832e488c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:12.663710 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-49efa0ef-208d-4358-99b9-fdf0dc5c95c1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:12.664354 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-49efa0ef-208d-4358-99b9-fdf0dc5c95c1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:12.664624 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-460a6efa-2f7e-404e-be39-d84f832e488c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:12.670433 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-49efa0ef-208d-4358-99b9-fdf0dc5c95c1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:12.670880 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-49efa0ef-208d-4358-99b9-fdf0dc5c95c1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:12.671677 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-49efa0ef-208d-4358-99b9-fdf0dc5c95c1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:12.672109 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-49efa0ef-208d-4358-99b9-fdf0dc5c95c1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:12.672550 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-460a6efa-2f7e-404e-be39-d84f832e488c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.150047 May 24 15:39:12.673114 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1040/2055] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:12 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:12.731524 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-49efa0ef-208d-4358-99b9-fdf0dc5c95c1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:12.739818 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-49efa0ef-208d-4358-99b9-fdf0dc5c95c1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:12.741593 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-49efa0ef-208d-4358-99b9-fdf0dc5c95c1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:12.742733 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-49efa0ef-208d-4358-99b9-fdf0dc5c95c1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.083503 May 24 15:39:12.743289 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1016/2056] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:39:12 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:39:13.396537 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-3d2446a1-8b42-4cd0-a3cb-2035d0608f33 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:13.397149 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-3d2446a1-8b42-4cd0-a3cb-2035d0608f33 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:13.403579 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3d2446a1-8b42-4cd0-a3cb-2035d0608f33 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:13.404032 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3d2446a1-8b42-4cd0-a3cb-2035d0608f33 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:13.404824 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3d2446a1-8b42-4cd0-a3cb-2035d0608f33 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:13.405259 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3d2446a1-8b42-4cd0-a3cb-2035d0608f33 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:13.413930 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-cd1f9ba2-9e41-4ea4-b7c9-2b17b0ff84d1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:13.414582 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-cd1f9ba2-9e41-4ea4-b7c9-2b17b0ff84d1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:13.421143 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cd1f9ba2-9e41-4ea4-b7c9-2b17b0ff84d1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:13.421596 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cd1f9ba2-9e41-4ea4-b7c9-2b17b0ff84d1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:13.422367 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cd1f9ba2-9e41-4ea4-b7c9-2b17b0ff84d1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:13.422811 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cd1f9ba2-9e41-4ea4-b7c9-2b17b0ff84d1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:13.531675 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-3d2446a1-8b42-4cd0-a3cb-2035d0608f33 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:13.539686 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-3d2446a1-8b42-4cd0-a3cb-2035d0608f33 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.147537 May 24 15:39:13.540244 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1041/2057] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:13 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:13.550365 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-cd1f9ba2-9e41-4ea4-b7c9-2b17b0ff84d1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:13.558263 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-cd1f9ba2-9e41-4ea4-b7c9-2b17b0ff84d1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.148678 May 24 15:39:13.558840 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1017/2058] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:13 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:39:13.689854 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-ee9d9d2e-6014-4643-813f-1fd5f4bff17a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:13.690388 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-ee9d9d2e-6014-4643-813f-1fd5f4bff17a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:13.697267 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ee9d9d2e-6014-4643-813f-1fd5f4bff17a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:13.697773 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ee9d9d2e-6014-4643-813f-1fd5f4bff17a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:13.698541 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ee9d9d2e-6014-4643-813f-1fd5f4bff17a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:13.698976 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ee9d9d2e-6014-4643-813f-1fd5f4bff17a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:13.761061 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a8152334-02ee-47db-bfa0-9d0384172ac4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:13.761693 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a8152334-02ee-47db-bfa0-9d0384172ac4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:13.767890 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a8152334-02ee-47db-bfa0-9d0384172ac4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:13.768386 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a8152334-02ee-47db-bfa0-9d0384172ac4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:13.769152 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a8152334-02ee-47db-bfa0-9d0384172ac4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:13.770338 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a8152334-02ee-47db-bfa0-9d0384172ac4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:13.825926 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ee9d9d2e-6014-4643-813f-1fd5f4bff17a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:13.834412 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-a8152334-02ee-47db-bfa0-9d0384172ac4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:13.834582 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-ee9d9d2e-6014-4643-813f-1fd5f4bff17a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.148604 May 24 15:39:13.835128 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1042/2059] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:13 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:13.843070 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-a8152334-02ee-47db-bfa0-9d0384172ac4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:13.844594 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-a8152334-02ee-47db-bfa0-9d0384172ac4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:13.845732 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a8152334-02ee-47db-bfa0-9d0384172ac4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.088704 May 24 15:39:13.846284 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1018/2060] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:39:13 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:39:14.556890 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-a42d8d51-2b61-4104-aef1-7c36fb8a50bb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:14.557529 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-a42d8d51-2b61-4104-aef1-7c36fb8a50bb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:14.564088 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a42d8d51-2b61-4104-aef1-7c36fb8a50bb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:14.564667 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a42d8d51-2b61-4104-aef1-7c36fb8a50bb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:14.565418 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a42d8d51-2b61-4104-aef1-7c36fb8a50bb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:14.565848 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a42d8d51-2b61-4104-aef1-7c36fb8a50bb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:14.574695 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-fa4fb1e8-7e2e-4bdd-ae3b-80e66f466629 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:14.575314 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-fa4fb1e8-7e2e-4bdd-ae3b-80e66f466629 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:14.582648 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fa4fb1e8-7e2e-4bdd-ae3b-80e66f466629 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:14.583100 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fa4fb1e8-7e2e-4bdd-ae3b-80e66f466629 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:14.583869 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fa4fb1e8-7e2e-4bdd-ae3b-80e66f466629 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:14.584327 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fa4fb1e8-7e2e-4bdd-ae3b-80e66f466629 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:14.695484 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-a42d8d51-2b61-4104-aef1-7c36fb8a50bb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:14.703648 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-a42d8d51-2b61-4104-aef1-7c36fb8a50bb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.150526 May 24 15:39:14.704221 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1043/2061] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:14 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:14.712821 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-fa4fb1e8-7e2e-4bdd-ae3b-80e66f466629 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:14.720755 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-fa4fb1e8-7e2e-4bdd-ae3b-80e66f466629 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.149816 May 24 15:39:14.721312 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1019/2062] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:14 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:39:14.851224 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-9b6ed216-ffa3-41f1-a57e-9a9ddc1dbb44 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:14.851826 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-9b6ed216-ffa3-41f1-a57e-9a9ddc1dbb44 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:14.857786 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9b6ed216-ffa3-41f1-a57e-9a9ddc1dbb44 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:14.858226 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9b6ed216-ffa3-41f1-a57e-9a9ddc1dbb44 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:14.858973 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9b6ed216-ffa3-41f1-a57e-9a9ddc1dbb44 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:14.859400 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9b6ed216-ffa3-41f1-a57e-9a9ddc1dbb44 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:14.862600 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-459e02bd-8b81-48b7-accf-9660ea9885ba tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:14.863222 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-459e02bd-8b81-48b7-accf-9660ea9885ba tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:14.869283 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-459e02bd-8b81-48b7-accf-9660ea9885ba tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:14.869721 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-459e02bd-8b81-48b7-accf-9660ea9885ba tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:14.870474 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-459e02bd-8b81-48b7-accf-9660ea9885ba tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:14.870900 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-459e02bd-8b81-48b7-accf-9660ea9885ba tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:14.934437 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-459e02bd-8b81-48b7-accf-9660ea9885ba tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:14.943133 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-459e02bd-8b81-48b7-accf-9660ea9885ba tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:14.944647 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-459e02bd-8b81-48b7-accf-9660ea9885ba tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:14.945792 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-459e02bd-8b81-48b7-accf-9660ea9885ba tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.086914 May 24 15:39:14.946352 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1020/2063] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:39:14 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:39:14.987442 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-9b6ed216-ffa3-41f1-a57e-9a9ddc1dbb44 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:14.995622 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-9b6ed216-ffa3-41f1-a57e-9a9ddc1dbb44 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.148752 May 24 15:39:14.996179 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1044/2064] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:14 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:15.721062 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-4b50649c-9194-4c95-b0f3-11f839ef9186 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:15.721677 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-4b50649c-9194-4c95-b0f3-11f839ef9186 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:15.728733 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4b50649c-9194-4c95-b0f3-11f839ef9186 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:15.729182 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4b50649c-9194-4c95-b0f3-11f839ef9186 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:15.729939 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4b50649c-9194-4c95-b0f3-11f839ef9186 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:15.730373 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4b50649c-9194-4c95-b0f3-11f839ef9186 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:15.734352 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:39:15.737985 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-8de7f4d1-98f2-4098-9996-f0e8cad6487d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:15.739275 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-8de7f4d1-98f2-4098-9996-f0e8cad6487d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:15.745774 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8de7f4d1-98f2-4098-9996-f0e8cad6487d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:15.746301 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8de7f4d1-98f2-4098-9996-f0e8cad6487d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:15.746963 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8de7f4d1-98f2-4098-9996-f0e8cad6487d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:15.747393 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8de7f4d1-98f2-4098-9996-f0e8cad6487d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:15.861748 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-4b50649c-9194-4c95-b0f3-11f839ef9186 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:15.870549 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-4b50649c-9194-4c95-b0f3-11f839ef9186 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.153299 May 24 15:39:15.871475 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1021/2065] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:15 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:15.876957 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-8de7f4d1-98f2-4098-9996-f0e8cad6487d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:15.880371 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:39:15.885659 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-8de7f4d1-98f2-4098-9996-f0e8cad6487d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.151393 May 24 15:39:15.886211 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1045/2066] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:15 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:39:15.962763 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d68562cd-1b86-4cb5-a293-9481ac333aab tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:15.963371 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d68562cd-1b86-4cb5-a293-9481ac333aab tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:15.969339 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d68562cd-1b86-4cb5-a293-9481ac333aab tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:15.969783 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d68562cd-1b86-4cb5-a293-9481ac333aab tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:15.970540 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d68562cd-1b86-4cb5-a293-9481ac333aab tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:15.970974 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d68562cd-1b86-4cb5-a293-9481ac333aab tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:16.012956 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-60e916a9-f358-468b-934e-c8a09c474525 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:16.013699 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-60e916a9-f358-468b-934e-c8a09c474525 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:16.019822 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-60e916a9-f358-468b-934e-c8a09c474525 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:16.020262 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-60e916a9-f358-468b-934e-c8a09c474525 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:16.021049 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-60e916a9-f358-468b-934e-c8a09c474525 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:16.021483 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-60e916a9-f358-468b-934e-c8a09c474525 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:16.031539 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-d68562cd-1b86-4cb5-a293-9481ac333aab tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:16.040562 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-d68562cd-1b86-4cb5-a293-9481ac333aab tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:16.042067 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-d68562cd-1b86-4cb5-a293-9481ac333aab tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:16.043216 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d68562cd-1b86-4cb5-a293-9481ac333aab tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084287 May 24 15:39:16.043772 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1022/2067] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:39:15 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:39:16.147229 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-60e916a9-f358-468b-934e-c8a09c474525 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:16.155109 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-60e916a9-f358-468b-934e-c8a09c474525 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.146291 May 24 15:39:16.155664 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1046/2068] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:16 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:39:16.887466 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-5da067e1-aef6-42ca-b6b7-9687719ee163 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:16.888075 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-5da067e1-aef6-42ca-b6b7-9687719ee163 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:16.895163 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5da067e1-aef6-42ca-b6b7-9687719ee163 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:16.895642 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5da067e1-aef6-42ca-b6b7-9687719ee163 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:16.896512 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5da067e1-aef6-42ca-b6b7-9687719ee163 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:16.896990 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5da067e1-aef6-42ca-b6b7-9687719ee163 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:16.902597 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-dadea7f1-37da-485b-8ae4-4bc9ab03d5ff tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:16.903240 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-dadea7f1-37da-485b-8ae4-4bc9ab03d5ff tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:16.909417 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dadea7f1-37da-485b-8ae4-4bc9ab03d5ff tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:16.909861 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dadea7f1-37da-485b-8ae4-4bc9ab03d5ff tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:16.911292 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dadea7f1-37da-485b-8ae4-4bc9ab03d5ff tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:16.911717 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dadea7f1-37da-485b-8ae4-4bc9ab03d5ff tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:17.030776 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-5da067e1-aef6-42ca-b6b7-9687719ee163 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:17.039408 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-5da067e1-aef6-42ca-b6b7-9687719ee163 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.155782 May 24 15:39:17.040367 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1023/2069] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:16 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:17.043046 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-dadea7f1-37da-485b-8ae4-4bc9ab03d5ff tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:17.051010 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-dadea7f1-37da-485b-8ae4-4bc9ab03d5ff tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.152328 May 24 15:39:17.051556 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1047/2070] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:16 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:39:17.062826 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-70f8bad7-9f2a-4245-a5b6-9e64de038234 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:17.063438 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-70f8bad7-9f2a-4245-a5b6-9e64de038234 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:17.069589 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-70f8bad7-9f2a-4245-a5b6-9e64de038234 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:17.070037 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-70f8bad7-9f2a-4245-a5b6-9e64de038234 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:17.071252 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-70f8bad7-9f2a-4245-a5b6-9e64de038234 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:17.071252 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-70f8bad7-9f2a-4245-a5b6-9e64de038234 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:17.135086 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-70f8bad7-9f2a-4245-a5b6-9e64de038234 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:17.143650 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-70f8bad7-9f2a-4245-a5b6-9e64de038234 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:17.145678 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-70f8bad7-9f2a-4245-a5b6-9e64de038234 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:17.146866 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-70f8bad7-9f2a-4245-a5b6-9e64de038234 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.089034 May 24 15:39:17.147427 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1024/2071] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:39:17 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:39:17.172794 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-2a694a1d-0aaa-48e1-829b-a016da48a544 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:17.173400 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-2a694a1d-0aaa-48e1-829b-a016da48a544 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:17.179287 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2a694a1d-0aaa-48e1-829b-a016da48a544 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:17.179729 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2a694a1d-0aaa-48e1-829b-a016da48a544 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:17.180510 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2a694a1d-0aaa-48e1-829b-a016da48a544 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:17.180940 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2a694a1d-0aaa-48e1-829b-a016da48a544 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:17.320215 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-2a694a1d-0aaa-48e1-829b-a016da48a544 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:17.328218 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-2a694a1d-0aaa-48e1-829b-a016da48a544 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.159227 May 24 15:39:17.328810 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1048/2072] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:17 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:18.056927 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-01ce66c7-be2b-4657-b787-a905335abb76 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:18.057542 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-01ce66c7-be2b-4657-b787-a905335abb76 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:18.064085 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-01ce66c7-be2b-4657-b787-a905335abb76 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:18.064573 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-01ce66c7-be2b-4657-b787-a905335abb76 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:18.065346 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-01ce66c7-be2b-4657-b787-a905335abb76 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:18.065781 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-01ce66c7-be2b-4657-b787-a905335abb76 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:18.066768 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-b3910fe0-003b-4d5a-bb20-19200a7e8086 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:18.067390 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-b3910fe0-003b-4d5a-bb20-19200a7e8086 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:18.073952 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b3910fe0-003b-4d5a-bb20-19200a7e8086 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:18.074405 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b3910fe0-003b-4d5a-bb20-19200a7e8086 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:18.075184 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b3910fe0-003b-4d5a-bb20-19200a7e8086 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:18.075621 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b3910fe0-003b-4d5a-bb20-19200a7e8086 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:18.193320 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-01ce66c7-be2b-4657-b787-a905335abb76 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:18.201493 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-01ce66c7-be2b-4657-b787-a905335abb76 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.148285 May 24 15:39:18.202070 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1025/2073] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:18 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:18.203300 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-b3910fe0-003b-4d5a-bb20-19200a7e8086 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:18.206483 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-18c248b4-3182-4c51-a571-c9e0d50d6464 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:18.207298 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-18c248b4-3182-4c51-a571-c9e0d50d6464 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:18.211562 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-b3910fe0-003b-4d5a-bb20-19200a7e8086 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.148590 May 24 15:39:18.212138 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1049/2074] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:18 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:39:18.213015 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-18c248b4-3182-4c51-a571-c9e0d50d6464 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:18.213452 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-18c248b4-3182-4c51-a571-c9e0d50d6464 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:18.214209 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-18c248b4-3182-4c51-a571-c9e0d50d6464 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:18.214630 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-18c248b4-3182-4c51-a571-c9e0d50d6464 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:18.274065 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-18c248b4-3182-4c51-a571-c9e0d50d6464 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:18.282253 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-18c248b4-3182-4c51-a571-c9e0d50d6464 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:18.283740 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-18c248b4-3182-4c51-a571-c9e0d50d6464 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:18.284903 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-18c248b4-3182-4c51-a571-c9e0d50d6464 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.081936 May 24 15:39:18.285972 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1026/2075] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:39:18 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:39:18.345465 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-21d89705-afdb-463d-ae25-8bf61ace7718 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:18.346078 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-21d89705-afdb-463d-ae25-8bf61ace7718 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:18.352704 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-21d89705-afdb-463d-ae25-8bf61ace7718 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:18.353154 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-21d89705-afdb-463d-ae25-8bf61ace7718 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:18.353912 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-21d89705-afdb-463d-ae25-8bf61ace7718 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:18.354349 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-21d89705-afdb-463d-ae25-8bf61ace7718 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:18.485974 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-21d89705-afdb-463d-ae25-8bf61ace7718 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:18.494096 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-21d89705-afdb-463d-ae25-8bf61ace7718 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.152460 May 24 15:39:18.494664 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1050/2076] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:18 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:19.218277 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-079197fb-4cad-4f88-ba87-54f9834d571e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:19.218889 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-079197fb-4cad-4f88-ba87-54f9834d571e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:19.225444 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-079197fb-4cad-4f88-ba87-54f9834d571e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:19.225881 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-079197fb-4cad-4f88-ba87-54f9834d571e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:19.226639 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-079197fb-4cad-4f88-ba87-54f9834d571e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:19.227068 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-079197fb-4cad-4f88-ba87-54f9834d571e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:19.228332 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-ee9d9b53-4fe4-4497-aa4c-effcc3c6c805 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:19.228957 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-ee9d9b53-4fe4-4497-aa4c-effcc3c6c805 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:19.235613 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ee9d9b53-4fe4-4497-aa4c-effcc3c6c805 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:19.236059 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ee9d9b53-4fe4-4497-aa4c-effcc3c6c805 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:19.236878 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ee9d9b53-4fe4-4497-aa4c-effcc3c6c805 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:19.237300 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ee9d9b53-4fe4-4497-aa4c-effcc3c6c805 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:19.362554 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-079197fb-4cad-4f88-ba87-54f9834d571e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:19.364591 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ee9d9b53-4fe4-4497-aa4c-effcc3c6c805 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:19.371391 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-079197fb-4cad-4f88-ba87-54f9834d571e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.156905 May 24 15:39:19.371961 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1027/2077] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:19 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:19.372785 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-ee9d9b53-4fe4-4497-aa4c-effcc3c6c805 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.148226 May 24 15:39:19.373508 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1051/2078] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:19 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:39:19.376334 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d47f4a6f-140f-4042-bc0f-22fd6c160d7d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:19.376944 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d47f4a6f-140f-4042-bc0f-22fd6c160d7d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:19.383300 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d47f4a6f-140f-4042-bc0f-22fd6c160d7d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:19.383743 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d47f4a6f-140f-4042-bc0f-22fd6c160d7d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:19.384538 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d47f4a6f-140f-4042-bc0f-22fd6c160d7d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:19.384969 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d47f4a6f-140f-4042-bc0f-22fd6c160d7d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:19.445158 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-d47f4a6f-140f-4042-bc0f-22fd6c160d7d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:19.453434 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-d47f4a6f-140f-4042-bc0f-22fd6c160d7d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:19.454933 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-d47f4a6f-140f-4042-bc0f-22fd6c160d7d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:19.456094 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d47f4a6f-140f-4042-bc0f-22fd6c160d7d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.083199 May 24 15:39:19.456697 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1028/2079] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:39:19 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:39:19.509910 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-4bd10243-3304-425d-98b5-3e84a3e44b8f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:19.510452 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-4bd10243-3304-425d-98b5-3e84a3e44b8f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:19.516356 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4bd10243-3304-425d-98b5-3e84a3e44b8f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:19.516801 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4bd10243-3304-425d-98b5-3e84a3e44b8f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:19.517547 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4bd10243-3304-425d-98b5-3e84a3e44b8f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:19.517973 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4bd10243-3304-425d-98b5-3e84a3e44b8f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:19.643529 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-4bd10243-3304-425d-98b5-3e84a3e44b8f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:19.651368 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-4bd10243-3304-425d-98b5-3e84a3e44b8f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.145289 May 24 15:39:19.651925 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1052/2080] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:19 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:20.388965 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-c9d7be2c-ac06-4394-b9d3-d16e52f4de88 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:20.389501 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-c9d7be2c-ac06-4394-b9d3-d16e52f4de88 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:20.389654 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-8d43bf67-36f8-474b-8416-2c5494fc086a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:20.390265 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-8d43bf67-36f8-474b-8416-2c5494fc086a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:20.396108 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c9d7be2c-ac06-4394-b9d3-d16e52f4de88 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:20.396581 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c9d7be2c-ac06-4394-b9d3-d16e52f4de88 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:20.396793 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8d43bf67-36f8-474b-8416-2c5494fc086a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:20.397243 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8d43bf67-36f8-474b-8416-2c5494fc086a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:20.397348 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c9d7be2c-ac06-4394-b9d3-d16e52f4de88 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:20.397752 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c9d7be2c-ac06-4394-b9d3-d16e52f4de88 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:20.398002 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8d43bf67-36f8-474b-8416-2c5494fc086a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:20.398435 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8d43bf67-36f8-474b-8416-2c5494fc086a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:20.530032 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-8d43bf67-36f8-474b-8416-2c5494fc086a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:20.532837 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-c9d7be2c-ac06-4394-b9d3-d16e52f4de88 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:20.538539 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-8d43bf67-36f8-474b-8416-2c5494fc086a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.152670 May 24 15:39:20.539101 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1053/2081] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:20 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:39:20.541586 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-c9d7be2c-ac06-4394-b9d3-d16e52f4de88 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.156483 May 24 15:39:20.542289 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1029/2082] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:20 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:20.543502 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-9d6ab545-eb82-4c50-9311-5a1c8baa290b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:20.544099 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-9d6ab545-eb82-4c50-9311-5a1c8baa290b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:20.549903 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9d6ab545-eb82-4c50-9311-5a1c8baa290b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:20.550425 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9d6ab545-eb82-4c50-9311-5a1c8baa290b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:20.551736 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9d6ab545-eb82-4c50-9311-5a1c8baa290b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:20.552163 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9d6ab545-eb82-4c50-9311-5a1c8baa290b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:20.616236 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-9d6ab545-eb82-4c50-9311-5a1c8baa290b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:20.625011 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-9d6ab545-eb82-4c50-9311-5a1c8baa290b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:20.626486 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-9d6ab545-eb82-4c50-9311-5a1c8baa290b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:20.627886 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-9d6ab545-eb82-4c50-9311-5a1c8baa290b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.087620 May 24 15:39:20.628478 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1054/2083] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:39:20 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:39:20.668674 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-5351517b-0c97-4e83-b8d2-0304c810f7d7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:20.669212 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-5351517b-0c97-4e83-b8d2-0304c810f7d7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:20.675148 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5351517b-0c97-4e83-b8d2-0304c810f7d7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:20.675631 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5351517b-0c97-4e83-b8d2-0304c810f7d7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:20.676412 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5351517b-0c97-4e83-b8d2-0304c810f7d7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:20.676839 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5351517b-0c97-4e83-b8d2-0304c810f7d7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:21.017921 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-5351517b-0c97-4e83-b8d2-0304c810f7d7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:21.026567 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-5351517b-0c97-4e83-b8d2-0304c810f7d7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.361740 May 24 15:39:21.027172 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1030/2084] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:20 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:21.555432 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-469bd60e-3411-4e73-9ae9-8e5aa30b5aed tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:21.556063 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-469bd60e-3411-4e73-9ae9-8e5aa30b5aed tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:21.558905 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-5d9e48a3-f57c-4d5e-89ff-39deea8948ec tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:21.559521 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-5d9e48a3-f57c-4d5e-89ff-39deea8948ec tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:21.562747 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-469bd60e-3411-4e73-9ae9-8e5aa30b5aed tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:21.563187 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-469bd60e-3411-4e73-9ae9-8e5aa30b5aed tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:21.563934 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-469bd60e-3411-4e73-9ae9-8e5aa30b5aed tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:21.564384 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-469bd60e-3411-4e73-9ae9-8e5aa30b5aed tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:21.566024 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5d9e48a3-f57c-4d5e-89ff-39deea8948ec tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:21.566702 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5d9e48a3-f57c-4d5e-89ff-39deea8948ec tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:21.567299 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5d9e48a3-f57c-4d5e-89ff-39deea8948ec tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:21.567732 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5d9e48a3-f57c-4d5e-89ff-39deea8948ec tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:21.698064 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-5d9e48a3-f57c-4d5e-89ff-39deea8948ec tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:21.698855 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-469bd60e-3411-4e73-9ae9-8e5aa30b5aed tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:21.706242 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-5d9e48a3-f57c-4d5e-89ff-39deea8948ec tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.151331 May 24 15:39:21.707525 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1031/2085] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:21 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:39:21.707657 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-469bd60e-3411-4e73-9ae9-8e5aa30b5aed tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.155380 May 24 15:39:21.708067 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1055/2086] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:21 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:21.711914 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-17e01f5c-2e4e-4723-9ed8-c9dea501ed5f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:21.712537 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-17e01f5c-2e4e-4723-9ed8-c9dea501ed5f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:21.718287 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-17e01f5c-2e4e-4723-9ed8-c9dea501ed5f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:21.718725 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-17e01f5c-2e4e-4723-9ed8-c9dea501ed5f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:21.719479 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-17e01f5c-2e4e-4723-9ed8-c9dea501ed5f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:21.719905 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-17e01f5c-2e4e-4723-9ed8-c9dea501ed5f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:21.780869 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-17e01f5c-2e4e-4723-9ed8-c9dea501ed5f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:21.789192 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-17e01f5c-2e4e-4723-9ed8-c9dea501ed5f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:21.790672 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-17e01f5c-2e4e-4723-9ed8-c9dea501ed5f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:21.791795 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-17e01f5c-2e4e-4723-9ed8-c9dea501ed5f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.083489 May 24 15:39:21.792376 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1032/2087] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:39:21 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:39:22.042852 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-0ece6072-6723-4935-81c1-025e1ea155a4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:22.043454 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-0ece6072-6723-4935-81c1-025e1ea155a4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:22.049429 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0ece6072-6723-4935-81c1-025e1ea155a4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:22.049868 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0ece6072-6723-4935-81c1-025e1ea155a4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:22.050606 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0ece6072-6723-4935-81c1-025e1ea155a4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:22.051033 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0ece6072-6723-4935-81c1-025e1ea155a4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:22.176447 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-0ece6072-6723-4935-81c1-025e1ea155a4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:22.184556 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-0ece6072-6723-4935-81c1-025e1ea155a4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.145458 May 24 15:39:22.185115 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1056/2088] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:22 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:22.723693 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e23176c1-42ea-4c7c-9c2b-70c241caff0c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:22.724394 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-e23176c1-42ea-4c7c-9c2b-70c241caff0c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:22.724545 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d1b5a860-095f-4f07-8842-7c561db6e52f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:22.725008 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d1b5a860-095f-4f07-8842-7c561db6e52f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:22.730959 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e23176c1-42ea-4c7c-9c2b-70c241caff0c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:22.731400 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e23176c1-42ea-4c7c-9c2b-70c241caff0c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:22.731519 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d1b5a860-095f-4f07-8842-7c561db6e52f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:22.731860 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d1b5a860-095f-4f07-8842-7c561db6e52f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:22.732151 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e23176c1-42ea-4c7c-9c2b-70c241caff0c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:22.732604 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e23176c1-42ea-4c7c-9c2b-70c241caff0c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:22.732717 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d1b5a860-095f-4f07-8842-7c561db6e52f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:22.733060 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d1b5a860-095f-4f07-8842-7c561db6e52f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:22.865407 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-e23176c1-42ea-4c7c-9c2b-70c241caff0c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:22.873894 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-e23176c1-42ea-4c7c-9c2b-70c241caff0c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.154491 May 24 15:39:22.874477 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1033/2089] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:22 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:22.879068 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-38764c87-d3e0-4b6f-812c-f03934873860 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:22.879677 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-38764c87-d3e0-4b6f-812c-f03934873860 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:22.885752 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-38764c87-d3e0-4b6f-812c-f03934873860 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:22.886199 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-38764c87-d3e0-4b6f-812c-f03934873860 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:22.886967 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-38764c87-d3e0-4b6f-812c-f03934873860 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:22.887401 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-38764c87-d3e0-4b6f-812c-f03934873860 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:22.918046 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-d1b5a860-095f-4f07-8842-7c561db6e52f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:22.926898 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d1b5a860-095f-4f07-8842-7c561db6e52f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.206734 May 24 15:39:22.927677 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1057/2090] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:22 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:39:22.949399 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-38764c87-d3e0-4b6f-812c-f03934873860 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:22.959385 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-38764c87-d3e0-4b6f-812c-f03934873860 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:22.960936 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-38764c87-d3e0-4b6f-812c-f03934873860 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:22.962074 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-38764c87-d3e0-4b6f-812c-f03934873860 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.086691 May 24 15:39:22.962634 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1034/2091] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:39:22 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:39:23.201373 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e971778e-3941-49c7-bd1e-b153a0e19e47 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:23.201990 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e971778e-3941-49c7-bd1e-b153a0e19e47 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:23.208475 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e971778e-3941-49c7-bd1e-b153a0e19e47 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:23.208928 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e971778e-3941-49c7-bd1e-b153a0e19e47 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:23.209688 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e971778e-3941-49c7-bd1e-b153a0e19e47 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:23.210125 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e971778e-3941-49c7-bd1e-b153a0e19e47 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:23.393637 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e971778e-3941-49c7-bd1e-b153a0e19e47 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:23.402422 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e971778e-3941-49c7-bd1e-b153a0e19e47 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.204947 May 24 15:39:23.402987 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1058/2092] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:23 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:23.890898 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-3168aae7-7b0b-40df-b9ef-13084795d8b1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:23.891507 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-3168aae7-7b0b-40df-b9ef-13084795d8b1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:23.898165 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3168aae7-7b0b-40df-b9ef-13084795d8b1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:23.898607 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3168aae7-7b0b-40df-b9ef-13084795d8b1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:23.899356 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3168aae7-7b0b-40df-b9ef-13084795d8b1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:23.899784 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3168aae7-7b0b-40df-b9ef-13084795d8b1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:23.945229 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e8da6e15-f535-40f6-b972-827323f4d97b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:23.945866 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e8da6e15-f535-40f6-b972-827323f4d97b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:23.952441 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e8da6e15-f535-40f6-b972-827323f4d97b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:23.952893 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e8da6e15-f535-40f6-b972-827323f4d97b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:23.953651 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e8da6e15-f535-40f6-b972-827323f4d97b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:23.954086 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e8da6e15-f535-40f6-b972-827323f4d97b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:24.025977 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-3168aae7-7b0b-40df-b9ef-13084795d8b1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:24.034261 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-3168aae7-7b0b-40df-b9ef-13084795d8b1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.147161 May 24 15:39:24.034773 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1035/2093] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:23 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:24.040872 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-6ddf2701-4e39-42a0-acd9-4bd58e394fc0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:24.041473 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-6ddf2701-4e39-42a0-acd9-4bd58e394fc0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:24.047340 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6ddf2701-4e39-42a0-acd9-4bd58e394fc0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:24.047781 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6ddf2701-4e39-42a0-acd9-4bd58e394fc0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:24.048611 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6ddf2701-4e39-42a0-acd9-4bd58e394fc0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:24.049037 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6ddf2701-4e39-42a0-acd9-4bd58e394fc0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:24.085566 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e8da6e15-f535-40f6-b972-827323f4d97b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:24.093643 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e8da6e15-f535-40f6-b972-827323f4d97b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.152872 May 24 15:39:24.094217 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1059/2094] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:23 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:39:24.116054 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-6ddf2701-4e39-42a0-acd9-4bd58e394fc0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:24.124488 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-6ddf2701-4e39-42a0-acd9-4bd58e394fc0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:24.125980 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-6ddf2701-4e39-42a0-acd9-4bd58e394fc0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:24.127119 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-6ddf2701-4e39-42a0-acd9-4bd58e394fc0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.090906 May 24 15:39:24.127677 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1036/2095] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:39:24 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:39:24.419009 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c6e2213e-89f9-4977-93ed-36fd6845aee6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:24.419624 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-c6e2213e-89f9-4977-93ed-36fd6845aee6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:24.425749 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c6e2213e-89f9-4977-93ed-36fd6845aee6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:24.426198 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c6e2213e-89f9-4977-93ed-36fd6845aee6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:24.426952 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c6e2213e-89f9-4977-93ed-36fd6845aee6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:24.427385 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c6e2213e-89f9-4977-93ed-36fd6845aee6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:24.553144 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-c6e2213e-89f9-4977-93ed-36fd6845aee6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:24.560963 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-c6e2213e-89f9-4977-93ed-36fd6845aee6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.145801 May 24 15:39:24.561527 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1060/2096] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:24 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:25.051584 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-21775937-b0d9-4bce-a1a7-e4d981cda15f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:25.052192 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-21775937-b0d9-4bce-a1a7-e4d981cda15f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:25.058816 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-21775937-b0d9-4bce-a1a7-e4d981cda15f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:25.059254 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-21775937-b0d9-4bce-a1a7-e4d981cda15f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:25.060005 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-21775937-b0d9-4bce-a1a7-e4d981cda15f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:25.060472 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-21775937-b0d9-4bce-a1a7-e4d981cda15f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:25.111036 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-ef55a4f8-e038-46f6-9800-ff67d2d16872 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:25.111678 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-ef55a4f8-e038-46f6-9800-ff67d2d16872 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:25.119003 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ef55a4f8-e038-46f6-9800-ff67d2d16872 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:25.119442 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ef55a4f8-e038-46f6-9800-ff67d2d16872 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:25.120198 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ef55a4f8-e038-46f6-9800-ff67d2d16872 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:25.120656 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ef55a4f8-e038-46f6-9800-ff67d2d16872 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:25.188159 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-21775937-b0d9-4bce-a1a7-e4d981cda15f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:25.192263 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:39:25.197931 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-21775937-b0d9-4bce-a1a7-e4d981cda15f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.150195 May 24 15:39:25.198885 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1037/2097] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:25 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:25.203196 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-598ba0ff-c4d1-456d-a32c-dc2d253d4b13 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:25.203744 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-598ba0ff-c4d1-456d-a32c-dc2d253d4b13 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:25.209644 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-598ba0ff-c4d1-456d-a32c-dc2d253d4b13 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:25.210095 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-598ba0ff-c4d1-456d-a32c-dc2d253d4b13 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:25.210894 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-598ba0ff-c4d1-456d-a32c-dc2d253d4b13 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:25.211326 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-598ba0ff-c4d1-456d-a32c-dc2d253d4b13 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:25.249475 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ef55a4f8-e038-46f6-9800-ff67d2d16872 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:25.258733 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-ef55a4f8-e038-46f6-9800-ff67d2d16872 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.151504 May 24 15:39:25.259314 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1061/2098] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:25 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:39:25.274998 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-598ba0ff-c4d1-456d-a32c-dc2d253d4b13 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:25.283439 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-598ba0ff-c4d1-456d-a32c-dc2d253d4b13 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:25.285018 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-598ba0ff-c4d1-456d-a32c-dc2d253d4b13 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:25.286153 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-598ba0ff-c4d1-456d-a32c-dc2d253d4b13 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.086749 May 24 15:39:25.286708 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1038/2099] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:39:25 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:39:25.577706 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-fd6d27a3-66c8-4160-be5b-1086d3824ffc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:25.578338 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-fd6d27a3-66c8-4160-be5b-1086d3824ffc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:25.584346 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fd6d27a3-66c8-4160-be5b-1086d3824ffc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:25.584785 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fd6d27a3-66c8-4160-be5b-1086d3824ffc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:25.585525 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fd6d27a3-66c8-4160-be5b-1086d3824ffc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:25.585950 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fd6d27a3-66c8-4160-be5b-1086d3824ffc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:25.603882 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:39:25.718533 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-fd6d27a3-66c8-4160-be5b-1086d3824ffc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:25.726814 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-fd6d27a3-66c8-4160-be5b-1086d3824ffc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.152932 May 24 15:39:25.727376 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1062/2100] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:25 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:26.214599 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-31bd3358-655a-42fa-a13c-041d77d041e2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:26.215203 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-31bd3358-655a-42fa-a13c-041d77d041e2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:26.221778 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-31bd3358-655a-42fa-a13c-041d77d041e2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:26.222221 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-31bd3358-655a-42fa-a13c-041d77d041e2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:26.223600 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-31bd3358-655a-42fa-a13c-041d77d041e2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:26.224023 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-31bd3358-655a-42fa-a13c-041d77d041e2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:26.275466 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-7922d2ae-35f5-411d-bec9-65f3d03ecc53 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:26.276068 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-7922d2ae-35f5-411d-bec9-65f3d03ecc53 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:26.282575 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7922d2ae-35f5-411d-bec9-65f3d03ecc53 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:26.283000 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7922d2ae-35f5-411d-bec9-65f3d03ecc53 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:26.283748 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7922d2ae-35f5-411d-bec9-65f3d03ecc53 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:26.284177 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7922d2ae-35f5-411d-bec9-65f3d03ecc53 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:26.355778 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-31bd3358-655a-42fa-a13c-041d77d041e2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:26.363749 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-31bd3358-655a-42fa-a13c-041d77d041e2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.153009 May 24 15:39:26.364342 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1039/2101] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:26 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:26.369013 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-7c6890ef-8913-4127-914f-371467f7ae7c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:26.369613 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-7c6890ef-8913-4127-914f-371467f7ae7c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:26.375384 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7c6890ef-8913-4127-914f-371467f7ae7c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:26.375823 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7c6890ef-8913-4127-914f-371467f7ae7c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:26.376599 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7c6890ef-8913-4127-914f-371467f7ae7c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:26.377026 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7c6890ef-8913-4127-914f-371467f7ae7c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:26.412221 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-7922d2ae-35f5-411d-bec9-65f3d03ecc53 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:26.420235 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-7922d2ae-35f5-411d-bec9-65f3d03ecc53 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.148515 May 24 15:39:26.421023 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1063/2102] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:26 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:39:26.437567 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-7c6890ef-8913-4127-914f-371467f7ae7c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:26.446629 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-7c6890ef-8913-4127-914f-371467f7ae7c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:26.448124 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-7c6890ef-8913-4127-914f-371467f7ae7c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:26.449323 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-7c6890ef-8913-4127-914f-371467f7ae7c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084076 May 24 15:39:26.449914 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1040/2103] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:39:26 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:39:26.743694 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-59a88484-7329-4fb1-9ec9-5cbaa968cfc8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:26.744362 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-59a88484-7329-4fb1-9ec9-5cbaa968cfc8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:26.750391 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-59a88484-7329-4fb1-9ec9-5cbaa968cfc8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:26.750837 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-59a88484-7329-4fb1-9ec9-5cbaa968cfc8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:26.751586 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-59a88484-7329-4fb1-9ec9-5cbaa968cfc8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:26.752017 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-59a88484-7329-4fb1-9ec9-5cbaa968cfc8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:26.875198 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-59a88484-7329-4fb1-9ec9-5cbaa968cfc8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:26.883710 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-59a88484-7329-4fb1-9ec9-5cbaa968cfc8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.144097 May 24 15:39:26.884275 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1064/2104] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:26 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:27.380741 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-080d734a-9162-4244-8881-68c541f1d1a8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:27.381272 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-080d734a-9162-4244-8881-68c541f1d1a8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:27.388808 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-080d734a-9162-4244-8881-68c541f1d1a8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:27.389247 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-080d734a-9162-4244-8881-68c541f1d1a8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:27.390008 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-080d734a-9162-4244-8881-68c541f1d1a8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:27.390437 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-080d734a-9162-4244-8881-68c541f1d1a8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:27.437205 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d8bb6474-a3d3-45e8-83f0-26484526989b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:27.437817 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d8bb6474-a3d3-45e8-83f0-26484526989b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:27.444219 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d8bb6474-a3d3-45e8-83f0-26484526989b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:27.444701 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d8bb6474-a3d3-45e8-83f0-26484526989b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:27.445458 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d8bb6474-a3d3-45e8-83f0-26484526989b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:27.445891 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d8bb6474-a3d3-45e8-83f0-26484526989b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:27.517564 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-080d734a-9162-4244-8881-68c541f1d1a8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:27.526128 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-080d734a-9162-4244-8881-68c541f1d1a8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.149256 May 24 15:39:27.526700 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1041/2105] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:27 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:27.531265 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-2504133e-13d0-4dfe-a17c-65119a01df91 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:27.531868 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-2504133e-13d0-4dfe-a17c-65119a01df91 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:27.538328 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2504133e-13d0-4dfe-a17c-65119a01df91 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:27.538773 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2504133e-13d0-4dfe-a17c-65119a01df91 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:27.539535 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2504133e-13d0-4dfe-a17c-65119a01df91 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:27.539966 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2504133e-13d0-4dfe-a17c-65119a01df91 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:27.575017 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-d8bb6474-a3d3-45e8-83f0-26484526989b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:27.583536 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d8bb6474-a3d3-45e8-83f0-26484526989b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.150100 May 24 15:39:27.584106 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1065/2106] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:27 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:39:27.603385 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-2504133e-13d0-4dfe-a17c-65119a01df91 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:27.611821 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-2504133e-13d0-4dfe-a17c-65119a01df91 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:27.613346 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-2504133e-13d0-4dfe-a17c-65119a01df91 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:27.614477 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-2504133e-13d0-4dfe-a17c-65119a01df91 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.086873 May 24 15:39:27.615029 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1042/2107] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:39:27 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:39:27.901437 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-595ef4f6-c63f-4b9a-a37c-b58f547175f0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:27.902056 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-595ef4f6-c63f-4b9a-a37c-b58f547175f0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:27.908026 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-595ef4f6-c63f-4b9a-a37c-b58f547175f0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:27.908527 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-595ef4f6-c63f-4b9a-a37c-b58f547175f0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:27.909310 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-595ef4f6-c63f-4b9a-a37c-b58f547175f0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:27.909740 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-595ef4f6-c63f-4b9a-a37c-b58f547175f0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:28.033786 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-595ef4f6-c63f-4b9a-a37c-b58f547175f0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:28.041838 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-595ef4f6-c63f-4b9a-a37c-b58f547175f0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.144517 May 24 15:39:28.042398 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1066/2108] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:27 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:28.543304 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-82545283-ccfc-4423-91bb-be1e31f399ff tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:28.543916 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-82545283-ccfc-4423-91bb-be1e31f399ff tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:28.551130 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-82545283-ccfc-4423-91bb-be1e31f399ff tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:28.551611 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-82545283-ccfc-4423-91bb-be1e31f399ff tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:28.552420 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-82545283-ccfc-4423-91bb-be1e31f399ff tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:28.552860 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-82545283-ccfc-4423-91bb-be1e31f399ff tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:28.600491 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-79682dbe-b824-439e-af3c-3b0b910a94e3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:28.601209 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-79682dbe-b824-439e-af3c-3b0b910a94e3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:28.607789 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-79682dbe-b824-439e-af3c-3b0b910a94e3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:28.608240 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-79682dbe-b824-439e-af3c-3b0b910a94e3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:28.609025 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-79682dbe-b824-439e-af3c-3b0b910a94e3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:28.609460 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-79682dbe-b824-439e-af3c-3b0b910a94e3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:28.680981 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-82545283-ccfc-4423-91bb-be1e31f399ff tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:28.689244 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-82545283-ccfc-4423-91bb-be1e31f399ff tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.149654 May 24 15:39:28.689605 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1043/2109] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:28 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:28.694123 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-c0a17d16-e26d-4f01-9c2b-f228d6c2773d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:28.694729 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-c0a17d16-e26d-4f01-9c2b-f228d6c2773d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:28.700921 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c0a17d16-e26d-4f01-9c2b-f228d6c2773d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:28.701372 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c0a17d16-e26d-4f01-9c2b-f228d6c2773d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:28.702135 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c0a17d16-e26d-4f01-9c2b-f228d6c2773d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:28.702565 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c0a17d16-e26d-4f01-9c2b-f228d6c2773d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:28.741067 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-79682dbe-b824-439e-af3c-3b0b910a94e3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:28.749179 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-79682dbe-b824-439e-af3c-3b0b910a94e3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.153041 May 24 15:39:28.749761 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1067/2110] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:28 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:39:28.764144 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-c0a17d16-e26d-4f01-9c2b-f228d6c2773d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:28.772574 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-c0a17d16-e26d-4f01-9c2b-f228d6c2773d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:28.774068 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-c0a17d16-e26d-4f01-9c2b-f228d6c2773d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:28.775201 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-c0a17d16-e26d-4f01-9c2b-f228d6c2773d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084689 May 24 15:39:28.775755 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1044/2111] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:39:28 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:39:29.058468 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-99d34e9c-f065-45ad-8b17-ff866c0abe88 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:29.059084 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-99d34e9c-f065-45ad-8b17-ff866c0abe88 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:29.065154 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-99d34e9c-f065-45ad-8b17-ff866c0abe88 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:29.065605 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-99d34e9c-f065-45ad-8b17-ff866c0abe88 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:29.066366 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-99d34e9c-f065-45ad-8b17-ff866c0abe88 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:29.066803 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-99d34e9c-f065-45ad-8b17-ff866c0abe88 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:29.192710 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-99d34e9c-f065-45ad-8b17-ff866c0abe88 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:29.200558 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-99d34e9c-f065-45ad-8b17-ff866c0abe88 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.145899 May 24 15:39:29.201126 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1068/2112] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:29 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:29.705842 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a0c65d3b-60b2-4e91-839a-bba915c29354 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:29.706533 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a0c65d3b-60b2-4e91-839a-bba915c29354 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:29.718523 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a0c65d3b-60b2-4e91-839a-bba915c29354 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:29.718523 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a0c65d3b-60b2-4e91-839a-bba915c29354 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:29.718523 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a0c65d3b-60b2-4e91-839a-bba915c29354 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:29.718523 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a0c65d3b-60b2-4e91-839a-bba915c29354 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:29.766132 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-cf6f4341-beb8-4307-881b-89fa4c70b5e0 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:29.766746 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-cf6f4341-beb8-4307-881b-89fa4c70b5e0 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:29.773322 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cf6f4341-beb8-4307-881b-89fa4c70b5e0 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:29.773776 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cf6f4341-beb8-4307-881b-89fa4c70b5e0 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:29.774531 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cf6f4341-beb8-4307-881b-89fa4c70b5e0 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:29.774967 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cf6f4341-beb8-4307-881b-89fa4c70b5e0 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:29.844355 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-a0c65d3b-60b2-4e91-839a-bba915c29354 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:29.852481 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a0c65d3b-60b2-4e91-839a-bba915c29354 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.150413 May 24 15:39:29.853064 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1045/2113] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:29 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:29.857475 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-eef04dc5-df31-431a-b535-da7450a242f2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:29.858082 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-eef04dc5-df31-431a-b535-da7450a242f2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:29.864575 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-eef04dc5-df31-431a-b535-da7450a242f2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:29.865024 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-eef04dc5-df31-431a-b535-da7450a242f2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:29.866060 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-eef04dc5-df31-431a-b535-da7450a242f2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:29.866495 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-eef04dc5-df31-431a-b535-da7450a242f2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:29.905122 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-cf6f4341-beb8-4307-881b-89fa4c70b5e0 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:29.913061 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-cf6f4341-beb8-4307-881b-89fa4c70b5e0 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.150767 May 24 15:39:29.913632 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1069/2114] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:29 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:39:29.929595 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-eef04dc5-df31-431a-b535-da7450a242f2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:29.938086 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-eef04dc5-df31-431a-b535-da7450a242f2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:29.939581 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-eef04dc5-df31-431a-b535-da7450a242f2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:29.940753 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-eef04dc5-df31-431a-b535-da7450a242f2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.086774 May 24 15:39:29.941955 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1046/2115] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:39:29 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:39:30.217817 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e9588677-7bc8-4a04-9c35-67903c5ddd27 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:30.218425 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e9588677-7bc8-4a04-9c35-67903c5ddd27 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:30.220265 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_api:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:39:30.226954 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e9588677-7bc8-4a04-9c35-67903c5ddd27 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:30.227401 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e9588677-7bc8-4a04-9c35-67903c5ddd27 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:30.228159 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e9588677-7bc8-4a04-9c35-67903c5ddd27 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:30.228624 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e9588677-7bc8-4a04-9c35-67903c5ddd27 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:30.353567 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e9588677-7bc8-4a04-9c35-67903c5ddd27 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:30.361454 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e9588677-7bc8-4a04-9c35-67903c5ddd27 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.147468 May 24 15:39:30.362016 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1070/2116] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:30 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:30.869295 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a6027da8-a9ff-42ec-82bb-6da1a55fde61 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:30.869905 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a6027da8-a9ff-42ec-82bb-6da1a55fde61 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:30.876439 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a6027da8-a9ff-42ec-82bb-6da1a55fde61 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:30.876888 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a6027da8-a9ff-42ec-82bb-6da1a55fde61 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:30.877642 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a6027da8-a9ff-42ec-82bb-6da1a55fde61 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:30.878072 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a6027da8-a9ff-42ec-82bb-6da1a55fde61 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:30.930127 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-25c7f7d8-73bc-45c7-a6b9-6215c2616434 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:30.930828 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-25c7f7d8-73bc-45c7-a6b9-6215c2616434 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:30.937397 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-25c7f7d8-73bc-45c7-a6b9-6215c2616434 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:30.937837 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-25c7f7d8-73bc-45c7-a6b9-6215c2616434 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:30.938592 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-25c7f7d8-73bc-45c7-a6b9-6215c2616434 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:30.939027 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-25c7f7d8-73bc-45c7-a6b9-6215c2616434 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:31.005835 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-a6027da8-a9ff-42ec-82bb-6da1a55fde61 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:31.014134 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a6027da8-a9ff-42ec-82bb-6da1a55fde61 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.148910 May 24 15:39:31.014703 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1047/2117] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:30 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:31.019868 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-7329c2a3-919c-407f-aa35-13a138f0a507 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:31.020503 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-7329c2a3-919c-407f-aa35-13a138f0a507 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:31.026381 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7329c2a3-919c-407f-aa35-13a138f0a507 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:31.026824 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7329c2a3-919c-407f-aa35-13a138f0a507 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:31.027577 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7329c2a3-919c-407f-aa35-13a138f0a507 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:31.028004 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7329c2a3-919c-407f-aa35-13a138f0a507 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:31.069347 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-25c7f7d8-73bc-45c7-a6b9-6215c2616434 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:31.077960 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-25c7f7d8-73bc-45c7-a6b9-6215c2616434 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.151589 May 24 15:39:31.078810 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1071/2118] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:30 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:39:31.093107 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-7329c2a3-919c-407f-aa35-13a138f0a507 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:31.101709 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-7329c2a3-919c-407f-aa35-13a138f0a507 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:31.103214 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-7329c2a3-919c-407f-aa35-13a138f0a507 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:31.104385 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-7329c2a3-919c-407f-aa35-13a138f0a507 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.088757 May 24 15:39:31.104953 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1048/2119] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:39:31 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:39:31.379158 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-7b564aa3-6fa8-44d3-9cb0-3b66ae36ed73 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:31.379768 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-7b564aa3-6fa8-44d3-9cb0-3b66ae36ed73 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:31.386047 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7b564aa3-6fa8-44d3-9cb0-3b66ae36ed73 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:31.386494 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7b564aa3-6fa8-44d3-9cb0-3b66ae36ed73 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:31.387248 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7b564aa3-6fa8-44d3-9cb0-3b66ae36ed73 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:31.387674 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7b564aa3-6fa8-44d3-9cb0-3b66ae36ed73 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:31.514057 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-7b564aa3-6fa8-44d3-9cb0-3b66ae36ed73 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:31.521922 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-7b564aa3-6fa8-44d3-9cb0-3b66ae36ed73 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.147161 May 24 15:39:31.522479 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1072/2120] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:31 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:32.030925 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-0eff09a2-8ad2-4226-a27b-fe098ef70088 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:32.031568 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-0eff09a2-8ad2-4226-a27b-fe098ef70088 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:32.038925 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0eff09a2-8ad2-4226-a27b-fe098ef70088 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:32.039369 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0eff09a2-8ad2-4226-a27b-fe098ef70088 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:32.040126 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0eff09a2-8ad2-4226-a27b-fe098ef70088 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:32.040591 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0eff09a2-8ad2-4226-a27b-fe098ef70088 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:32.094999 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-f35311ca-f2ec-4c1c-9eca-eed75e30cb85 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:32.095607 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-f35311ca-f2ec-4c1c-9eca-eed75e30cb85 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:32.102689 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f35311ca-f2ec-4c1c-9eca-eed75e30cb85 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:32.103136 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f35311ca-f2ec-4c1c-9eca-eed75e30cb85 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:32.103919 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f35311ca-f2ec-4c1c-9eca-eed75e30cb85 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:32.104374 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f35311ca-f2ec-4c1c-9eca-eed75e30cb85 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:32.169445 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-0eff09a2-8ad2-4226-a27b-fe098ef70088 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:32.177435 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-0eff09a2-8ad2-4226-a27b-fe098ef70088 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.150366 May 24 15:39:32.178000 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1049/2121] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:32 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:32.182378 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-fe863086-9a05-4f3a-a828-f0229f826b7e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:32.182974 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-fe863086-9a05-4f3a-a828-f0229f826b7e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:32.188785 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fe863086-9a05-4f3a-a828-f0229f826b7e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:32.189226 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fe863086-9a05-4f3a-a828-f0229f826b7e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:32.189980 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fe863086-9a05-4f3a-a828-f0229f826b7e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:32.190408 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fe863086-9a05-4f3a-a828-f0229f826b7e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:32.232445 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-f35311ca-f2ec-4c1c-9eca-eed75e30cb85 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:32.240954 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-f35311ca-f2ec-4c1c-9eca-eed75e30cb85 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.149367 May 24 15:39:32.241517 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1073/2122] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:32 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:39:32.250616 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-fe863086-9a05-4f3a-a828-f0229f826b7e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:32.259967 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-fe863086-9a05-4f3a-a828-f0229f826b7e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:32.261515 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-fe863086-9a05-4f3a-a828-f0229f826b7e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:32.262650 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-fe863086-9a05-4f3a-a828-f0229f826b7e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.083755 May 24 15:39:32.263204 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1050/2123] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:39:32 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:39:32.538570 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-67aa17b4-d411-49d6-a915-d0fdabcaad09 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:32.539173 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-67aa17b4-d411-49d6-a915-d0fdabcaad09 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:32.545471 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-67aa17b4-d411-49d6-a915-d0fdabcaad09 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:32.545909 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-67aa17b4-d411-49d6-a915-d0fdabcaad09 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:32.546653 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-67aa17b4-d411-49d6-a915-d0fdabcaad09 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:32.547078 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-67aa17b4-d411-49d6-a915-d0fdabcaad09 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:32.829729 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-67aa17b4-d411-49d6-a915-d0fdabcaad09 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:32.837566 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-67aa17b4-d411-49d6-a915-d0fdabcaad09 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.302826 May 24 15:39:32.838119 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1074/2124] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:32 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:33.193903 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-bb48196b-bed7-4cdd-9538-0ccbc7ac0b4c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:33.194436 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-bb48196b-bed7-4cdd-9538-0ccbc7ac0b4c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:33.200938 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bb48196b-bed7-4cdd-9538-0ccbc7ac0b4c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:33.201376 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bb48196b-bed7-4cdd-9538-0ccbc7ac0b4c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:33.202117 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bb48196b-bed7-4cdd-9538-0ccbc7ac0b4c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:33.202541 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bb48196b-bed7-4cdd-9538-0ccbc7ac0b4c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:33.258086 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c4d49dfd-c7c3-4e5c-ad44-4238fdbab563 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:33.258803 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-c4d49dfd-c7c3-4e5c-ad44-4238fdbab563 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:33.265299 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c4d49dfd-c7c3-4e5c-ad44-4238fdbab563 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:33.265747 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c4d49dfd-c7c3-4e5c-ad44-4238fdbab563 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:33.266500 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c4d49dfd-c7c3-4e5c-ad44-4238fdbab563 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:33.266931 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c4d49dfd-c7c3-4e5c-ad44-4238fdbab563 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:33.331376 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-bb48196b-bed7-4cdd-9538-0ccbc7ac0b4c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:33.340322 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-bb48196b-bed7-4cdd-9538-0ccbc7ac0b4c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.150255 May 24 15:39:33.341093 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1051/2125] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:33 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:33.345291 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-23d3d8ad-985b-4dd7-ac6d-b01bb2ef2322 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:33.345913 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-23d3d8ad-985b-4dd7-ac6d-b01bb2ef2322 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:33.352714 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-23d3d8ad-985b-4dd7-ac6d-b01bb2ef2322 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:33.353152 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-23d3d8ad-985b-4dd7-ac6d-b01bb2ef2322 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:33.353904 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-23d3d8ad-985b-4dd7-ac6d-b01bb2ef2322 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:33.354330 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-23d3d8ad-985b-4dd7-ac6d-b01bb2ef2322 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:33.395413 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-c4d49dfd-c7c3-4e5c-ad44-4238fdbab563 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:33.403407 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-c4d49dfd-c7c3-4e5c-ad44-4238fdbab563 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.149289 May 24 15:39:33.403966 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1075/2126] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:33 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:39:33.415184 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-23d3d8ad-985b-4dd7-ac6d-b01bb2ef2322 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:33.423695 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-23d3d8ad-985b-4dd7-ac6d-b01bb2ef2322 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:33.425202 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-23d3d8ad-985b-4dd7-ac6d-b01bb2ef2322 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:33.426378 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-23d3d8ad-985b-4dd7-ac6d-b01bb2ef2322 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084582 May 24 15:39:33.426921 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1052/2127] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:39:33 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:39:33.854183 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-22ecfd47-5960-4afc-a955-49d7c4154d03 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:33.854797 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-22ecfd47-5960-4afc-a955-49d7c4154d03 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:33.860757 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-22ecfd47-5960-4afc-a955-49d7c4154d03 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:33.861214 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-22ecfd47-5960-4afc-a955-49d7c4154d03 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:33.861943 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-22ecfd47-5960-4afc-a955-49d7c4154d03 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:33.862373 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-22ecfd47-5960-4afc-a955-49d7c4154d03 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:33.987970 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-22ecfd47-5960-4afc-a955-49d7c4154d03 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:33.996114 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-22ecfd47-5960-4afc-a955-49d7c4154d03 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.145755 May 24 15:39:33.996689 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1076/2128] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:33 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:34.357942 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e96e7ff7-4125-4a95-8c38-4af9678fc46a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:34.358581 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-e96e7ff7-4125-4a95-8c38-4af9678fc46a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:34.365922 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e96e7ff7-4125-4a95-8c38-4af9678fc46a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:34.366367 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e96e7ff7-4125-4a95-8c38-4af9678fc46a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:34.367112 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e96e7ff7-4125-4a95-8c38-4af9678fc46a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:34.367539 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e96e7ff7-4125-4a95-8c38-4af9678fc46a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:34.421015 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-ad60c6a2-2aa4-4030-b428-290f692367bd tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:34.421636 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-ad60c6a2-2aa4-4030-b428-290f692367bd tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:34.428639 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ad60c6a2-2aa4-4030-b428-290f692367bd tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:34.429090 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ad60c6a2-2aa4-4030-b428-290f692367bd tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:34.429857 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ad60c6a2-2aa4-4030-b428-290f692367bd tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:34.430300 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ad60c6a2-2aa4-4030-b428-290f692367bd tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:34.496646 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-e96e7ff7-4125-4a95-8c38-4af9678fc46a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:34.505046 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-e96e7ff7-4125-4a95-8c38-4af9678fc46a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.150926 May 24 15:39:34.505641 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1053/2129] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:34 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:34.510223 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-4f727348-e09d-4abf-95ac-dfa9656b26cf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:34.510836 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-4f727348-e09d-4abf-95ac-dfa9656b26cf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:34.517107 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4f727348-e09d-4abf-95ac-dfa9656b26cf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:34.517558 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4f727348-e09d-4abf-95ac-dfa9656b26cf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:34.518371 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4f727348-e09d-4abf-95ac-dfa9656b26cf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:34.518809 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4f727348-e09d-4abf-95ac-dfa9656b26cf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:34.538579 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:39:34.588154 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-4f727348-e09d-4abf-95ac-dfa9656b26cf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:34.597707 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-4f727348-e09d-4abf-95ac-dfa9656b26cf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:34.599226 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-4f727348-e09d-4abf-95ac-dfa9656b26cf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:34.600422 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-4f727348-e09d-4abf-95ac-dfa9656b26cf tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.093838 May 24 15:39:34.600991 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1054/2130] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:39:34 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:39:34.780501 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ad60c6a2-2aa4-4030-b428-290f692367bd tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:34.788902 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-ad60c6a2-2aa4-4030-b428-290f692367bd tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.371876 May 24 15:39:34.789478 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1077/2131] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:34 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:39:35.014153 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e04c50b6-e794-48bb-be37-302df4d3aa9f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:35.014730 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-e04c50b6-e794-48bb-be37-302df4d3aa9f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:35.021327 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e04c50b6-e794-48bb-be37-302df4d3aa9f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:35.021772 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e04c50b6-e794-48bb-be37-302df4d3aa9f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:35.022528 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e04c50b6-e794-48bb-be37-302df4d3aa9f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:35.022987 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e04c50b6-e794-48bb-be37-302df4d3aa9f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:35.147990 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-e04c50b6-e794-48bb-be37-302df4d3aa9f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:35.155845 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-e04c50b6-e794-48bb-be37-302df4d3aa9f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.145641 May 24 15:39:35.156423 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1055/2132] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:35 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:35.522791 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-48792c16-a84f-4abb-9b52-bf1d8163af97 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:35.523396 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-48792c16-a84f-4abb-9b52-bf1d8163af97 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:35.529924 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-48792c16-a84f-4abb-9b52-bf1d8163af97 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:35.530373 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-48792c16-a84f-4abb-9b52-bf1d8163af97 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:35.531120 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-48792c16-a84f-4abb-9b52-bf1d8163af97 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:35.531548 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-48792c16-a84f-4abb-9b52-bf1d8163af97 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:35.621890 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-9ddd11d7-cba2-455e-af68-e8fca6623564 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:35.622958 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-9ddd11d7-cba2-455e-af68-e8fca6623564 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:35.633052 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9ddd11d7-cba2-455e-af68-e8fca6623564 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:35.633734 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9ddd11d7-cba2-455e-af68-e8fca6623564 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:35.634893 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9ddd11d7-cba2-455e-af68-e8fca6623564 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:35.635557 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9ddd11d7-cba2-455e-af68-e8fca6623564 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:35.656807 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-48792c16-a84f-4abb-9b52-bf1d8163af97 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:35.664695 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-48792c16-a84f-4abb-9b52-bf1d8163af97 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.146361 May 24 15:39:35.665260 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1078/2133] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:35 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:35.706736 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-9ddd11d7-cba2-455e-af68-e8fca6623564 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:35.715049 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-9ddd11d7-cba2-455e-af68-e8fca6623564 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:35.716591 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-9ddd11d7-cba2-455e-af68-e8fca6623564 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:35.717741 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-9ddd11d7-cba2-455e-af68-e8fca6623564 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.102378 May 24 15:39:35.718303 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1056/2134] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:39:35 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:39:35.806093 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-860f1129-4213-4a03-9b5b-2cf5aa2713c8 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:35.806620 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-860f1129-4213-4a03-9b5b-2cf5aa2713c8 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:35.812596 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-860f1129-4213-4a03-9b5b-2cf5aa2713c8 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:35.813041 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-860f1129-4213-4a03-9b5b-2cf5aa2713c8 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:35.813788 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-860f1129-4213-4a03-9b5b-2cf5aa2713c8 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:35.814216 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-860f1129-4213-4a03-9b5b-2cf5aa2713c8 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:35.818646 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:39:35.942170 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-860f1129-4213-4a03-9b5b-2cf5aa2713c8 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:35.950091 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-860f1129-4213-4a03-9b5b-2cf5aa2713c8 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.147849 May 24 15:39:35.950983 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1079/2135] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:35 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:36.173226 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-bc912890-c9af-4b18-87dc-a2fabec81813 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:36.173842 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-bc912890-c9af-4b18-87dc-a2fabec81813 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:36.176459 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_api:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:39:36.182200 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bc912890-c9af-4b18-87dc-a2fabec81813 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:36.182650 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bc912890-c9af-4b18-87dc-a2fabec81813 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:36.183413 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bc912890-c9af-4b18-87dc-a2fabec81813 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:36.183850 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bc912890-c9af-4b18-87dc-a2fabec81813 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:36.313337 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-bc912890-c9af-4b18-87dc-a2fabec81813 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:36.321315 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-bc912890-c9af-4b18-87dc-a2fabec81813 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.151937 May 24 15:39:36.321823 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1057/2136] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:36 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:36.681666 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-86245efe-5a60-413b-86f4-d5b65e314f4f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:36.682198 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-86245efe-5a60-413b-86f4-d5b65e314f4f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:36.688731 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-86245efe-5a60-413b-86f4-d5b65e314f4f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:36.689183 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-86245efe-5a60-413b-86f4-d5b65e314f4f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:36.689943 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-86245efe-5a60-413b-86f4-d5b65e314f4f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:36.690378 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-86245efe-5a60-413b-86f4-d5b65e314f4f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:36.735152 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-92828e0f-c5bd-4a93-aef9-e0e4b471471f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:36.735825 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-92828e0f-c5bd-4a93-aef9-e0e4b471471f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:36.742692 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-92828e0f-c5bd-4a93-aef9-e0e4b471471f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:36.743139 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-92828e0f-c5bd-4a93-aef9-e0e4b471471f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:36.743905 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-92828e0f-c5bd-4a93-aef9-e0e4b471471f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:36.744368 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-92828e0f-c5bd-4a93-aef9-e0e4b471471f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:36.805131 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-92828e0f-c5bd-4a93-aef9-e0e4b471471f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:36.813559 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-92828e0f-c5bd-4a93-aef9-e0e4b471471f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:36.815140 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-92828e0f-c5bd-4a93-aef9-e0e4b471471f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:36.816745 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-92828e0f-c5bd-4a93-aef9-e0e4b471471f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.085439 May 24 15:39:36.817307 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1058/2137] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:39:36 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:39:36.818583 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-86245efe-5a60-413b-86f4-d5b65e314f4f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:36.826624 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-86245efe-5a60-413b-86f4-d5b65e314f4f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.148880 May 24 15:39:36.827170 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1080/2138] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:36 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:36.967049 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-3fd2f82c-f80a-4e9e-a91a-4be5e17b0109 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:36.967666 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-3fd2f82c-f80a-4e9e-a91a-4be5e17b0109 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:36.973735 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3fd2f82c-f80a-4e9e-a91a-4be5e17b0109 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:36.974186 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3fd2f82c-f80a-4e9e-a91a-4be5e17b0109 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:36.974943 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3fd2f82c-f80a-4e9e-a91a-4be5e17b0109 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:36.975378 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3fd2f82c-f80a-4e9e-a91a-4be5e17b0109 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:37.102064 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-3fd2f82c-f80a-4e9e-a91a-4be5e17b0109 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:37.110133 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-3fd2f82c-f80a-4e9e-a91a-4be5e17b0109 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.147083 May 24 15:39:37.110692 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1059/2139] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:36 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:37.337645 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-f5436c7c-a1c6-449d-80c4-511762490da1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:37.338328 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-f5436c7c-a1c6-449d-80c4-511762490da1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:37.344275 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f5436c7c-a1c6-449d-80c4-511762490da1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:37.344759 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f5436c7c-a1c6-449d-80c4-511762490da1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:37.345512 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f5436c7c-a1c6-449d-80c4-511762490da1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:37.345943 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f5436c7c-a1c6-449d-80c4-511762490da1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:37.474023 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-f5436c7c-a1c6-449d-80c4-511762490da1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:37.481919 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-f5436c7c-a1c6-449d-80c4-511762490da1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.148084 May 24 15:39:37.482477 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1081/2140] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:37 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:37.835033 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-582164d9-67aa-4c23-9444-2f3dbad5db4f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:37.835656 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-582164d9-67aa-4c23-9444-2f3dbad5db4f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:37.842259 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-582164d9-67aa-4c23-9444-2f3dbad5db4f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:37.842692 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-582164d9-67aa-4c23-9444-2f3dbad5db4f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:37.843442 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-582164d9-67aa-4c23-9444-2f3dbad5db4f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:37.843866 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-582164d9-67aa-4c23-9444-2f3dbad5db4f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:37.843985 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-dbaf0176-ad2d-4ec3-8031-c2ce9a86b3f6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:37.844531 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-dbaf0176-ad2d-4ec3-8031-c2ce9a86b3f6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:37.851605 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dbaf0176-ad2d-4ec3-8031-c2ce9a86b3f6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:37.852050 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dbaf0176-ad2d-4ec3-8031-c2ce9a86b3f6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:37.852846 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dbaf0176-ad2d-4ec3-8031-c2ce9a86b3f6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:37.853279 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dbaf0176-ad2d-4ec3-8031-c2ce9a86b3f6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:37.911259 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-582164d9-67aa-4c23-9444-2f3dbad5db4f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:37.920646 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-582164d9-67aa-4c23-9444-2f3dbad5db4f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:37.923497 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-582164d9-67aa-4c23-9444-2f3dbad5db4f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:37.924898 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-582164d9-67aa-4c23-9444-2f3dbad5db4f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.094251 May 24 15:39:37.925710 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1060/2141] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:39:37 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:39:37.983702 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-dbaf0176-ad2d-4ec3-8031-c2ce9a86b3f6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:37.992915 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-dbaf0176-ad2d-4ec3-8031-c2ce9a86b3f6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.152752 May 24 15:39:37.993872 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1082/2142] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:37 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:39:38.126982 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a49b2da7-e21e-47c3-83a7-0ea932a19de3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:38.127507 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a49b2da7-e21e-47c3-83a7-0ea932a19de3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:38.133588 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a49b2da7-e21e-47c3-83a7-0ea932a19de3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:38.134031 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a49b2da7-e21e-47c3-83a7-0ea932a19de3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:38.134778 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a49b2da7-e21e-47c3-83a7-0ea932a19de3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:38.135210 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a49b2da7-e21e-47c3-83a7-0ea932a19de3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:38.259318 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-a49b2da7-e21e-47c3-83a7-0ea932a19de3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:38.267104 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a49b2da7-e21e-47c3-83a7-0ea932a19de3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.144078 May 24 15:39:38.267663 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1061/2143] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:38 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:38.499657 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e4cfef0f-ff43-485d-96ee-a48df205b5c5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:38.500260 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e4cfef0f-ff43-485d-96ee-a48df205b5c5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:38.506726 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e4cfef0f-ff43-485d-96ee-a48df205b5c5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:38.507177 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e4cfef0f-ff43-485d-96ee-a48df205b5c5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:38.507930 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e4cfef0f-ff43-485d-96ee-a48df205b5c5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:38.508390 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e4cfef0f-ff43-485d-96ee-a48df205b5c5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:38.631414 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e4cfef0f-ff43-485d-96ee-a48df205b5c5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:38.639385 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e4cfef0f-ff43-485d-96ee-a48df205b5c5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.143553 May 24 15:39:38.639948 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1083/2144] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:38 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:38.943550 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-7969357a-b396-4cea-a573-336eb569cd05 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:38.944083 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-7969357a-b396-4cea-a573-336eb569cd05 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:38.950588 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7969357a-b396-4cea-a573-336eb569cd05 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:38.951034 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7969357a-b396-4cea-a573-336eb569cd05 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:38.951788 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7969357a-b396-4cea-a573-336eb569cd05 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:38.952220 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7969357a-b396-4cea-a573-336eb569cd05 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:39.009522 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e6345959-962c-49b5-b043-0c1dcb4d24d1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:39.010121 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e6345959-962c-49b5-b043-0c1dcb4d24d1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:39.013358 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-7969357a-b396-4cea-a573-336eb569cd05 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:39.016624 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e6345959-962c-49b5-b043-0c1dcb4d24d1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:39.017140 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e6345959-962c-49b5-b043-0c1dcb4d24d1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:39.017899 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e6345959-962c-49b5-b043-0c1dcb4d24d1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:39.018330 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e6345959-962c-49b5-b043-0c1dcb4d24d1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:39.022618 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-7969357a-b396-4cea-a573-336eb569cd05 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:39.024146 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-7969357a-b396-4cea-a573-336eb569cd05 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:39.025316 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-7969357a-b396-4cea-a573-336eb569cd05 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.086357 May 24 15:39:39.025884 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1062/2145] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:39:38 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:39:39.145944 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e6345959-962c-49b5-b043-0c1dcb4d24d1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:39.153796 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e6345959-962c-49b5-b043-0c1dcb4d24d1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.148087 May 24 15:39:39.154353 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1084/2146] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:39 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:39:39.284064 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-4729903a-ea9b-4b3a-9581-d4018e73e530 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:39.285193 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-4729903a-ea9b-4b3a-9581-d4018e73e530 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:39.291185 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4729903a-ea9b-4b3a-9581-d4018e73e530 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:39.291624 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4729903a-ea9b-4b3a-9581-d4018e73e530 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:39.292397 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4729903a-ea9b-4b3a-9581-d4018e73e530 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:39.292826 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4729903a-ea9b-4b3a-9581-d4018e73e530 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:39.421395 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-4729903a-ea9b-4b3a-9581-d4018e73e530 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:39.429379 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-4729903a-ea9b-4b3a-9581-d4018e73e530 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.149106 May 24 15:39:39.429952 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1063/2147] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:39 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:39.656124 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-44716701-5508-4fec-a075-6ace5d2369b4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:39.656689 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-44716701-5508-4fec-a075-6ace5d2369b4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:39.663271 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-44716701-5508-4fec-a075-6ace5d2369b4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:39.663722 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-44716701-5508-4fec-a075-6ace5d2369b4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:39.664524 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-44716701-5508-4fec-a075-6ace5d2369b4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:39.664969 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-44716701-5508-4fec-a075-6ace5d2369b4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:39.789656 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-44716701-5508-4fec-a075-6ace5d2369b4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:39.802364 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-44716701-5508-4fec-a075-6ace5d2369b4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.150130 May 24 15:39:39.802938 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1085/2148] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:39 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:40.043043 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-fae0bfe9-66de-4e43-af1c-b4a1df6c5459 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:40.043666 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-fae0bfe9-66de-4e43-af1c-b4a1df6c5459 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:40.049755 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fae0bfe9-66de-4e43-af1c-b4a1df6c5459 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:40.050223 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fae0bfe9-66de-4e43-af1c-b4a1df6c5459 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:40.050977 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fae0bfe9-66de-4e43-af1c-b4a1df6c5459 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:40.051439 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fae0bfe9-66de-4e43-af1c-b4a1df6c5459 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:40.114422 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-fae0bfe9-66de-4e43-af1c-b4a1df6c5459 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:40.123193 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-fae0bfe9-66de-4e43-af1c-b4a1df6c5459 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:40.125446 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-fae0bfe9-66de-4e43-af1c-b4a1df6c5459 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:40.126623 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-fae0bfe9-66de-4e43-af1c-b4a1df6c5459 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.087653 May 24 15:39:40.127178 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1064/2149] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:39:40 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:39:40.170837 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-beaa23cf-768b-4394-be4b-853bfb473864 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:40.171532 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-beaa23cf-768b-4394-be4b-853bfb473864 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:40.178260 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-beaa23cf-768b-4394-be4b-853bfb473864 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:40.178707 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-beaa23cf-768b-4394-be4b-853bfb473864 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:40.179456 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-beaa23cf-768b-4394-be4b-853bfb473864 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:40.179889 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-beaa23cf-768b-4394-be4b-853bfb473864 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:40.306618 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-beaa23cf-768b-4394-be4b-853bfb473864 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:40.314484 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-beaa23cf-768b-4394-be4b-853bfb473864 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.147462 May 24 15:39:40.315048 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1086/2150] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:40 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:40.446751 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-09efb4be-1dbc-42a0-98f7-b93be479e4dc tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:40.447358 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-09efb4be-1dbc-42a0-98f7-b93be479e4dc tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:40.453393 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-09efb4be-1dbc-42a0-98f7-b93be479e4dc tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:40.453838 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-09efb4be-1dbc-42a0-98f7-b93be479e4dc tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:40.454589 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-09efb4be-1dbc-42a0-98f7-b93be479e4dc tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:40.455018 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-09efb4be-1dbc-42a0-98f7-b93be479e4dc tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:40.580932 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-09efb4be-1dbc-42a0-98f7-b93be479e4dc tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:40.588821 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-09efb4be-1dbc-42a0-98f7-b93be479e4dc tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.145875 May 24 15:39:40.589383 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1065/2151] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:40 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:40.818551 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-7c809d83-e793-449b-b25d-b4243d1e54db tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:40.819157 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-7c809d83-e793-449b-b25d-b4243d1e54db tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:40.825231 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7c809d83-e793-449b-b25d-b4243d1e54db tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:40.825682 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7c809d83-e793-449b-b25d-b4243d1e54db tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:40.826423 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7c809d83-e793-449b-b25d-b4243d1e54db tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:40.826862 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7c809d83-e793-449b-b25d-b4243d1e54db tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:40.954337 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-7c809d83-e793-449b-b25d-b4243d1e54db tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:40.962689 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-7c809d83-e793-449b-b25d-b4243d1e54db tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.147992 May 24 15:39:40.963435 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1087/2152] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:40 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:39:41.145481 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-01b32303-16a7-4228-9b1d-211567af2cc5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:41.146084 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-01b32303-16a7-4228-9b1d-211567af2cc5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:41.152629 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-01b32303-16a7-4228-9b1d-211567af2cc5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:41.153076 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-01b32303-16a7-4228-9b1d-211567af2cc5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:41.153901 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-01b32303-16a7-4228-9b1d-211567af2cc5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:41.154283 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-01b32303-16a7-4228-9b1d-211567af2cc5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:41.217355 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-01b32303-16a7-4228-9b1d-211567af2cc5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:41.226325 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-01b32303-16a7-4228-9b1d-211567af2cc5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:41.227808 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-01b32303-16a7-4228-9b1d-211567af2cc5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:41.229023 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-01b32303-16a7-4228-9b1d-211567af2cc5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.088020 May 24 15:39:41.229564 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1066/2153] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:39:41 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:39:41.332335 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-13d0e2ad-709d-4fc8-846e-e2d3119d48fe tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:41.332955 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-13d0e2ad-709d-4fc8-846e-e2d3119d48fe tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:41.339786 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-13d0e2ad-709d-4fc8-846e-e2d3119d48fe tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:41.340259 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-13d0e2ad-709d-4fc8-846e-e2d3119d48fe tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:41.341044 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-13d0e2ad-709d-4fc8-846e-e2d3119d48fe tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:41.341474 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-13d0e2ad-709d-4fc8-846e-e2d3119d48fe tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:41.469264 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-13d0e2ad-709d-4fc8-846e-e2d3119d48fe tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:41.477156 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-13d0e2ad-709d-4fc8-846e-e2d3119d48fe tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.149317 May 24 15:39:41.477716 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1088/2154] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:41 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:41.608047 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-3c702414-d859-4453-a456-6f3ec08b890d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:41.608673 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-3c702414-d859-4453-a456-6f3ec08b890d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:41.615062 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3c702414-d859-4453-a456-6f3ec08b890d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:41.615503 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3c702414-d859-4453-a456-6f3ec08b890d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:41.616531 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3c702414-d859-4453-a456-6f3ec08b890d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:41.616961 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3c702414-d859-4453-a456-6f3ec08b890d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:41.741354 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-3c702414-d859-4453-a456-6f3ec08b890d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:41.749135 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-3c702414-d859-4453-a456-6f3ec08b890d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.144907 May 24 15:39:41.749701 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1067/2155] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:41 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:41.979290 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-0c0ab6fa-bf13-46eb-96f7-6f75be36b173 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:41.979898 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-0c0ab6fa-bf13-46eb-96f7-6f75be36b173 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:41.986052 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0c0ab6fa-bf13-46eb-96f7-6f75be36b173 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:41.986499 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0c0ab6fa-bf13-46eb-96f7-6f75be36b173 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:41.987251 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0c0ab6fa-bf13-46eb-96f7-6f75be36b173 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:41.988338 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0c0ab6fa-bf13-46eb-96f7-6f75be36b173 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:42.115154 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-0c0ab6fa-bf13-46eb-96f7-6f75be36b173 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:42.123340 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-0c0ab6fa-bf13-46eb-96f7-6f75be36b173 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.147895 May 24 15:39:42.123898 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1089/2156] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:41 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:42.247355 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-c744d054-a744-4c18-aed5-80de8232a592 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:42.247910 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-c744d054-a744-4c18-aed5-80de8232a592 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:42.254890 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c744d054-a744-4c18-aed5-80de8232a592 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:42.255339 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c744d054-a744-4c18-aed5-80de8232a592 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:42.256095 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c744d054-a744-4c18-aed5-80de8232a592 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:42.256557 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c744d054-a744-4c18-aed5-80de8232a592 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:42.316427 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-c744d054-a744-4c18-aed5-80de8232a592 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:42.324619 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-c744d054-a744-4c18-aed5-80de8232a592 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:42.326100 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-c744d054-a744-4c18-aed5-80de8232a592 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:42.327222 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-c744d054-a744-4c18-aed5-80de8232a592 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.083857 May 24 15:39:42.327777 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1068/2157] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:39:42 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:39:42.494594 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-78e99463-2411-40db-9827-14f7556e77e7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:42.495201 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-78e99463-2411-40db-9827-14f7556e77e7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:42.501662 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-78e99463-2411-40db-9827-14f7556e77e7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:42.502049 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-78e99463-2411-40db-9827-14f7556e77e7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:42.502792 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-78e99463-2411-40db-9827-14f7556e77e7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:42.503219 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-78e99463-2411-40db-9827-14f7556e77e7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:42.628672 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-78e99463-2411-40db-9827-14f7556e77e7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:42.636626 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-78e99463-2411-40db-9827-14f7556e77e7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.146048 May 24 15:39:42.637205 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1090/2158] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:42 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:42.766482 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-9caf67e2-acc9-4970-b92d-4d75e618c06d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:42.767023 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-9caf67e2-acc9-4970-b92d-4d75e618c06d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:42.773648 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9caf67e2-acc9-4970-b92d-4d75e618c06d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:42.774092 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9caf67e2-acc9-4970-b92d-4d75e618c06d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:42.774850 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9caf67e2-acc9-4970-b92d-4d75e618c06d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:42.775283 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9caf67e2-acc9-4970-b92d-4d75e618c06d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:42.902041 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-9caf67e2-acc9-4970-b92d-4d75e618c06d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:42.909978 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-9caf67e2-acc9-4970-b92d-4d75e618c06d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.147382 May 24 15:39:42.910536 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1069/2159] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:42 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:43.139864 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-6838a015-4b11-4c07-8402-6638b3f2b05b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:43.140509 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-6838a015-4b11-4c07-8402-6638b3f2b05b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:43.146491 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6838a015-4b11-4c07-8402-6638b3f2b05b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:43.146929 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6838a015-4b11-4c07-8402-6638b3f2b05b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:43.147673 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6838a015-4b11-4c07-8402-6638b3f2b05b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:43.148103 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6838a015-4b11-4c07-8402-6638b3f2b05b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:43.276426 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-6838a015-4b11-4c07-8402-6638b3f2b05b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:43.285146 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-6838a015-4b11-4c07-8402-6638b3f2b05b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.148462 May 24 15:39:43.285709 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1091/2160] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:43 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:43.344712 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-8234e27f-4ba9-4e24-83dd-cf229287bc96 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:43.345257 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-8234e27f-4ba9-4e24-83dd-cf229287bc96 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:43.352370 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8234e27f-4ba9-4e24-83dd-cf229287bc96 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:43.352817 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8234e27f-4ba9-4e24-83dd-cf229287bc96 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:43.353568 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8234e27f-4ba9-4e24-83dd-cf229287bc96 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:43.353998 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8234e27f-4ba9-4e24-83dd-cf229287bc96 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:43.414373 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-8234e27f-4ba9-4e24-83dd-cf229287bc96 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:43.422898 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-8234e27f-4ba9-4e24-83dd-cf229287bc96 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:43.424431 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-8234e27f-4ba9-4e24-83dd-cf229287bc96 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:43.425582 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-8234e27f-4ba9-4e24-83dd-cf229287bc96 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084743 May 24 15:39:43.426148 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1070/2161] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:39:43 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:39:43.653662 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-382ba32b-db33-4b9d-8696-573be6aca082 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:43.654569 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-382ba32b-db33-4b9d-8696-573be6aca082 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:43.661360 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-382ba32b-db33-4b9d-8696-573be6aca082 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:43.662693 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-382ba32b-db33-4b9d-8696-573be6aca082 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:43.663554 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-382ba32b-db33-4b9d-8696-573be6aca082 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:43.663915 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-382ba32b-db33-4b9d-8696-573be6aca082 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:43.789492 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-382ba32b-db33-4b9d-8696-573be6aca082 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:43.797682 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-382ba32b-db33-4b9d-8696-573be6aca082 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.147815 May 24 15:39:43.798267 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1092/2162] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:43 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:43.927119 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-c60d4fa3-f087-44ed-b27b-a633043adbc1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:43.927655 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-c60d4fa3-f087-44ed-b27b-a633043adbc1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:43.933739 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c60d4fa3-f087-44ed-b27b-a633043adbc1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:43.934190 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c60d4fa3-f087-44ed-b27b-a633043adbc1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:43.934949 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c60d4fa3-f087-44ed-b27b-a633043adbc1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:43.935384 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c60d4fa3-f087-44ed-b27b-a633043adbc1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:43.939272 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:39:44.061224 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-c60d4fa3-f087-44ed-b27b-a633043adbc1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:44.069886 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-c60d4fa3-f087-44ed-b27b-a633043adbc1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.147188 May 24 15:39:44.070468 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1071/2163] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:43 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:44.302411 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-8621a333-8734-4f48-a545-96a00bedd8ca tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:44.303023 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-8621a333-8734-4f48-a545-96a00bedd8ca tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:44.309088 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8621a333-8734-4f48-a545-96a00bedd8ca tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:44.309537 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8621a333-8734-4f48-a545-96a00bedd8ca tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:44.310294 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8621a333-8734-4f48-a545-96a00bedd8ca tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:44.310729 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8621a333-8734-4f48-a545-96a00bedd8ca tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:44.440726 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-8621a333-8734-4f48-a545-96a00bedd8ca tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:44.443356 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-fa67f9f4-a2d1-4578-a83e-0a239b34324b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:44.444042 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-fa67f9f4-a2d1-4578-a83e-0a239b34324b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:44.448966 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-8621a333-8734-4f48-a545-96a00bedd8ca tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.150979 May 24 15:39:44.458207 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1093/2164] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:44 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:44.458385 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fa67f9f4-a2d1-4578-a83e-0a239b34324b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:44.458385 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fa67f9f4-a2d1-4578-a83e-0a239b34324b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:44.458385 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fa67f9f4-a2d1-4578-a83e-0a239b34324b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:44.458385 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fa67f9f4-a2d1-4578-a83e-0a239b34324b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:44.516812 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-fa67f9f4-a2d1-4578-a83e-0a239b34324b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:44.525358 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-fa67f9f4-a2d1-4578-a83e-0a239b34324b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:44.526872 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-fa67f9f4-a2d1-4578-a83e-0a239b34324b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:44.528013 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-fa67f9f4-a2d1-4578-a83e-0a239b34324b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.088621 May 24 15:39:44.528621 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1072/2165] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:39:44 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:39:44.814188 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-fae0237e-6ca0-4b16-8c44-a9c55fd9aa50 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:44.814790 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-fae0237e-6ca0-4b16-8c44-a9c55fd9aa50 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:44.821230 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fae0237e-6ca0-4b16-8c44-a9c55fd9aa50 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:44.821672 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fae0237e-6ca0-4b16-8c44-a9c55fd9aa50 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:44.822417 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fae0237e-6ca0-4b16-8c44-a9c55fd9aa50 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:44.822845 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fae0237e-6ca0-4b16-8c44-a9c55fd9aa50 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:44.946515 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-fae0237e-6ca0-4b16-8c44-a9c55fd9aa50 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:44.954388 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-fae0237e-6ca0-4b16-8c44-a9c55fd9aa50 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.144018 May 24 15:39:44.954950 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1094/2166] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:44 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:45.087150 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a1733b8b-93f7-4b71-b9fb-cf22e2306356 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:45.087763 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a1733b8b-93f7-4b71-b9fb-cf22e2306356 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:45.093938 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a1733b8b-93f7-4b71-b9fb-cf22e2306356 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:45.094387 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a1733b8b-93f7-4b71-b9fb-cf22e2306356 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:45.095142 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a1733b8b-93f7-4b71-b9fb-cf22e2306356 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:45.095579 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a1733b8b-93f7-4b71-b9fb-cf22e2306356 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:45.220850 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-a1733b8b-93f7-4b71-b9fb-cf22e2306356 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:45.228767 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a1733b8b-93f7-4b71-b9fb-cf22e2306356 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.145501 May 24 15:39:45.229339 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1073/2167] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:45 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:45.464897 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-47e26bc5-b9a1-4fe8-9071-5f4a4a02d526 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:45.465423 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-47e26bc5-b9a1-4fe8-9071-5f4a4a02d526 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:45.471365 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-47e26bc5-b9a1-4fe8-9071-5f4a4a02d526 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:45.471810 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-47e26bc5-b9a1-4fe8-9071-5f4a4a02d526 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:45.472580 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-47e26bc5-b9a1-4fe8-9071-5f4a4a02d526 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:45.473039 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-47e26bc5-b9a1-4fe8-9071-5f4a4a02d526 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:45.546641 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-1c212f07-8c09-4b9d-be3e-a511d556f0b8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:45.547632 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-1c212f07-8c09-4b9d-be3e-a511d556f0b8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:45.554039 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1c212f07-8c09-4b9d-be3e-a511d556f0b8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:45.554492 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1c212f07-8c09-4b9d-be3e-a511d556f0b8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:45.555257 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1c212f07-8c09-4b9d-be3e-a511d556f0b8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:45.555696 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1c212f07-8c09-4b9d-be3e-a511d556f0b8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:45.603955 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-47e26bc5-b9a1-4fe8-9071-5f4a4a02d526 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:45.607368 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:39:45.613389 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-47e26bc5-b9a1-4fe8-9071-5f4a4a02d526 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.151924 May 24 15:39:45.613956 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1095/2168] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:45 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:45.619430 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-1c212f07-8c09-4b9d-be3e-a511d556f0b8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:45.628019 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-1c212f07-8c09-4b9d-be3e-a511d556f0b8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:45.630203 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-1c212f07-8c09-4b9d-be3e-a511d556f0b8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:45.631351 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-1c212f07-8c09-4b9d-be3e-a511d556f0b8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.088785 May 24 15:39:45.631912 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1074/2169] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:39:45 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:39:45.972372 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-1ce64d3b-c202-467c-8d80-af5394857e7c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:45.972991 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-1ce64d3b-c202-467c-8d80-af5394857e7c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:45.979522 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1ce64d3b-c202-467c-8d80-af5394857e7c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:45.979962 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1ce64d3b-c202-467c-8d80-af5394857e7c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:45.980733 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1ce64d3b-c202-467c-8d80-af5394857e7c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:45.981163 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1ce64d3b-c202-467c-8d80-af5394857e7c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:46.110518 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-1ce64d3b-c202-467c-8d80-af5394857e7c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:46.118693 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-1ce64d3b-c202-467c-8d80-af5394857e7c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.150659 May 24 15:39:46.119256 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1096/2170] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:45 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:46.245774 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-ecb90518-d5a5-4e5a-a6eb-6c57c0c76517 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:46.246311 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-ecb90518-d5a5-4e5a-a6eb-6c57c0c76517 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:46.252255 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ecb90518-d5a5-4e5a-a6eb-6c57c0c76517 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:46.252727 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ecb90518-d5a5-4e5a-a6eb-6c57c0c76517 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:46.253474 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ecb90518-d5a5-4e5a-a6eb-6c57c0c76517 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:46.253903 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ecb90518-d5a5-4e5a-a6eb-6c57c0c76517 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:46.381044 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-ecb90518-d5a5-4e5a-a6eb-6c57c0c76517 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:46.388966 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-ecb90518-d5a5-4e5a-a6eb-6c57c0c76517 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.147077 May 24 15:39:46.389525 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1075/2171] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:46 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:46.631034 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-db7e8d44-c07c-4d96-b73b-8e8fd2b7e31b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:46.631561 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-db7e8d44-c07c-4d96-b73b-8e8fd2b7e31b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:46.637519 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-db7e8d44-c07c-4d96-b73b-8e8fd2b7e31b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:46.637961 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-db7e8d44-c07c-4d96-b73b-8e8fd2b7e31b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:46.638705 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-db7e8d44-c07c-4d96-b73b-8e8fd2b7e31b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:46.639131 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-db7e8d44-c07c-4d96-b73b-8e8fd2b7e31b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:46.649444 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a049c7e7-a9e7-4dba-9e3b-3e2be84d535d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:46.650087 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a049c7e7-a9e7-4dba-9e3b-3e2be84d535d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:46.656521 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a049c7e7-a9e7-4dba-9e3b-3e2be84d535d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:46.656970 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a049c7e7-a9e7-4dba-9e3b-3e2be84d535d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:46.657737 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a049c7e7-a9e7-4dba-9e3b-3e2be84d535d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:46.658164 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a049c7e7-a9e7-4dba-9e3b-3e2be84d535d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:46.720287 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-a049c7e7-a9e7-4dba-9e3b-3e2be84d535d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:46.728831 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-a049c7e7-a9e7-4dba-9e3b-3e2be84d535d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:46.730340 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-a049c7e7-a9e7-4dba-9e3b-3e2be84d535d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:46.731486 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a049c7e7-a9e7-4dba-9e3b-3e2be84d535d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.085885 May 24 15:39:46.732055 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1076/2172] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:39:46 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:39:46.768002 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-db7e8d44-c07c-4d96-b73b-8e8fd2b7e31b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:46.776592 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-db7e8d44-c07c-4d96-b73b-8e8fd2b7e31b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.150015 May 24 15:39:46.777161 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1097/2173] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:46 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:47.135507 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-c1d11888-84fc-4feb-9485-ad9743b1066c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:47.136117 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-c1d11888-84fc-4feb-9485-ad9743b1066c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:47.142136 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c1d11888-84fc-4feb-9485-ad9743b1066c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:47.142580 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c1d11888-84fc-4feb-9485-ad9743b1066c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:47.143333 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c1d11888-84fc-4feb-9485-ad9743b1066c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:47.143789 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c1d11888-84fc-4feb-9485-ad9743b1066c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:47.268463 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-c1d11888-84fc-4feb-9485-ad9743b1066c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:47.276398 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-c1d11888-84fc-4feb-9485-ad9743b1066c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.144713 May 24 15:39:47.276963 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1077/2174] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:47 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:47.406225 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-7ab93f06-7bcf-49ab-8d67-7df5bbc990ac tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:47.406816 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-7ab93f06-7bcf-49ab-8d67-7df5bbc990ac tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:47.413790 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7ab93f06-7bcf-49ab-8d67-7df5bbc990ac tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:47.414233 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7ab93f06-7bcf-49ab-8d67-7df5bbc990ac tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:47.414979 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7ab93f06-7bcf-49ab-8d67-7df5bbc990ac tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:47.415423 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7ab93f06-7bcf-49ab-8d67-7df5bbc990ac tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:47.545217 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-7ab93f06-7bcf-49ab-8d67-7df5bbc990ac tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:47.553657 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-7ab93f06-7bcf-49ab-8d67-7df5bbc990ac tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.151322 May 24 15:39:47.554215 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1098/2175] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:47 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:47.750109 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d21bfcb3-3fbe-4b93-a1d0-b1be2c6dea43 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:47.750649 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d21bfcb3-3fbe-4b93-a1d0-b1be2c6dea43 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:47.757133 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d21bfcb3-3fbe-4b93-a1d0-b1be2c6dea43 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:47.757580 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d21bfcb3-3fbe-4b93-a1d0-b1be2c6dea43 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:47.758336 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d21bfcb3-3fbe-4b93-a1d0-b1be2c6dea43 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:47.758772 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d21bfcb3-3fbe-4b93-a1d0-b1be2c6dea43 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:47.793553 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-4439976b-a8e0-4fb0-8517-4de2b43b4a47 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:47.794165 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-4439976b-a8e0-4fb0-8517-4de2b43b4a47 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:47.800252 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4439976b-a8e0-4fb0-8517-4de2b43b4a47 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:47.800737 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4439976b-a8e0-4fb0-8517-4de2b43b4a47 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:47.801505 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4439976b-a8e0-4fb0-8517-4de2b43b4a47 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:47.801944 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4439976b-a8e0-4fb0-8517-4de2b43b4a47 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:47.829294 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-d21bfcb3-3fbe-4b93-a1d0-b1be2c6dea43 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:47.839452 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-d21bfcb3-3fbe-4b93-a1d0-b1be2c6dea43 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:47.840984 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-d21bfcb3-3fbe-4b93-a1d0-b1be2c6dea43 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:47.842202 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d21bfcb3-3fbe-4b93-a1d0-b1be2c6dea43 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.096082 May 24 15:39:47.842774 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1078/2176] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:39:47 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:39:47.929366 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-4439976b-a8e0-4fb0-8517-4de2b43b4a47 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:47.937323 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-4439976b-a8e0-4fb0-8517-4de2b43b4a47 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.147706 May 24 15:39:47.937887 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1099/2177] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:47 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:39:48.293758 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-1ca0dd9e-41aa-4472-9a9e-c271ba8c53b4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:48.294361 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-1ca0dd9e-41aa-4472-9a9e-c271ba8c53b4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:48.300471 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1ca0dd9e-41aa-4472-9a9e-c271ba8c53b4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:48.300916 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1ca0dd9e-41aa-4472-9a9e-c271ba8c53b4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:48.301663 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1ca0dd9e-41aa-4472-9a9e-c271ba8c53b4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:48.302093 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1ca0dd9e-41aa-4472-9a9e-c271ba8c53b4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:48.427884 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-1ca0dd9e-41aa-4472-9a9e-c271ba8c53b4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:48.435854 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-1ca0dd9e-41aa-4472-9a9e-c271ba8c53b4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.145936 May 24 15:39:48.436427 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1079/2178] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:48 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:48.570845 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-09fceb2e-c9ed-4b04-bd63-719e7e6f1f19 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:48.571458 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-09fceb2e-c9ed-4b04-bd63-719e7e6f1f19 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:48.577930 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-09fceb2e-c9ed-4b04-bd63-719e7e6f1f19 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:48.578378 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-09fceb2e-c9ed-4b04-bd63-719e7e6f1f19 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:48.579138 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-09fceb2e-c9ed-4b04-bd63-719e7e6f1f19 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:48.579570 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-09fceb2e-c9ed-4b04-bd63-719e7e6f1f19 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:48.708720 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-09fceb2e-c9ed-4b04-bd63-719e7e6f1f19 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:48.716636 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-09fceb2e-c9ed-4b04-bd63-719e7e6f1f19 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.149700 May 24 15:39:48.717200 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1100/2179] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:48 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:48.860478 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-94705dd7-fec2-4d2f-bb2b-8a057dc20ef1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:48.861090 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-94705dd7-fec2-4d2f-bb2b-8a057dc20ef1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:48.868433 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-94705dd7-fec2-4d2f-bb2b-8a057dc20ef1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:48.868879 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-94705dd7-fec2-4d2f-bb2b-8a057dc20ef1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:48.869632 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-94705dd7-fec2-4d2f-bb2b-8a057dc20ef1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:48.870062 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-94705dd7-fec2-4d2f-bb2b-8a057dc20ef1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:48.930230 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-94705dd7-fec2-4d2f-bb2b-8a057dc20ef1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:48.938566 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-94705dd7-fec2-4d2f-bb2b-8a057dc20ef1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:48.940056 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-94705dd7-fec2-4d2f-bb2b-8a057dc20ef1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:48.941245 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-94705dd7-fec2-4d2f-bb2b-8a057dc20ef1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084773 May 24 15:39:48.941808 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1080/2180] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:39:48 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:39:48.953823 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-df4364b1-c213-4789-9a90-5180a121dd34 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:48.954433 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-df4364b1-c213-4789-9a90-5180a121dd34 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:48.960437 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-df4364b1-c213-4789-9a90-5180a121dd34 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:48.960887 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-df4364b1-c213-4789-9a90-5180a121dd34 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:48.961643 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-df4364b1-c213-4789-9a90-5180a121dd34 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:48.962078 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-df4364b1-c213-4789-9a90-5180a121dd34 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:49.089797 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-df4364b1-c213-4789-9a90-5180a121dd34 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:49.098375 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-df4364b1-c213-4789-9a90-5180a121dd34 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.148369 May 24 15:39:49.098933 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1101/2181] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:48 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:49.453476 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-9e2d43c7-b68e-4e1e-9980-cefedd48f808 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:49.454089 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-9e2d43c7-b68e-4e1e-9980-cefedd48f808 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:49.460667 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9e2d43c7-b68e-4e1e-9980-cefedd48f808 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:49.461105 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9e2d43c7-b68e-4e1e-9980-cefedd48f808 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:49.461856 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9e2d43c7-b68e-4e1e-9980-cefedd48f808 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:49.462283 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9e2d43c7-b68e-4e1e-9980-cefedd48f808 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:49.596940 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-9e2d43c7-b68e-4e1e-9980-cefedd48f808 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:49.605159 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-9e2d43c7-b68e-4e1e-9980-cefedd48f808 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.155541 May 24 15:39:49.605727 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1081/2182] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:49 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:49.733880 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e8d40548-04c3-4929-9b1b-9db4ffc23c3a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:49.734488 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e8d40548-04c3-4929-9b1b-9db4ffc23c3a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:49.741224 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e8d40548-04c3-4929-9b1b-9db4ffc23c3a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:49.741669 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e8d40548-04c3-4929-9b1b-9db4ffc23c3a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:49.742427 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e8d40548-04c3-4929-9b1b-9db4ffc23c3a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:49.742863 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e8d40548-04c3-4929-9b1b-9db4ffc23c3a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:49.867640 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e8d40548-04c3-4929-9b1b-9db4ffc23c3a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:49.875488 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e8d40548-04c3-4929-9b1b-9db4ffc23c3a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.145485 May 24 15:39:49.876047 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1102/2183] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:49 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:49.958752 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-dd5ad635-76f4-4547-8932-c04e3353169d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:49.959347 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-dd5ad635-76f4-4547-8932-c04e3353169d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:49.966030 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dd5ad635-76f4-4547-8932-c04e3353169d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:49.966474 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dd5ad635-76f4-4547-8932-c04e3353169d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:49.967233 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dd5ad635-76f4-4547-8932-c04e3353169d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:49.967665 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dd5ad635-76f4-4547-8932-c04e3353169d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:50.028471 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-dd5ad635-76f4-4547-8932-c04e3353169d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:50.036822 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-dd5ad635-76f4-4547-8932-c04e3353169d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:50.038321 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-dd5ad635-76f4-4547-8932-c04e3353169d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:50.039471 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-dd5ad635-76f4-4547-8932-c04e3353169d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084677 May 24 15:39:50.040042 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1082/2184] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:39:49 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:39:50.115399 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-3164b308-394d-41b9-bed0-6bb26f492015 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:50.116267 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-3164b308-394d-41b9-bed0-6bb26f492015 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:50.122238 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3164b308-394d-41b9-bed0-6bb26f492015 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:50.122687 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3164b308-394d-41b9-bed0-6bb26f492015 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:50.123446 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3164b308-394d-41b9-bed0-6bb26f492015 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:50.123881 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3164b308-394d-41b9-bed0-6bb26f492015 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:50.251993 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-3164b308-394d-41b9-bed0-6bb26f492015 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:50.259842 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-3164b308-394d-41b9-bed0-6bb26f492015 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.148745 May 24 15:39:50.260416 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1103/2185] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:50 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:50.622119 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-14fec078-4826-4d4c-b6f0-312885de01c2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:50.622724 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-14fec078-4826-4d4c-b6f0-312885de01c2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:50.628923 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-14fec078-4826-4d4c-b6f0-312885de01c2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:50.629367 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-14fec078-4826-4d4c-b6f0-312885de01c2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:50.630120 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-14fec078-4826-4d4c-b6f0-312885de01c2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:50.630550 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-14fec078-4826-4d4c-b6f0-312885de01c2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:50.754739 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-14fec078-4826-4d4c-b6f0-312885de01c2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:50.762626 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-14fec078-4826-4d4c-b6f0-312885de01c2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.144329 May 24 15:39:50.763186 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1083/2186] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:50 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:50.892838 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-f2f9658e-1939-429d-81a3-3ba28fa2a357 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:50.893385 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-f2f9658e-1939-429d-81a3-3ba28fa2a357 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:50.900352 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f2f9658e-1939-429d-81a3-3ba28fa2a357 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:50.900808 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f2f9658e-1939-429d-81a3-3ba28fa2a357 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:50.901566 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f2f9658e-1939-429d-81a3-3ba28fa2a357 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:50.902007 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f2f9658e-1939-429d-81a3-3ba28fa2a357 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:51.048001 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-f2f9658e-1939-429d-81a3-3ba28fa2a357 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:51.056177 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-f2f9658e-1939-429d-81a3-3ba28fa2a357 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.167189 May 24 15:39:51.056966 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1104/2187] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:50 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:51.057092 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-18e52bff-d9ef-4596-a0be-2a2dce5cd86b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:51.057751 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-18e52bff-d9ef-4596-a0be-2a2dce5cd86b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:51.064186 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-18e52bff-d9ef-4596-a0be-2a2dce5cd86b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:51.064667 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-18e52bff-d9ef-4596-a0be-2a2dce5cd86b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:51.065423 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-18e52bff-d9ef-4596-a0be-2a2dce5cd86b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:51.066343 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-18e52bff-d9ef-4596-a0be-2a2dce5cd86b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:51.133997 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-18e52bff-d9ef-4596-a0be-2a2dce5cd86b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:51.142512 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-18e52bff-d9ef-4596-a0be-2a2dce5cd86b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:51.144773 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-18e52bff-d9ef-4596-a0be-2a2dce5cd86b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:51.145850 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-18e52bff-d9ef-4596-a0be-2a2dce5cd86b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.092676 May 24 15:39:51.146402 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1084/2188] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:39:51 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:39:51.275598 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-67a90df7-56a4-4bab-ac78-bceff8c07ed6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:51.276207 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-67a90df7-56a4-4bab-ac78-bceff8c07ed6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:51.282186 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-67a90df7-56a4-4bab-ac78-bceff8c07ed6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:51.282632 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-67a90df7-56a4-4bab-ac78-bceff8c07ed6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:51.283372 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-67a90df7-56a4-4bab-ac78-bceff8c07ed6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:51.283800 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-67a90df7-56a4-4bab-ac78-bceff8c07ed6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:51.416346 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-67a90df7-56a4-4bab-ac78-bceff8c07ed6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:51.424238 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-67a90df7-56a4-4bab-ac78-bceff8c07ed6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.152452 May 24 15:39:51.425320 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1105/2189] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:51 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:51.779296 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-80dfbba8-5c68-4703-8120-12f1e9d4766d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:51.779900 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-80dfbba8-5c68-4703-8120-12f1e9d4766d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:51.786579 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-80dfbba8-5c68-4703-8120-12f1e9d4766d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:51.787019 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-80dfbba8-5c68-4703-8120-12f1e9d4766d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:51.787775 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-80dfbba8-5c68-4703-8120-12f1e9d4766d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:51.788202 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-80dfbba8-5c68-4703-8120-12f1e9d4766d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:51.922416 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-80dfbba8-5c68-4703-8120-12f1e9d4766d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:51.930881 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-80dfbba8-5c68-4703-8120-12f1e9d4766d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.155424 May 24 15:39:51.931458 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1085/2190] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:51 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:52.073585 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-8738fa01-8564-4421-a183-7af88e5ef854 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:52.074207 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-8738fa01-8564-4421-a183-7af88e5ef854 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:52.080761 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8738fa01-8564-4421-a183-7af88e5ef854 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:52.081703 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8738fa01-8564-4421-a183-7af88e5ef854 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:52.082461 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8738fa01-8564-4421-a183-7af88e5ef854 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:52.082896 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8738fa01-8564-4421-a183-7af88e5ef854 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:52.163964 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-5ac6558a-5217-4ef7-b0f8-f78a0ddf8fa1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:52.164673 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-5ac6558a-5217-4ef7-b0f8-f78a0ddf8fa1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:52.171204 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5ac6558a-5217-4ef7-b0f8-f78a0ddf8fa1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:52.171653 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5ac6558a-5217-4ef7-b0f8-f78a0ddf8fa1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:52.172440 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5ac6558a-5217-4ef7-b0f8-f78a0ddf8fa1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:52.172880 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5ac6558a-5217-4ef7-b0f8-f78a0ddf8fa1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:52.209041 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-8738fa01-8564-4421-a183-7af88e5ef854 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:52.217050 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-8738fa01-8564-4421-a183-7af88e5ef854 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.147255 May 24 15:39:52.217629 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1106/2191] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:52 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:39:52.233779 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-5ac6558a-5217-4ef7-b0f8-f78a0ddf8fa1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:52.242342 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-5ac6558a-5217-4ef7-b0f8-f78a0ddf8fa1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:52.243830 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-5ac6558a-5217-4ef7-b0f8-f78a0ddf8fa1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:52.245005 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-5ac6558a-5217-4ef7-b0f8-f78a0ddf8fa1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.085540 May 24 15:39:52.245560 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1086/2192] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:39:52 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:39:52.442193 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-57d347a7-bc07-4d18-89bd-304f9711e3e1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:52.442718 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-57d347a7-bc07-4d18-89bd-304f9711e3e1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:52.448767 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-57d347a7-bc07-4d18-89bd-304f9711e3e1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:52.449289 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-57d347a7-bc07-4d18-89bd-304f9711e3e1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:52.450046 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-57d347a7-bc07-4d18-89bd-304f9711e3e1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:52.450473 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-57d347a7-bc07-4d18-89bd-304f9711e3e1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:52.577266 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-57d347a7-bc07-4d18-89bd-304f9711e3e1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:52.589676 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-57d347a7-bc07-4d18-89bd-304f9711e3e1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.151327 May 24 15:39:52.590335 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1107/2193] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:52 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:52.947676 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-c2142651-779c-49b0-a5e1-b4b1beceed1f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:52.948281 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-c2142651-779c-49b0-a5e1-b4b1beceed1f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:52.954357 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c2142651-779c-49b0-a5e1-b4b1beceed1f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:52.954798 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c2142651-779c-49b0-a5e1-b4b1beceed1f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:52.955543 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c2142651-779c-49b0-a5e1-b4b1beceed1f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:52.955971 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c2142651-779c-49b0-a5e1-b4b1beceed1f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:53.083130 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-c2142651-779c-49b0-a5e1-b4b1beceed1f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:53.086496 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:39:53.091988 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-c2142651-779c-49b0-a5e1-b4b1beceed1f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.148196 May 24 15:39:53.092596 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1087/2194] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:52 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:53.234602 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-ba3e3e57-cb9d-48b3-988f-05376eb96d18 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:53.235210 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-ba3e3e57-cb9d-48b3-988f-05376eb96d18 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:53.242479 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ba3e3e57-cb9d-48b3-988f-05376eb96d18 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:53.242928 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ba3e3e57-cb9d-48b3-988f-05376eb96d18 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:53.243672 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ba3e3e57-cb9d-48b3-988f-05376eb96d18 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:53.244100 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ba3e3e57-cb9d-48b3-988f-05376eb96d18 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:53.262841 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-15c8c40a-9635-4d18-8ecc-30369106dc10 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:53.263448 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-15c8c40a-9635-4d18-8ecc-30369106dc10 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:53.269977 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-15c8c40a-9635-4d18-8ecc-30369106dc10 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:53.270426 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-15c8c40a-9635-4d18-8ecc-30369106dc10 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:53.271188 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-15c8c40a-9635-4d18-8ecc-30369106dc10 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:53.271624 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-15c8c40a-9635-4d18-8ecc-30369106dc10 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:53.332763 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-15c8c40a-9635-4d18-8ecc-30369106dc10 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:53.341299 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-15c8c40a-9635-4d18-8ecc-30369106dc10 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:53.342801 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-15c8c40a-9635-4d18-8ecc-30369106dc10 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:53.343939 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-15c8c40a-9635-4d18-8ecc-30369106dc10 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.085005 May 24 15:39:53.350204 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1088/2195] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:39:53 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:39:53.377959 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ba3e3e57-cb9d-48b3-988f-05376eb96d18 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:53.385815 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-ba3e3e57-cb9d-48b3-988f-05376eb96d18 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.155040 May 24 15:39:53.386372 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1108/2196] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:53 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:53.606660 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-bfd518ae-4bad-4948-a628-75ea84cf1c85 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:53.607199 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-bfd518ae-4bad-4948-a628-75ea84cf1c85 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:53.613287 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bfd518ae-4bad-4948-a628-75ea84cf1c85 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:53.613734 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bfd518ae-4bad-4948-a628-75ea84cf1c85 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:53.614487 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bfd518ae-4bad-4948-a628-75ea84cf1c85 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:53.614924 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bfd518ae-4bad-4948-a628-75ea84cf1c85 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:53.743336 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-bfd518ae-4bad-4948-a628-75ea84cf1c85 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:53.751328 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-bfd518ae-4bad-4948-a628-75ea84cf1c85 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.148592 May 24 15:39:53.751893 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1089/2197] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:53 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:54.108905 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-b4f77bf8-fa9e-4b77-8307-df19e708b59f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:54.109513 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-b4f77bf8-fa9e-4b77-8307-df19e708b59f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:54.115498 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b4f77bf8-fa9e-4b77-8307-df19e708b59f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:54.116194 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b4f77bf8-fa9e-4b77-8307-df19e708b59f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:54.116964 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b4f77bf8-fa9e-4b77-8307-df19e708b59f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:54.117394 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b4f77bf8-fa9e-4b77-8307-df19e708b59f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:54.242481 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-b4f77bf8-fa9e-4b77-8307-df19e708b59f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:54.250338 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-b4f77bf8-fa9e-4b77-8307-df19e708b59f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.145245 May 24 15:39:54.250905 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1109/2198] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:54 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:54.362049 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-5d4dbcae-481f-4204-a387-767c9fab1715 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:54.363117 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-5d4dbcae-481f-4204-a387-767c9fab1715 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:54.369841 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5d4dbcae-481f-4204-a387-767c9fab1715 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:54.370281 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5d4dbcae-481f-4204-a387-767c9fab1715 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:54.371024 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5d4dbcae-481f-4204-a387-767c9fab1715 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:54.371557 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5d4dbcae-481f-4204-a387-767c9fab1715 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:54.402579 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-8e871e0e-4d0d-455e-8fac-ba17daea8664 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:54.403191 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-8e871e0e-4d0d-455e-8fac-ba17daea8664 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:54.409297 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8e871e0e-4d0d-455e-8fac-ba17daea8664 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:54.409748 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8e871e0e-4d0d-455e-8fac-ba17daea8664 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:54.410510 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8e871e0e-4d0d-455e-8fac-ba17daea8664 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:54.410949 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8e871e0e-4d0d-455e-8fac-ba17daea8664 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:54.436086 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-5d4dbcae-481f-4204-a387-767c9fab1715 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:54.445236 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-5d4dbcae-481f-4204-a387-767c9fab1715 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:54.446723 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-5d4dbcae-481f-4204-a387-767c9fab1715 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:54.447860 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-5d4dbcae-481f-4204-a387-767c9fab1715 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.089713 May 24 15:39:54.448433 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1090/2199] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:39:54 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:39:54.540956 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-8e871e0e-4d0d-455e-8fac-ba17daea8664 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:54.548930 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-8e871e0e-4d0d-455e-8fac-ba17daea8664 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.150218 May 24 15:39:54.549496 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1110/2200] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:54 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:39:54.767941 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-6af14f60-d3eb-4ff2-b9be-6201dcdf1b36 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:54.768592 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-6af14f60-d3eb-4ff2-b9be-6201dcdf1b36 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:54.774595 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6af14f60-d3eb-4ff2-b9be-6201dcdf1b36 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:54.775042 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6af14f60-d3eb-4ff2-b9be-6201dcdf1b36 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:54.775791 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6af14f60-d3eb-4ff2-b9be-6201dcdf1b36 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:54.776224 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6af14f60-d3eb-4ff2-b9be-6201dcdf1b36 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:54.899840 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-6af14f60-d3eb-4ff2-b9be-6201dcdf1b36 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:54.907688 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-6af14f60-d3eb-4ff2-b9be-6201dcdf1b36 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.143531 May 24 15:39:54.908252 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1091/2201] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:54 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:55.267452 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-1ddb442a-0ec2-407e-bf90-038e39ccaf23 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:55.268057 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-1ddb442a-0ec2-407e-bf90-038e39ccaf23 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:55.275068 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1ddb442a-0ec2-407e-bf90-038e39ccaf23 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:55.275511 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1ddb442a-0ec2-407e-bf90-038e39ccaf23 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:55.276259 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1ddb442a-0ec2-407e-bf90-038e39ccaf23 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:55.276713 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1ddb442a-0ec2-407e-bf90-038e39ccaf23 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:55.400526 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-1ddb442a-0ec2-407e-bf90-038e39ccaf23 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:55.408323 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-1ddb442a-0ec2-407e-bf90-038e39ccaf23 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.144652 May 24 15:39:55.408877 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1111/2202] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:55 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:55.465529 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-9c7617e0-f283-4090-91d1-c93417a15484 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:55.466142 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-9c7617e0-f283-4090-91d1-c93417a15484 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:55.472742 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9c7617e0-f283-4090-91d1-c93417a15484 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:55.473191 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9c7617e0-f283-4090-91d1-c93417a15484 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:55.473948 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9c7617e0-f283-4090-91d1-c93417a15484 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:55.474381 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9c7617e0-f283-4090-91d1-c93417a15484 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:55.535043 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-9c7617e0-f283-4090-91d1-c93417a15484 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:55.543382 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-9c7617e0-f283-4090-91d1-c93417a15484 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:55.544899 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-9c7617e0-f283-4090-91d1-c93417a15484 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:55.546026 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-9c7617e0-f283-4090-91d1-c93417a15484 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084383 May 24 15:39:55.546580 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1092/2203] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:39:55 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:39:55.566664 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-fff7d2a9-201b-4efe-9ea3-e126a3e52a54 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:55.567281 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-fff7d2a9-201b-4efe-9ea3-e126a3e52a54 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:55.573298 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fff7d2a9-201b-4efe-9ea3-e126a3e52a54 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:55.573747 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fff7d2a9-201b-4efe-9ea3-e126a3e52a54 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:55.574501 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fff7d2a9-201b-4efe-9ea3-e126a3e52a54 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:55.574938 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fff7d2a9-201b-4efe-9ea3-e126a3e52a54 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:55.593238 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:39:55.703122 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-fff7d2a9-201b-4efe-9ea3-e126a3e52a54 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:55.711670 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-fff7d2a9-201b-4efe-9ea3-e126a3e52a54 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.149297 May 24 15:39:55.712234 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1112/2204] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:55 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:55.925145 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-7a56ad71-3cd3-46cd-b6b3-831d62f2d11e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:55.926175 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-7a56ad71-3cd3-46cd-b6b3-831d62f2d11e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:55.932232 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7a56ad71-3cd3-46cd-b6b3-831d62f2d11e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:55.932704 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7a56ad71-3cd3-46cd-b6b3-831d62f2d11e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:55.933452 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7a56ad71-3cd3-46cd-b6b3-831d62f2d11e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:55.933877 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7a56ad71-3cd3-46cd-b6b3-831d62f2d11e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:56.061447 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-7a56ad71-3cd3-46cd-b6b3-831d62f2d11e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:56.070314 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-7a56ad71-3cd3-46cd-b6b3-831d62f2d11e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.149046 May 24 15:39:56.070880 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1093/2205] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:55 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:56.426317 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-f93b8111-1b19-46d7-8f98-6ddc1bc1c5a2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:56.426927 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-f93b8111-1b19-46d7-8f98-6ddc1bc1c5a2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:56.433409 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f93b8111-1b19-46d7-8f98-6ddc1bc1c5a2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:56.433853 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f93b8111-1b19-46d7-8f98-6ddc1bc1c5a2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:56.434601 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f93b8111-1b19-46d7-8f98-6ddc1bc1c5a2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:56.435030 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f93b8111-1b19-46d7-8f98-6ddc1bc1c5a2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:56.559604 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-f93b8111-1b19-46d7-8f98-6ddc1bc1c5a2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:56.562915 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-ca372d68-de70-4840-97f0-6f31e390f5aa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:56.563550 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-ca372d68-de70-4840-97f0-6f31e390f5aa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:56.567570 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-f93b8111-1b19-46d7-8f98-6ddc1bc1c5a2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.145680 May 24 15:39:56.568135 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1113/2206] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:56 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:56.570043 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ca372d68-de70-4840-97f0-6f31e390f5aa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:56.570487 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ca372d68-de70-4840-97f0-6f31e390f5aa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:56.571251 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ca372d68-de70-4840-97f0-6f31e390f5aa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:56.571679 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ca372d68-de70-4840-97f0-6f31e390f5aa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:56.641403 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-ca372d68-de70-4840-97f0-6f31e390f5aa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:56.650145 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-ca372d68-de70-4840-97f0-6f31e390f5aa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:56.651623 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-ca372d68-de70-4840-97f0-6f31e390f5aa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:56.652779 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-ca372d68-de70-4840-97f0-6f31e390f5aa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.093820 May 24 15:39:56.653336 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1094/2207] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:39:56 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:39:56.729440 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-bcc35620-73d3-4766-87fa-86d0584778cd tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:56.730052 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-bcc35620-73d3-4766-87fa-86d0584778cd tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:56.736099 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bcc35620-73d3-4766-87fa-86d0584778cd tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:56.736591 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bcc35620-73d3-4766-87fa-86d0584778cd tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:56.737346 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bcc35620-73d3-4766-87fa-86d0584778cd tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:56.737783 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bcc35620-73d3-4766-87fa-86d0584778cd tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:56.862342 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-bcc35620-73d3-4766-87fa-86d0584778cd tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:56.870501 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-bcc35620-73d3-4766-87fa-86d0584778cd tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.144894 May 24 15:39:56.871065 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1114/2208] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:56 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:39:57.087540 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-2307484a-b46f-4f27-829d-65070a8fed21 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:57.088151 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-2307484a-b46f-4f27-829d-65070a8fed21 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:57.094381 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2307484a-b46f-4f27-829d-65070a8fed21 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:57.094833 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2307484a-b46f-4f27-829d-65070a8fed21 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:57.095593 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2307484a-b46f-4f27-829d-65070a8fed21 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:57.096035 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2307484a-b46f-4f27-829d-65070a8fed21 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:57.219558 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-2307484a-b46f-4f27-829d-65070a8fed21 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:57.227582 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-2307484a-b46f-4f27-829d-65070a8fed21 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.143909 May 24 15:39:57.228160 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1095/2209] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:57 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:57.584550 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-423c69a6-6504-4c05-8508-775ea0b2b46c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:57.585191 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-423c69a6-6504-4c05-8508-775ea0b2b46c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:57.591896 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-423c69a6-6504-4c05-8508-775ea0b2b46c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:57.592375 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-423c69a6-6504-4c05-8508-775ea0b2b46c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:57.593145 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-423c69a6-6504-4c05-8508-775ea0b2b46c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:57.593584 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-423c69a6-6504-4c05-8508-775ea0b2b46c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:57.671084 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-6c97edbe-fc9d-4d9b-8be8-70ac20b58fa7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:57.671699 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-6c97edbe-fc9d-4d9b-8be8-70ac20b58fa7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:57.678819 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6c97edbe-fc9d-4d9b-8be8-70ac20b58fa7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:57.679271 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6c97edbe-fc9d-4d9b-8be8-70ac20b58fa7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:57.680038 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6c97edbe-fc9d-4d9b-8be8-70ac20b58fa7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:57.680509 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6c97edbe-fc9d-4d9b-8be8-70ac20b58fa7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:57.724828 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-423c69a6-6504-4c05-8508-775ea0b2b46c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:57.732706 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-423c69a6-6504-4c05-8508-775ea0b2b46c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.152050 May 24 15:39:57.733266 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1115/2210] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:57 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:57.746331 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-6c97edbe-fc9d-4d9b-8be8-70ac20b58fa7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:57.754671 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-6c97edbe-fc9d-4d9b-8be8-70ac20b58fa7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:57.756155 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-6c97edbe-fc9d-4d9b-8be8-70ac20b58fa7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:57.757319 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-6c97edbe-fc9d-4d9b-8be8-70ac20b58fa7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.090233 May 24 15:39:57.757862 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1096/2211] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:39:57 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:39:57.886928 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c98876a3-ef93-4ca7-b5f5-5a067b9f3f60 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:57.887495 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-c98876a3-ef93-4ca7-b5f5-5a067b9f3f60 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:57.893466 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c98876a3-ef93-4ca7-b5f5-5a067b9f3f60 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:57.893915 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c98876a3-ef93-4ca7-b5f5-5a067b9f3f60 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:57.894668 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c98876a3-ef93-4ca7-b5f5-5a067b9f3f60 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:57.895098 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c98876a3-ef93-4ca7-b5f5-5a067b9f3f60 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:58.019403 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-c98876a3-ef93-4ca7-b5f5-5a067b9f3f60 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:58.027413 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-c98876a3-ef93-4ca7-b5f5-5a067b9f3f60 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.144464 May 24 15:39:58.027963 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1116/2212] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:57 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:58.244734 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-8c6c7bd5-6f34-4e0f-84b9-d5e9298e732f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:58.245341 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-8c6c7bd5-6f34-4e0f-84b9-d5e9298e732f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:58.251370 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8c6c7bd5-6f34-4e0f-84b9-d5e9298e732f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:58.251810 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8c6c7bd5-6f34-4e0f-84b9-d5e9298e732f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:58.252585 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8c6c7bd5-6f34-4e0f-84b9-d5e9298e732f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:58.253017 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8c6c7bd5-6f34-4e0f-84b9-d5e9298e732f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:58.380197 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-8c6c7bd5-6f34-4e0f-84b9-d5e9298e732f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:58.388247 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-8c6c7bd5-6f34-4e0f-84b9-d5e9298e732f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.147735 May 24 15:39:58.388835 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1097/2213] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:58 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:58.749363 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-5f2cd0ff-08e5-4d8d-bd56-a2f7d9f11ed1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:58.749976 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-5f2cd0ff-08e5-4d8d-bd56-a2f7d9f11ed1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:58.756979 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5f2cd0ff-08e5-4d8d-bd56-a2f7d9f11ed1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:58.757427 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5f2cd0ff-08e5-4d8d-bd56-a2f7d9f11ed1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:58.758184 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5f2cd0ff-08e5-4d8d-bd56-a2f7d9f11ed1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:58.758622 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5f2cd0ff-08e5-4d8d-bd56-a2f7d9f11ed1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:58.775411 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-68de3f36-09b9-4322-8862-faace058c48c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:58.776013 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-68de3f36-09b9-4322-8862-faace058c48c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:58.782364 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-68de3f36-09b9-4322-8862-faace058c48c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:58.782804 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-68de3f36-09b9-4322-8862-faace058c48c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:58.783551 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-68de3f36-09b9-4322-8862-faace058c48c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:58.784011 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-68de3f36-09b9-4322-8862-faace058c48c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:58.845523 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-68de3f36-09b9-4322-8862-faace058c48c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:58.854040 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-68de3f36-09b9-4322-8862-faace058c48c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:58.855530 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-68de3f36-09b9-4322-8862-faace058c48c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:58.856701 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-68de3f36-09b9-4322-8862-faace058c48c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.085178 May 24 15:39:58.857498 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1098/2214] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:39:58 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:39:58.889505 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-5f2cd0ff-08e5-4d8d-bd56-a2f7d9f11ed1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:58.897600 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-5f2cd0ff-08e5-4d8d-bd56-a2f7d9f11ed1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.151987 May 24 15:39:58.898345 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1117/2215] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:58 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:59.044778 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-73d00671-4ed1-4a2a-bd02-b12c1ec2cf4e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:59.045332 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-73d00671-4ed1-4a2a-bd02-b12c1ec2cf4e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:59.051874 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-73d00671-4ed1-4a2a-bd02-b12c1ec2cf4e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:59.052331 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-73d00671-4ed1-4a2a-bd02-b12c1ec2cf4e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:59.053082 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-73d00671-4ed1-4a2a-bd02-b12c1ec2cf4e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:59.053509 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-73d00671-4ed1-4a2a-bd02-b12c1ec2cf4e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:59.174628 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 15:39:59.174875 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Tue May 24 15:39:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 (ip 10.222.0.45) !!! May 24 15:39:59.184243 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-73d00671-4ed1-4a2a-bd02-b12c1ec2cf4e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:59.192815 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-73d00671-4ed1-4a2a-bd02-b12c1ec2cf4e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.151935 May 24 15:39:59.193380 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1099/2216] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:59 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:59.404584 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-838ae60b-8819-4129-b92c-941794e3563f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:59.405191 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-838ae60b-8819-4129-b92c-941794e3563f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:59.411686 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-838ae60b-8819-4129-b92c-941794e3563f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:59.412126 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-838ae60b-8819-4129-b92c-941794e3563f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:59.412898 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-838ae60b-8819-4129-b92c-941794e3563f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:59.413326 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-838ae60b-8819-4129-b92c-941794e3563f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:59.536553 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-838ae60b-8819-4129-b92c-941794e3563f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:59.544368 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-838ae60b-8819-4129-b92c-941794e3563f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.143616 May 24 15:39:59.544926 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1118/2217] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:59 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:59.874871 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-3509e7f5-1a83-4874-b578-aa2f064ef7b0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:59.875504 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-3509e7f5-1a83-4874-b578-aa2f064ef7b0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:59.881955 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3509e7f5-1a83-4874-b578-aa2f064ef7b0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:59.882424 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3509e7f5-1a83-4874-b578-aa2f064ef7b0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:59.883174 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3509e7f5-1a83-4874-b578-aa2f064ef7b0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:59.883602 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3509e7f5-1a83-4874-b578-aa2f064ef7b0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:59.914874 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-105d5b59-ffc0-4045-87ae-274b9f1723cd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:59.915512 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-105d5b59-ffc0-4045-87ae-274b9f1723cd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:59.922498 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-105d5b59-ffc0-4045-87ae-274b9f1723cd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:59.922956 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-105d5b59-ffc0-4045-87ae-274b9f1723cd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:59.923728 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-105d5b59-ffc0-4045-87ae-274b9f1723cd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:59.924175 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-105d5b59-ffc0-4045-87ae-274b9f1723cd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:59.948927 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-3509e7f5-1a83-4874-b578-aa2f064ef7b0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:59.958400 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-3509e7f5-1a83-4874-b578-aa2f064ef7b0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:59.959998 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-3509e7f5-1a83-4874-b578-aa2f064ef7b0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:59.961169 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-3509e7f5-1a83-4874-b578-aa2f064ef7b0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.090224 May 24 15:39:59.961732 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1100/2218] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:39:59 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:00.058166 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-105d5b59-ffc0-4045-87ae-274b9f1723cd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:00.066724 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-105d5b59-ffc0-4045-87ae-274b9f1723cd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.155099 May 24 15:40:00.067656 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1119/2219] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:39:59 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:40:00.210427 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-2d5aa066-84c2-4b37-8312-6b7657c82b09 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:00.210965 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-2d5aa066-84c2-4b37-8312-6b7657c82b09 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:00.217057 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2d5aa066-84c2-4b37-8312-6b7657c82b09 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:00.217499 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2d5aa066-84c2-4b37-8312-6b7657c82b09 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:00.218246 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2d5aa066-84c2-4b37-8312-6b7657c82b09 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:00.218675 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2d5aa066-84c2-4b37-8312-6b7657c82b09 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:00.343666 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-2d5aa066-84c2-4b37-8312-6b7657c82b09 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:00.351598 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-2d5aa066-84c2-4b37-8312-6b7657c82b09 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.145715 May 24 15:40:00.352167 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1101/2220] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:00 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:00.561932 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e3145106-afdb-4bbc-964d-976cb845ebb1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:00.562531 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e3145106-afdb-4bbc-964d-976cb845ebb1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:00.564393 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_api:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:40:00.570211 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e3145106-afdb-4bbc-964d-976cb845ebb1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:00.570655 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e3145106-afdb-4bbc-964d-976cb845ebb1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:00.571399 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e3145106-afdb-4bbc-964d-976cb845ebb1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:00.571829 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e3145106-afdb-4bbc-964d-976cb845ebb1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:00.701545 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e3145106-afdb-4bbc-964d-976cb845ebb1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:00.709463 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e3145106-afdb-4bbc-964d-976cb845ebb1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.151438 May 24 15:40:00.710025 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1120/2221] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:00 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:00.979407 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-47cfeb24-c09c-4838-94e9-25662f28818a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:00.980026 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-47cfeb24-c09c-4838-94e9-25662f28818a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:00.986593 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-47cfeb24-c09c-4838-94e9-25662f28818a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:00.987044 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-47cfeb24-c09c-4838-94e9-25662f28818a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:00.987807 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-47cfeb24-c09c-4838-94e9-25662f28818a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:00.989079 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-47cfeb24-c09c-4838-94e9-25662f28818a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:01.053669 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-47cfeb24-c09c-4838-94e9-25662f28818a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:01.062044 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-47cfeb24-c09c-4838-94e9-25662f28818a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:01.063529 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-47cfeb24-c09c-4838-94e9-25662f28818a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:01.064699 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-47cfeb24-c09c-4838-94e9-25662f28818a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.089217 May 24 15:40:01.065454 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1102/2222] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:40:00 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:01.084416 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-950bf736-2242-4d1d-ac13-e89a5ea1a49e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:01.085026 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-950bf736-2242-4d1d-ac13-e89a5ea1a49e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:01.091491 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-950bf736-2242-4d1d-ac13-e89a5ea1a49e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:01.091929 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-950bf736-2242-4d1d-ac13-e89a5ea1a49e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:01.092770 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-950bf736-2242-4d1d-ac13-e89a5ea1a49e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:01.093195 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-950bf736-2242-4d1d-ac13-e89a5ea1a49e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:01.224382 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-950bf736-2242-4d1d-ac13-e89a5ea1a49e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:01.232349 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-950bf736-2242-4d1d-ac13-e89a5ea1a49e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.152223 May 24 15:40:01.232917 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1121/2223] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:01 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:01.369252 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-58d382f7-0467-4561-b55b-49966db60c1e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:01.369857 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-58d382f7-0467-4561-b55b-49966db60c1e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:01.375881 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-58d382f7-0467-4561-b55b-49966db60c1e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:01.376345 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-58d382f7-0467-4561-b55b-49966db60c1e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:01.377097 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-58d382f7-0467-4561-b55b-49966db60c1e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:01.377526 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-58d382f7-0467-4561-b55b-49966db60c1e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:01.501380 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-58d382f7-0467-4561-b55b-49966db60c1e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:01.509824 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-58d382f7-0467-4561-b55b-49966db60c1e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.144672 May 24 15:40:01.510393 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1103/2224] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:01 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:01.726267 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-8adec423-ac4a-4811-bcd2-2de241cc66db tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:01.726884 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-8adec423-ac4a-4811-bcd2-2de241cc66db tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:01.732928 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8adec423-ac4a-4811-bcd2-2de241cc66db tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:01.733384 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8adec423-ac4a-4811-bcd2-2de241cc66db tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:01.734149 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8adec423-ac4a-4811-bcd2-2de241cc66db tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:01.734590 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8adec423-ac4a-4811-bcd2-2de241cc66db tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:01.869267 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-8adec423-ac4a-4811-bcd2-2de241cc66db tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:01.877148 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-8adec423-ac4a-4811-bcd2-2de241cc66db tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.154683 May 24 15:40:01.877714 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1122/2225] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:01 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:02.082696 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-aadf36fc-2f0e-437a-959b-59a920ad48e0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:02.083306 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-aadf36fc-2f0e-437a-959b-59a920ad48e0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:02.090061 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-aadf36fc-2f0e-437a-959b-59a920ad48e0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:02.090510 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-aadf36fc-2f0e-437a-959b-59a920ad48e0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:02.091264 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-aadf36fc-2f0e-437a-959b-59a920ad48e0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:02.091697 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-aadf36fc-2f0e-437a-959b-59a920ad48e0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:02.109265 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:40:02.152877 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-aadf36fc-2f0e-437a-959b-59a920ad48e0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:02.161203 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-aadf36fc-2f0e-437a-959b-59a920ad48e0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:02.162704 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-aadf36fc-2f0e-437a-959b-59a920ad48e0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:02.163840 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-aadf36fc-2f0e-437a-959b-59a920ad48e0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.085093 May 24 15:40:02.164424 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1104/2226] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:40:02 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:02.249570 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-7e7b7981-eb94-4496-97d8-0e636638081a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:02.250179 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-7e7b7981-eb94-4496-97d8-0e636638081a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:02.256694 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7e7b7981-eb94-4496-97d8-0e636638081a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:02.257140 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7e7b7981-eb94-4496-97d8-0e636638081a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:02.257920 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7e7b7981-eb94-4496-97d8-0e636638081a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:02.258351 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7e7b7981-eb94-4496-97d8-0e636638081a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:02.382637 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-7e7b7981-eb94-4496-97d8-0e636638081a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:02.390510 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-7e7b7981-eb94-4496-97d8-0e636638081a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.144784 May 24 15:40:02.391071 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1123/2227] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:02 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:02.526195 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-4d261661-9d49-4517-a2c9-d1881afe06bc tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:02.526834 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-4d261661-9d49-4517-a2c9-d1881afe06bc tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:02.532931 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4d261661-9d49-4517-a2c9-d1881afe06bc tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:02.533658 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4d261661-9d49-4517-a2c9-d1881afe06bc tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:02.534413 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4d261661-9d49-4517-a2c9-d1881afe06bc tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:02.535331 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4d261661-9d49-4517-a2c9-d1881afe06bc tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:02.667642 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-4d261661-9d49-4517-a2c9-d1881afe06bc tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:02.675561 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-4d261661-9d49-4517-a2c9-d1881afe06bc tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.153126 May 24 15:40:02.676134 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1105/2228] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:02 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:02.895115 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-1436c1d2-39ff-4cd6-a776-9d02f048ed1e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:02.895668 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-1436c1d2-39ff-4cd6-a776-9d02f048ed1e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:02.901631 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1436c1d2-39ff-4cd6-a776-9d02f048ed1e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:02.902079 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1436c1d2-39ff-4cd6-a776-9d02f048ed1e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:02.902832 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1436c1d2-39ff-4cd6-a776-9d02f048ed1e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:02.903266 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1436c1d2-39ff-4cd6-a776-9d02f048ed1e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:03.035505 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-1436c1d2-39ff-4cd6-a776-9d02f048ed1e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:03.043381 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-1436c1d2-39ff-4cd6-a776-9d02f048ed1e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.152678 May 24 15:40:03.043938 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1124/2229] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:02 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:03.181666 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d4d30696-be6e-4726-a98a-8eee45a4fd6e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:03.182215 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d4d30696-be6e-4726-a98a-8eee45a4fd6e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:03.188748 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d4d30696-be6e-4726-a98a-8eee45a4fd6e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:03.189194 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d4d30696-be6e-4726-a98a-8eee45a4fd6e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:03.189950 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d4d30696-be6e-4726-a98a-8eee45a4fd6e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:03.190386 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d4d30696-be6e-4726-a98a-8eee45a4fd6e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:03.250661 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-d4d30696-be6e-4726-a98a-8eee45a4fd6e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:03.261608 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-d4d30696-be6e-4726-a98a-8eee45a4fd6e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:03.263495 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-d4d30696-be6e-4726-a98a-8eee45a4fd6e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:03.265158 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d4d30696-be6e-4726-a98a-8eee45a4fd6e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.087497 May 24 15:40:03.265720 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1106/2230] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:40:03 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:03.406454 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-abc6458a-4ac4-4087-8adc-32df33e3eccd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:03.407057 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-abc6458a-4ac4-4087-8adc-32df33e3eccd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:03.413471 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-abc6458a-4ac4-4087-8adc-32df33e3eccd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:03.413912 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-abc6458a-4ac4-4087-8adc-32df33e3eccd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:03.414653 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-abc6458a-4ac4-4087-8adc-32df33e3eccd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:03.415081 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-abc6458a-4ac4-4087-8adc-32df33e3eccd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:03.541729 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-abc6458a-4ac4-4087-8adc-32df33e3eccd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:03.549744 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-abc6458a-4ac4-4087-8adc-32df33e3eccd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.147093 May 24 15:40:03.550319 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1125/2231] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:03 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:03.693371 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-ae854a36-cfcd-4dbb-8580-dfbfbf7f23a3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:03.693980 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-ae854a36-cfcd-4dbb-8580-dfbfbf7f23a3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:03.695837 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_api:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:40:03.701140 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ae854a36-cfcd-4dbb-8580-dfbfbf7f23a3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:03.701598 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ae854a36-cfcd-4dbb-8580-dfbfbf7f23a3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:03.702358 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ae854a36-cfcd-4dbb-8580-dfbfbf7f23a3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:03.702786 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ae854a36-cfcd-4dbb-8580-dfbfbf7f23a3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:03.826089 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-ae854a36-cfcd-4dbb-8580-dfbfbf7f23a3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:03.833884 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-ae854a36-cfcd-4dbb-8580-dfbfbf7f23a3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.145272 May 24 15:40:03.834449 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1107/2232] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:03 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:04.122026 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-1303d1b8-8269-4625-a83c-a57e5b11f7f8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:04.122636 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-1303d1b8-8269-4625-a83c-a57e5b11f7f8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:04.128734 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1303d1b8-8269-4625-a83c-a57e5b11f7f8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:04.129206 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1303d1b8-8269-4625-a83c-a57e5b11f7f8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:04.129957 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1303d1b8-8269-4625-a83c-a57e5b11f7f8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:04.130389 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1303d1b8-8269-4625-a83c-a57e5b11f7f8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:04.253906 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-1303d1b8-8269-4625-a83c-a57e5b11f7f8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:04.261833 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-1303d1b8-8269-4625-a83c-a57e5b11f7f8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.206388 May 24 15:40:04.262401 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1126/2233] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:04 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:04.282875 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-6f3615c2-c546-4be4-a761-c00b5f53446e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:04.283476 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-6f3615c2-c546-4be4-a761-c00b5f53446e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:04.290433 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6f3615c2-c546-4be4-a761-c00b5f53446e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:04.290873 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6f3615c2-c546-4be4-a761-c00b5f53446e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:04.291617 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6f3615c2-c546-4be4-a761-c00b5f53446e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:04.292042 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6f3615c2-c546-4be4-a761-c00b5f53446e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:04.354631 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-6f3615c2-c546-4be4-a761-c00b5f53446e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:04.363253 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-6f3615c2-c546-4be4-a761-c00b5f53446e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:04.364776 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-6f3615c2-c546-4be4-a761-c00b5f53446e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:04.366300 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-6f3615c2-c546-4be4-a761-c00b5f53446e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.086872 May 24 15:40:04.366855 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1108/2234] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:40:04 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:04.569860 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-ffafd4f3-60ce-4fe1-9fee-7602290041bb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:04.570469 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-ffafd4f3-60ce-4fe1-9fee-7602290041bb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:04.576961 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ffafd4f3-60ce-4fe1-9fee-7602290041bb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:04.577411 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ffafd4f3-60ce-4fe1-9fee-7602290041bb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:04.578172 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ffafd4f3-60ce-4fe1-9fee-7602290041bb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:04.578605 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ffafd4f3-60ce-4fe1-9fee-7602290041bb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:04.704962 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ffafd4f3-60ce-4fe1-9fee-7602290041bb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:04.713403 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-ffafd4f3-60ce-4fe1-9fee-7602290041bb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.147807 May 24 15:40:04.713964 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1127/2235] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:04 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:04.850516 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-7162d6e5-a185-4d04-96ac-dbd0db786381 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:04.851124 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-7162d6e5-a185-4d04-96ac-dbd0db786381 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:04.857194 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7162d6e5-a185-4d04-96ac-dbd0db786381 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:04.857633 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7162d6e5-a185-4d04-96ac-dbd0db786381 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:04.858378 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7162d6e5-a185-4d04-96ac-dbd0db786381 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:04.858805 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7162d6e5-a185-4d04-96ac-dbd0db786381 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:04.985859 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-7162d6e5-a185-4d04-96ac-dbd0db786381 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:04.994452 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-7162d6e5-a185-4d04-96ac-dbd0db786381 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.147797 May 24 15:40:04.995008 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1109/2236] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:04 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:05.278887 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d085089b-33f5-4975-b7b4-aa87313efd19 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:05.279500 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d085089b-33f5-4975-b7b4-aa87313efd19 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:05.286107 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d085089b-33f5-4975-b7b4-aa87313efd19 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:05.286561 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d085089b-33f5-4975-b7b4-aa87313efd19 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:05.287315 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d085089b-33f5-4975-b7b4-aa87313efd19 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:05.287755 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d085089b-33f5-4975-b7b4-aa87313efd19 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:05.383113 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e5265338-68b1-4e91-be30-242e3e460d20 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:05.383766 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-e5265338-68b1-4e91-be30-242e3e460d20 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:05.390242 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e5265338-68b1-4e91-be30-242e3e460d20 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:05.390695 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e5265338-68b1-4e91-be30-242e3e460d20 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:05.391463 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e5265338-68b1-4e91-be30-242e3e460d20 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:05.391900 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e5265338-68b1-4e91-be30-242e3e460d20 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:05.413112 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-d085089b-33f5-4975-b7b4-aa87313efd19 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:05.421082 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d085089b-33f5-4975-b7b4-aa87313efd19 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.146010 May 24 15:40:05.421656 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1128/2237] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:05 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:05.453174 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-e5265338-68b1-4e91-be30-242e3e460d20 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:05.461487 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-e5265338-68b1-4e91-be30-242e3e460d20 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:05.463016 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-e5265338-68b1-4e91-be30-242e3e460d20 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:05.464153 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-e5265338-68b1-4e91-be30-242e3e460d20 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084950 May 24 15:40:05.464751 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1110/2238] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:40:05 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:40:05.730150 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-7a3734c4-54fd-4d63-9318-3361351840d8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:05.730771 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-7a3734c4-54fd-4d63-9318-3361351840d8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:05.737403 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7a3734c4-54fd-4d63-9318-3361351840d8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:05.737850 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7a3734c4-54fd-4d63-9318-3361351840d8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:05.738605 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7a3734c4-54fd-4d63-9318-3361351840d8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:05.739032 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7a3734c4-54fd-4d63-9318-3361351840d8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:05.743282 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:40:05.868343 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-7a3734c4-54fd-4d63-9318-3361351840d8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:05.876173 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-7a3734c4-54fd-4d63-9318-3361351840d8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.149967 May 24 15:40:05.876760 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1129/2239] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:05 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:06.012031 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-ee6843cc-408a-4d52-be2f-5e34de9a84ac tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:06.012592 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-ee6843cc-408a-4d52-be2f-5e34de9a84ac tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:06.018833 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ee6843cc-408a-4d52-be2f-5e34de9a84ac tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:06.019883 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ee6843cc-408a-4d52-be2f-5e34de9a84ac tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:06.020686 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ee6843cc-408a-4d52-be2f-5e34de9a84ac tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:06.021120 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ee6843cc-408a-4d52-be2f-5e34de9a84ac tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:06.147685 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-ee6843cc-408a-4d52-be2f-5e34de9a84ac tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:06.155654 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-ee6843cc-408a-4d52-be2f-5e34de9a84ac tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.147540 May 24 15:40:06.156225 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1111/2240] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:06 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:06.438497 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e32ab211-1b05-4a2f-90ef-d90493bac789 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:06.439106 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e32ab211-1b05-4a2f-90ef-d90493bac789 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:06.445117 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e32ab211-1b05-4a2f-90ef-d90493bac789 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:06.445556 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e32ab211-1b05-4a2f-90ef-d90493bac789 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:06.446334 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e32ab211-1b05-4a2f-90ef-d90493bac789 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:06.446767 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e32ab211-1b05-4a2f-90ef-d90493bac789 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:06.482814 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-bb1facff-60a2-4651-a9d1-c726f1c73eaa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:06.483534 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-bb1facff-60a2-4651-a9d1-c726f1c73eaa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:06.490209 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bb1facff-60a2-4651-a9d1-c726f1c73eaa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:06.490944 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bb1facff-60a2-4651-a9d1-c726f1c73eaa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:06.491713 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bb1facff-60a2-4651-a9d1-c726f1c73eaa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:06.492151 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bb1facff-60a2-4651-a9d1-c726f1c73eaa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:06.552935 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-bb1facff-60a2-4651-a9d1-c726f1c73eaa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:06.561963 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-bb1facff-60a2-4651-a9d1-c726f1c73eaa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:06.563463 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-bb1facff-60a2-4651-a9d1-c726f1c73eaa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:06.564636 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-bb1facff-60a2-4651-a9d1-c726f1c73eaa tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.085680 May 24 15:40:06.565205 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1112/2241] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:40:06 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:40:06.572795 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e32ab211-1b05-4a2f-90ef-d90493bac789 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:06.580695 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e32ab211-1b05-4a2f-90ef-d90493bac789 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.146042 May 24 15:40:06.581246 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1130/2242] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:06 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:06.892995 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-ade866fc-9fb5-42a6-8768-794e1d1bf988 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:06.893604 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-ade866fc-9fb5-42a6-8768-794e1d1bf988 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:06.902474 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ade866fc-9fb5-42a6-8768-794e1d1bf988 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:06.902893 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ade866fc-9fb5-42a6-8768-794e1d1bf988 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:06.903534 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ade866fc-9fb5-42a6-8768-794e1d1bf988 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:06.903958 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ade866fc-9fb5-42a6-8768-794e1d1bf988 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:07.037332 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-ade866fc-9fb5-42a6-8768-794e1d1bf988 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:07.045159 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-ade866fc-9fb5-42a6-8768-794e1d1bf988 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.156003 May 24 15:40:07.046858 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1113/2243] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:06 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:07.172565 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d972e517-8cc1-4ff8-a1b2-6f4e13c1742e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:07.173174 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d972e517-8cc1-4ff8-a1b2-6f4e13c1742e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:07.180147 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d972e517-8cc1-4ff8-a1b2-6f4e13c1742e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:07.180630 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d972e517-8cc1-4ff8-a1b2-6f4e13c1742e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:07.181365 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d972e517-8cc1-4ff8-a1b2-6f4e13c1742e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:07.181793 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d972e517-8cc1-4ff8-a1b2-6f4e13c1742e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:07.308899 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-d972e517-8cc1-4ff8-a1b2-6f4e13c1742e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:07.317353 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d972e517-8cc1-4ff8-a1b2-6f4e13c1742e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.148703 May 24 15:40:07.317908 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1131/2244] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:07 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:07.581548 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-82641ce0-a9ec-4f50-b744-32c2e5e451d2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:07.582073 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-82641ce0-a9ec-4f50-b744-32c2e5e451d2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:07.588636 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-82641ce0-a9ec-4f50-b744-32c2e5e451d2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:07.589078 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-82641ce0-a9ec-4f50-b744-32c2e5e451d2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:07.589827 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-82641ce0-a9ec-4f50-b744-32c2e5e451d2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:07.590250 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-82641ce0-a9ec-4f50-b744-32c2e5e451d2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:07.598679 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-924283e5-93c6-4288-bd99-77ca5eb98d4f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:07.599285 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-924283e5-93c6-4288-bd99-77ca5eb98d4f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:07.605561 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-924283e5-93c6-4288-bd99-77ca5eb98d4f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:07.606007 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-924283e5-93c6-4288-bd99-77ca5eb98d4f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:07.606796 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-924283e5-93c6-4288-bd99-77ca5eb98d4f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:07.607232 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-924283e5-93c6-4288-bd99-77ca5eb98d4f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:07.654502 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-82641ce0-a9ec-4f50-b744-32c2e5e451d2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:07.663565 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-82641ce0-a9ec-4f50-b744-32c2e5e451d2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:07.665084 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-82641ce0-a9ec-4f50-b744-32c2e5e451d2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:07.666243 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-82641ce0-a9ec-4f50-b744-32c2e5e451d2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.088642 May 24 15:40:07.666798 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1114/2245] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:40:07 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:07.738745 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-924283e5-93c6-4288-bd99-77ca5eb98d4f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:07.746782 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-924283e5-93c6-4288-bd99-77ca5eb98d4f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.152366 May 24 15:40:07.747342 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1132/2246] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:07 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:08.062515 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-38ec2b8e-b4ed-4337-9793-53d84b5b2aa3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:08.063125 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-38ec2b8e-b4ed-4337-9793-53d84b5b2aa3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:08.069178 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-38ec2b8e-b4ed-4337-9793-53d84b5b2aa3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:08.069620 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-38ec2b8e-b4ed-4337-9793-53d84b5b2aa3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:08.070372 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-38ec2b8e-b4ed-4337-9793-53d84b5b2aa3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:08.070802 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-38ec2b8e-b4ed-4337-9793-53d84b5b2aa3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:08.197298 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-38ec2b8e-b4ed-4337-9793-53d84b5b2aa3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:08.205278 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-38ec2b8e-b4ed-4337-9793-53d84b5b2aa3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.146631 May 24 15:40:08.205852 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1115/2247] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:08 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:08.333789 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-fa684cb4-124b-4b24-809a-3034b2a5447a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:08.334311 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-fa684cb4-124b-4b24-809a-3034b2a5447a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:08.340768 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fa684cb4-124b-4b24-809a-3034b2a5447a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:08.341216 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fa684cb4-124b-4b24-809a-3034b2a5447a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:08.341994 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fa684cb4-124b-4b24-809a-3034b2a5447a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:08.342421 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fa684cb4-124b-4b24-809a-3034b2a5447a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:08.467550 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-fa684cb4-124b-4b24-809a-3034b2a5447a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:08.475423 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-fa684cb4-124b-4b24-809a-3034b2a5447a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.146120 May 24 15:40:08.475979 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1133/2248] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:08 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:08.684384 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f3ac05aa-2a8b-4a9a-8f5a-6cff6cec1f91 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:08.684908 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f3ac05aa-2a8b-4a9a-8f5a-6cff6cec1f91 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:08.691982 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f3ac05aa-2a8b-4a9a-8f5a-6cff6cec1f91 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:08.692464 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f3ac05aa-2a8b-4a9a-8f5a-6cff6cec1f91 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:08.693227 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f3ac05aa-2a8b-4a9a-8f5a-6cff6cec1f91 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:08.693663 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f3ac05aa-2a8b-4a9a-8f5a-6cff6cec1f91 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:08.753128 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-f3ac05aa-2a8b-4a9a-8f5a-6cff6cec1f91 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:08.762286 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-f3ac05aa-2a8b-4a9a-8f5a-6cff6cec1f91 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:08.762745 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-f498fa0c-48aa-4527-811c-31e9975006dd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:08.763352 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-f498fa0c-48aa-4527-811c-31e9975006dd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:08.763783 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-f3ac05aa-2a8b-4a9a-8f5a-6cff6cec1f91 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:08.764956 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f3ac05aa-2a8b-4a9a-8f5a-6cff6cec1f91 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084611 May 24 15:40:08.765516 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1116/2249] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:40:08 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:08.769278 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f498fa0c-48aa-4527-811c-31e9975006dd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:08.769759 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f498fa0c-48aa-4527-811c-31e9975006dd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:08.770507 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f498fa0c-48aa-4527-811c-31e9975006dd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:08.770936 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f498fa0c-48aa-4527-811c-31e9975006dd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:08.898362 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-f498fa0c-48aa-4527-811c-31e9975006dd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:08.906371 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-f498fa0c-48aa-4527-811c-31e9975006dd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.147357 May 24 15:40:08.906930 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1134/2250] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:08 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:40:09.222166 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-ad017770-90d8-4052-9849-ae05285b24e6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:09.222778 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-ad017770-90d8-4052-9849-ae05285b24e6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:09.228956 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ad017770-90d8-4052-9849-ae05285b24e6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:09.229349 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ad017770-90d8-4052-9849-ae05285b24e6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:09.230102 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ad017770-90d8-4052-9849-ae05285b24e6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:09.230535 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ad017770-90d8-4052-9849-ae05285b24e6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:09.358534 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-ad017770-90d8-4052-9849-ae05285b24e6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:09.367141 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-ad017770-90d8-4052-9849-ae05285b24e6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.148813 May 24 15:40:09.367706 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1117/2251] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:09 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:09.492944 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-bc7ced52-2247-470a-9c9e-323f991990c7 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:09.493476 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-bc7ced52-2247-470a-9c9e-323f991990c7 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:09.499939 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bc7ced52-2247-470a-9c9e-323f991990c7 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:09.500423 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bc7ced52-2247-470a-9c9e-323f991990c7 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:09.501186 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bc7ced52-2247-470a-9c9e-323f991990c7 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:09.501623 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bc7ced52-2247-470a-9c9e-323f991990c7 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:09.625953 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-bc7ced52-2247-470a-9c9e-323f991990c7 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:09.634421 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-bc7ced52-2247-470a-9c9e-323f991990c7 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.146189 May 24 15:40:09.634984 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1135/2252] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:09 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:09.783081 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-7eacefb6-1222-456e-9831-b706356479a2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:09.783637 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-7eacefb6-1222-456e-9831-b706356479a2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:09.790364 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7eacefb6-1222-456e-9831-b706356479a2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:09.790830 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7eacefb6-1222-456e-9831-b706356479a2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:09.791595 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7eacefb6-1222-456e-9831-b706356479a2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:09.792027 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7eacefb6-1222-456e-9831-b706356479a2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:09.852105 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-7eacefb6-1222-456e-9831-b706356479a2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:09.860402 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-7eacefb6-1222-456e-9831-b706356479a2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:09.861902 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-7eacefb6-1222-456e-9831-b706356479a2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:09.863712 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-7eacefb6-1222-456e-9831-b706356479a2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084181 May 24 15:40:09.864279 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1118/2253] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:40:09 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:09.923182 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-23fb13d3-4d51-441c-b38d-681e3527dbe9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:09.923817 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-23fb13d3-4d51-441c-b38d-681e3527dbe9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:09.930480 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-23fb13d3-4d51-441c-b38d-681e3527dbe9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:09.930920 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-23fb13d3-4d51-441c-b38d-681e3527dbe9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:09.931683 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-23fb13d3-4d51-441c-b38d-681e3527dbe9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:09.932124 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-23fb13d3-4d51-441c-b38d-681e3527dbe9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:10.059618 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-23fb13d3-4d51-441c-b38d-681e3527dbe9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:10.067594 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-23fb13d3-4d51-441c-b38d-681e3527dbe9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.148234 May 24 15:40:10.068172 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1136/2254] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:09 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:10.110214 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 15:40:10.110363 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Tue May 24 15:40:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 15:40:10.383732 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-ca3c9775-8fe4-4410-946f-e42c5ac183d6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:10.384264 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-ca3c9775-8fe4-4410-946f-e42c5ac183d6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:10.390345 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ca3c9775-8fe4-4410-946f-e42c5ac183d6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:10.390784 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ca3c9775-8fe4-4410-946f-e42c5ac183d6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:10.391529 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ca3c9775-8fe4-4410-946f-e42c5ac183d6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:10.391956 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ca3c9775-8fe4-4410-946f-e42c5ac183d6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:10.518327 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-ca3c9775-8fe4-4410-946f-e42c5ac183d6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:10.527191 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-ca3c9775-8fe4-4410-946f-e42c5ac183d6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.147301 May 24 15:40:10.527947 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1119/2255] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:10 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:10.651322 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-4c86ad65-87e0-474f-9a99-90be4db69071 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:10.651867 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-4c86ad65-87e0-474f-9a99-90be4db69071 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:10.657871 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4c86ad65-87e0-474f-9a99-90be4db69071 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:10.658328 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4c86ad65-87e0-474f-9a99-90be4db69071 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:10.659088 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4c86ad65-87e0-474f-9a99-90be4db69071 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:10.659527 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4c86ad65-87e0-474f-9a99-90be4db69071 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:10.783857 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-4c86ad65-87e0-474f-9a99-90be4db69071 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:10.791941 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-4c86ad65-87e0-474f-9a99-90be4db69071 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.144474 May 24 15:40:10.792527 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1137/2256] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:10 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:10.882523 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-2fa8f965-96fd-4a04-845b-80fb5bd5b109 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:10.883158 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-2fa8f965-96fd-4a04-845b-80fb5bd5b109 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:10.889573 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2fa8f965-96fd-4a04-845b-80fb5bd5b109 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:10.890012 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2fa8f965-96fd-4a04-845b-80fb5bd5b109 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:10.890760 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2fa8f965-96fd-4a04-845b-80fb5bd5b109 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:10.891193 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2fa8f965-96fd-4a04-845b-80fb5bd5b109 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:10.954470 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-2fa8f965-96fd-4a04-845b-80fb5bd5b109 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:10.962724 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-2fa8f965-96fd-4a04-845b-80fb5bd5b109 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:10.964207 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-2fa8f965-96fd-4a04-845b-80fb5bd5b109 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:10.965360 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-2fa8f965-96fd-4a04-845b-80fb5bd5b109 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.087364 May 24 15:40:10.965920 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1120/2257] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:40:10 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:11.084371 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-de5b0122-0968-4078-b22d-1ea5c94ce736 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:11.084989 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-de5b0122-0968-4078-b22d-1ea5c94ce736 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:11.091427 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-de5b0122-0968-4078-b22d-1ea5c94ce736 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:11.091873 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-de5b0122-0968-4078-b22d-1ea5c94ce736 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:11.092666 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-de5b0122-0968-4078-b22d-1ea5c94ce736 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:11.093104 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-de5b0122-0968-4078-b22d-1ea5c94ce736 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:11.219909 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-de5b0122-0968-4078-b22d-1ea5c94ce736 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:11.228361 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-de5b0122-0968-4078-b22d-1ea5c94ce736 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.147820 May 24 15:40:11.228921 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1138/2258] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:11 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:11.544273 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-58f931a5-bac3-4dcb-a566-dc16184d9005 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:11.544859 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-58f931a5-bac3-4dcb-a566-dc16184d9005 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:11.551502 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-58f931a5-bac3-4dcb-a566-dc16184d9005 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:11.551942 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-58f931a5-bac3-4dcb-a566-dc16184d9005 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:11.552721 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-58f931a5-bac3-4dcb-a566-dc16184d9005 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:11.553148 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-58f931a5-bac3-4dcb-a566-dc16184d9005 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:11.557083 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:40:11.677611 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-58f931a5-bac3-4dcb-a566-dc16184d9005 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:11.685492 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-58f931a5-bac3-4dcb-a566-dc16184d9005 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.145199 May 24 15:40:11.686060 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1121/2259] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:11 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:11.808865 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-dd782e8f-fe68-4ec3-9cf2-2818c21090aa tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:11.809407 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-dd782e8f-fe68-4ec3-9cf2-2818c21090aa tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:11.815352 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dd782e8f-fe68-4ec3-9cf2-2818c21090aa tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:11.815795 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dd782e8f-fe68-4ec3-9cf2-2818c21090aa tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:11.816572 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dd782e8f-fe68-4ec3-9cf2-2818c21090aa tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:11.817004 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dd782e8f-fe68-4ec3-9cf2-2818c21090aa tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:11.946977 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-dd782e8f-fe68-4ec3-9cf2-2818c21090aa tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:11.954877 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-dd782e8f-fe68-4ec3-9cf2-2818c21090aa tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.149848 May 24 15:40:11.955431 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1139/2260] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:11 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:11.982837 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-27451664-758d-47c6-918f-a414ced7f087 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:11.983444 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-27451664-758d-47c6-918f-a414ced7f087 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:11.989910 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-27451664-758d-47c6-918f-a414ced7f087 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:11.990351 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-27451664-758d-47c6-918f-a414ced7f087 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:11.991347 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-27451664-758d-47c6-918f-a414ced7f087 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:11.991773 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-27451664-758d-47c6-918f-a414ced7f087 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:12.052471 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-27451664-758d-47c6-918f-a414ced7f087 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:12.060740 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-27451664-758d-47c6-918f-a414ced7f087 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:12.062154 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-27451664-758d-47c6-918f-a414ced7f087 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:12.063281 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-27451664-758d-47c6-918f-a414ced7f087 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084335 May 24 15:40:12.063841 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1122/2261] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:40:11 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:12.247391 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-643d4769-e377-465b-bcf0-f0cd33ebcf64 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:12.247996 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-643d4769-e377-465b-bcf0-f0cd33ebcf64 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:12.254535 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-643d4769-e377-465b-bcf0-f0cd33ebcf64 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:12.255467 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-643d4769-e377-465b-bcf0-f0cd33ebcf64 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:12.256211 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-643d4769-e377-465b-bcf0-f0cd33ebcf64 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:12.256664 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-643d4769-e377-465b-bcf0-f0cd33ebcf64 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:12.390388 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-643d4769-e377-465b-bcf0-f0cd33ebcf64 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:12.398510 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-643d4769-e377-465b-bcf0-f0cd33ebcf64 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.155948 May 24 15:40:12.399264 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1140/2262] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:12 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:12.702335 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e83961ef-2e6f-4c27-9fa5-e091b5f42dbc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:12.703005 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-e83961ef-2e6f-4c27-9fa5-e091b5f42dbc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:12.709181 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e83961ef-2e6f-4c27-9fa5-e091b5f42dbc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:12.709702 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e83961ef-2e6f-4c27-9fa5-e091b5f42dbc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:12.710461 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e83961ef-2e6f-4c27-9fa5-e091b5f42dbc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:12.710898 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e83961ef-2e6f-4c27-9fa5-e091b5f42dbc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:12.838316 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-e83961ef-2e6f-4c27-9fa5-e091b5f42dbc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:12.846395 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-e83961ef-2e6f-4c27-9fa5-e091b5f42dbc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.147894 May 24 15:40:12.846896 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1123/2263] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:12 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:12.972180 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-9fdeee84-d93e-47ea-8786-9b72f64b29c4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:12.972825 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-9fdeee84-d93e-47ea-8786-9b72f64b29c4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:12.979341 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9fdeee84-d93e-47ea-8786-9b72f64b29c4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:12.979785 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9fdeee84-d93e-47ea-8786-9b72f64b29c4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:12.980701 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9fdeee84-d93e-47ea-8786-9b72f64b29c4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:12.980998 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9fdeee84-d93e-47ea-8786-9b72f64b29c4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:13.081551 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-0ae91df9-0a58-4419-8716-203820e127cc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:13.082901 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-0ae91df9-0a58-4419-8716-203820e127cc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:13.090366 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0ae91df9-0a58-4419-8716-203820e127cc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:13.090820 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0ae91df9-0a58-4419-8716-203820e127cc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:13.091595 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0ae91df9-0a58-4419-8716-203820e127cc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:13.092038 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0ae91df9-0a58-4419-8716-203820e127cc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:13.113180 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-9fdeee84-d93e-47ea-8786-9b72f64b29c4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:13.121310 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-9fdeee84-d93e-47ea-8786-9b72f64b29c4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.152947 May 24 15:40:13.121869 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1141/2264] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:12 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:13.152766 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-0ae91df9-0a58-4419-8716-203820e127cc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:13.161822 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-0ae91df9-0a58-4419-8716-203820e127cc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:13.163338 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-0ae91df9-0a58-4419-8716-203820e127cc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:13.164533 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-0ae91df9-0a58-4419-8716-203820e127cc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.086852 May 24 15:40:13.165101 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1124/2265] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:40:13 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:40:13.416232 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-32636d2b-b707-45c9-b90e-74b4a648df28 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:13.416825 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-32636d2b-b707-45c9-b90e-74b4a648df28 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:13.423322 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-32636d2b-b707-45c9-b90e-74b4a648df28 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:13.423774 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-32636d2b-b707-45c9-b90e-74b4a648df28 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:13.424568 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-32636d2b-b707-45c9-b90e-74b4a648df28 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:13.425003 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-32636d2b-b707-45c9-b90e-74b4a648df28 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:13.550678 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-32636d2b-b707-45c9-b90e-74b4a648df28 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:13.558539 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-32636d2b-b707-45c9-b90e-74b4a648df28 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.146180 May 24 15:40:13.559098 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1142/2266] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:13 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:13.863569 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-1f77962b-665a-4416-beaa-e57c5867ac97 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:13.864179 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-1f77962b-665a-4416-beaa-e57c5867ac97 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:13.871048 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1f77962b-665a-4416-beaa-e57c5867ac97 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:13.871490 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1f77962b-665a-4416-beaa-e57c5867ac97 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:13.872241 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1f77962b-665a-4416-beaa-e57c5867ac97 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:13.872702 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1f77962b-665a-4416-beaa-e57c5867ac97 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:14.010036 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-1f77962b-665a-4416-beaa-e57c5867ac97 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:14.017874 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-1f77962b-665a-4416-beaa-e57c5867ac97 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.158161 May 24 15:40:14.018431 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1125/2267] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:13 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:14.137847 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-0fd930d6-6ea6-4136-aa26-faf1c0a5033d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:14.138458 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-0fd930d6-6ea6-4136-aa26-faf1c0a5033d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:14.144409 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0fd930d6-6ea6-4136-aa26-faf1c0a5033d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:14.144860 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0fd930d6-6ea6-4136-aa26-faf1c0a5033d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:14.145610 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0fd930d6-6ea6-4136-aa26-faf1c0a5033d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:14.146044 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0fd930d6-6ea6-4136-aa26-faf1c0a5033d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:14.182910 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-fd5bd114-6438-4318-a1d2-c82b6d18b8fe tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:14.183512 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-fd5bd114-6438-4318-a1d2-c82b6d18b8fe tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:14.190022 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fd5bd114-6438-4318-a1d2-c82b6d18b8fe tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:14.190459 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fd5bd114-6438-4318-a1d2-c82b6d18b8fe tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:14.191222 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fd5bd114-6438-4318-a1d2-c82b6d18b8fe tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:14.191647 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fd5bd114-6438-4318-a1d2-c82b6d18b8fe tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:14.255886 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-fd5bd114-6438-4318-a1d2-c82b6d18b8fe tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:14.264349 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-fd5bd114-6438-4318-a1d2-c82b6d18b8fe tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:14.265774 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-fd5bd114-6438-4318-a1d2-c82b6d18b8fe tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:14.266910 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-fd5bd114-6438-4318-a1d2-c82b6d18b8fe tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.087841 May 24 15:40:14.267467 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1126/2268] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:40:14 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:40:14.272384 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-0fd930d6-6ea6-4136-aa26-faf1c0a5033d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:14.280329 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-0fd930d6-6ea6-4136-aa26-faf1c0a5033d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.146281 May 24 15:40:14.280876 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1143/2269] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:14 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:14.575806 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-23715ff8-5614-49a1-b40f-25d37df6c898 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:14.576409 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-23715ff8-5614-49a1-b40f-25d37df6c898 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:14.582441 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-23715ff8-5614-49a1-b40f-25d37df6c898 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:14.582919 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-23715ff8-5614-49a1-b40f-25d37df6c898 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:14.583676 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-23715ff8-5614-49a1-b40f-25d37df6c898 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:14.584112 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-23715ff8-5614-49a1-b40f-25d37df6c898 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:14.709123 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-23715ff8-5614-49a1-b40f-25d37df6c898 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:14.716979 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-23715ff8-5614-49a1-b40f-25d37df6c898 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.145148 May 24 15:40:14.717546 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1127/2270] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:14 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:15.034650 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-24b43c94-51f3-4f75-86fe-fb23968ad5c6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:15.035268 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-24b43c94-51f3-4f75-86fe-fb23968ad5c6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:15.042298 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-24b43c94-51f3-4f75-86fe-fb23968ad5c6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:15.042751 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-24b43c94-51f3-4f75-86fe-fb23968ad5c6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:15.043510 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-24b43c94-51f3-4f75-86fe-fb23968ad5c6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:15.043947 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-24b43c94-51f3-4f75-86fe-fb23968ad5c6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:15.176159 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-24b43c94-51f3-4f75-86fe-fb23968ad5c6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:15.184806 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-24b43c94-51f3-4f75-86fe-fb23968ad5c6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.153977 May 24 15:40:15.185374 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1144/2271] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:15 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:15.284708 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-5aa94ba6-2cc4-4ef4-8949-7dae0d3e4efc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:15.285263 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-5aa94ba6-2cc4-4ef4-8949-7dae0d3e4efc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:15.292386 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5aa94ba6-2cc4-4ef4-8949-7dae0d3e4efc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:15.292838 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5aa94ba6-2cc4-4ef4-8949-7dae0d3e4efc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:15.293597 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5aa94ba6-2cc4-4ef4-8949-7dae0d3e4efc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:15.294029 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5aa94ba6-2cc4-4ef4-8949-7dae0d3e4efc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:15.297011 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-0e51c90b-e7d4-4a97-8c64-82ba037d5f51 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:15.297625 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-0e51c90b-e7d4-4a97-8c64-82ba037d5f51 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:15.303530 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0e51c90b-e7d4-4a97-8c64-82ba037d5f51 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:15.303984 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0e51c90b-e7d4-4a97-8c64-82ba037d5f51 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:15.304801 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0e51c90b-e7d4-4a97-8c64-82ba037d5f51 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:15.305225 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0e51c90b-e7d4-4a97-8c64-82ba037d5f51 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:15.355277 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-5aa94ba6-2cc4-4ef4-8949-7dae0d3e4efc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:15.363818 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-5aa94ba6-2cc4-4ef4-8949-7dae0d3e4efc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:15.365350 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-5aa94ba6-2cc4-4ef4-8949-7dae0d3e4efc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:15.366745 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-5aa94ba6-2cc4-4ef4-8949-7dae0d3e4efc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.086059 May 24 15:40:15.367312 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1128/2272] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:40:15 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:15.432378 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-0e51c90b-e7d4-4a97-8c64-82ba037d5f51 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:15.435726 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:40:15.441103 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-0e51c90b-e7d4-4a97-8c64-82ba037d5f51 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.147978 May 24 15:40:15.441662 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1145/2273] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:15 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:15.733738 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-b2a919d9-189e-4579-a6fe-fb650051b284 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:15.734346 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-b2a919d9-189e-4579-a6fe-fb650051b284 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:15.740468 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b2a919d9-189e-4579-a6fe-fb650051b284 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:15.741168 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b2a919d9-189e-4579-a6fe-fb650051b284 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:15.741934 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b2a919d9-189e-4579-a6fe-fb650051b284 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:15.742366 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b2a919d9-189e-4579-a6fe-fb650051b284 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:15.869395 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-b2a919d9-189e-4579-a6fe-fb650051b284 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:15.877261 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-b2a919d9-189e-4579-a6fe-fb650051b284 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.147450 May 24 15:40:15.877829 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1129/2274] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:15 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:16.194680 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 15:40:16.194837 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Tue May 24 15:40:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 15:40:16.201757 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-8e33f7e6-58d4-4608-b33c-f4fdae83344f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:16.202363 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-8e33f7e6-58d4-4608-b33c-f4fdae83344f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:16.208966 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8e33f7e6-58d4-4608-b33c-f4fdae83344f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:16.209410 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8e33f7e6-58d4-4608-b33c-f4fdae83344f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:16.210171 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8e33f7e6-58d4-4608-b33c-f4fdae83344f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:16.210601 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8e33f7e6-58d4-4608-b33c-f4fdae83344f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:16.338269 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-8e33f7e6-58d4-4608-b33c-f4fdae83344f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:16.346187 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-8e33f7e6-58d4-4608-b33c-f4fdae83344f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.148622 May 24 15:40:16.346743 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1146/2275] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:16 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:16.458081 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-7ff367b5-f3b0-4ffe-b865-5a82fa9da7a1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:16.458615 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-7ff367b5-f3b0-4ffe-b865-5a82fa9da7a1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:16.464620 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7ff367b5-f3b0-4ffe-b865-5a82fa9da7a1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:16.465065 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7ff367b5-f3b0-4ffe-b865-5a82fa9da7a1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:16.465819 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7ff367b5-f3b0-4ffe-b865-5a82fa9da7a1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:16.466251 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7ff367b5-f3b0-4ffe-b865-5a82fa9da7a1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:16.502296 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-aa02f603-99b9-41a1-aaa1-52573da62456 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:16.502943 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-aa02f603-99b9-41a1-aaa1-52573da62456 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:16.509310 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-aa02f603-99b9-41a1-aaa1-52573da62456 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:16.509760 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-aa02f603-99b9-41a1-aaa1-52573da62456 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:16.510533 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-aa02f603-99b9-41a1-aaa1-52573da62456 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:16.510968 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-aa02f603-99b9-41a1-aaa1-52573da62456 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:16.574036 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-aa02f603-99b9-41a1-aaa1-52573da62456 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:16.582447 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-aa02f603-99b9-41a1-aaa1-52573da62456 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:16.583949 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-aa02f603-99b9-41a1-aaa1-52573da62456 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:16.585145 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-aa02f603-99b9-41a1-aaa1-52573da62456 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.203925 May 24 15:40:16.585703 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1130/2276] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:40:16 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:16.600515 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-7ff367b5-f3b0-4ffe-b865-5a82fa9da7a1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:16.608438 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-7ff367b5-f3b0-4ffe-b865-5a82fa9da7a1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.154272 May 24 15:40:16.609032 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1147/2277] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:16 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:40:16.894601 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-7afce1d6-a68d-4996-bc29-80cb306b8b0e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:16.895207 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-7afce1d6-a68d-4996-bc29-80cb306b8b0e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:16.901944 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7afce1d6-a68d-4996-bc29-80cb306b8b0e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:16.902441 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7afce1d6-a68d-4996-bc29-80cb306b8b0e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:16.903161 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7afce1d6-a68d-4996-bc29-80cb306b8b0e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:16.903765 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7afce1d6-a68d-4996-bc29-80cb306b8b0e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:17.029860 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-7afce1d6-a68d-4996-bc29-80cb306b8b0e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:17.038536 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-7afce1d6-a68d-4996-bc29-80cb306b8b0e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.147727 May 24 15:40:17.039098 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1131/2278] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:16 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:17.362856 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-adcf8ae3-d5a6-48bb-8103-43838e16c6d0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:17.363467 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-adcf8ae3-d5a6-48bb-8103-43838e16c6d0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:17.370224 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-adcf8ae3-d5a6-48bb-8103-43838e16c6d0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:17.370672 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-adcf8ae3-d5a6-48bb-8103-43838e16c6d0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:17.371425 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-adcf8ae3-d5a6-48bb-8103-43838e16c6d0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:17.371856 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-adcf8ae3-d5a6-48bb-8103-43838e16c6d0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:17.498366 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-adcf8ae3-d5a6-48bb-8103-43838e16c6d0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:17.508535 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-adcf8ae3-d5a6-48bb-8103-43838e16c6d0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.149466 May 24 15:40:17.509103 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1148/2279] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:17 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:17.602705 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-fb12b0a3-1b05-49bc-bbfa-8b5b521d922a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:17.603319 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-fb12b0a3-1b05-49bc-bbfa-8b5b521d922a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:17.609878 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fb12b0a3-1b05-49bc-bbfa-8b5b521d922a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:17.610329 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fb12b0a3-1b05-49bc-bbfa-8b5b521d922a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:17.611089 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fb12b0a3-1b05-49bc-bbfa-8b5b521d922a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:17.611525 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fb12b0a3-1b05-49bc-bbfa-8b5b521d922a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:17.626096 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-8e36a85b-6fe3-4516-8f01-305f032ddb31 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:17.626633 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-8e36a85b-6fe3-4516-8f01-305f032ddb31 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:17.633890 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8e36a85b-6fe3-4516-8f01-305f032ddb31 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:17.634339 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8e36a85b-6fe3-4516-8f01-305f032ddb31 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:17.635259 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8e36a85b-6fe3-4516-8f01-305f032ddb31 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:17.635696 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8e36a85b-6fe3-4516-8f01-305f032ddb31 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:17.675927 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-fb12b0a3-1b05-49bc-bbfa-8b5b521d922a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:17.685056 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-fb12b0a3-1b05-49bc-bbfa-8b5b521d922a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:17.686582 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-fb12b0a3-1b05-49bc-bbfa-8b5b521d922a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:17.687729 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-fb12b0a3-1b05-49bc-bbfa-8b5b521d922a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.088988 May 24 15:40:17.688321 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1132/2280] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:40:17 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:17.761869 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-8e36a85b-6fe3-4516-8f01-305f032ddb31 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:17.769806 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-8e36a85b-6fe3-4516-8f01-305f032ddb31 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.147539 May 24 15:40:17.770371 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1149/2281] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:17 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:40:18.055148 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-1c1313c0-50b5-4ac6-9540-82b15cd8f137 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:18.055763 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-1c1313c0-50b5-4ac6-9540-82b15cd8f137 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:18.061835 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1c1313c0-50b5-4ac6-9540-82b15cd8f137 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:18.062279 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1c1313c0-50b5-4ac6-9540-82b15cd8f137 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:18.063037 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1c1313c0-50b5-4ac6-9540-82b15cd8f137 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:18.063470 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1c1313c0-50b5-4ac6-9540-82b15cd8f137 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:18.187518 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-1c1313c0-50b5-4ac6-9540-82b15cd8f137 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:18.195411 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-1c1313c0-50b5-4ac6-9540-82b15cd8f137 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.144677 May 24 15:40:18.195978 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1133/2282] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:18 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:18.525814 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-8c0ca5ae-fc3e-4b45-b4b5-54525cb3ce57 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:18.526423 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-8c0ca5ae-fc3e-4b45-b4b5-54525cb3ce57 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:18.532926 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8c0ca5ae-fc3e-4b45-b4b5-54525cb3ce57 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:18.533367 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8c0ca5ae-fc3e-4b45-b4b5-54525cb3ce57 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:18.534110 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8c0ca5ae-fc3e-4b45-b4b5-54525cb3ce57 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:18.534538 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8c0ca5ae-fc3e-4b45-b4b5-54525cb3ce57 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:18.658856 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-8c0ca5ae-fc3e-4b45-b4b5-54525cb3ce57 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:18.668872 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-8c0ca5ae-fc3e-4b45-b4b5-54525cb3ce57 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.147147 May 24 15:40:18.669563 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1150/2283] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:18 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:40:18.706081 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-fb9d013a-3d0e-4e74-8f10-4617f5d7811d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:18.706723 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-fb9d013a-3d0e-4e74-8f10-4617f5d7811d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:18.713999 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fb9d013a-3d0e-4e74-8f10-4617f5d7811d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:18.714453 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fb9d013a-3d0e-4e74-8f10-4617f5d7811d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:18.715213 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fb9d013a-3d0e-4e74-8f10-4617f5d7811d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:18.715682 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fb9d013a-3d0e-4e74-8f10-4617f5d7811d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:18.775752 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-fb9d013a-3d0e-4e74-8f10-4617f5d7811d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:18.784197 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-fb9d013a-3d0e-4e74-8f10-4617f5d7811d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:18.785725 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-fb9d013a-3d0e-4e74-8f10-4617f5d7811d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:18.785972 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-7784a629-ebce-45d0-855f-e10a2328400f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:18.786579 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-7784a629-ebce-45d0-855f-e10a2328400f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:18.786901 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-fb9d013a-3d0e-4e74-8f10-4617f5d7811d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084700 May 24 15:40:18.787461 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1134/2284] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:40:18 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:18.792648 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7784a629-ebce-45d0-855f-e10a2328400f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:18.793095 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7784a629-ebce-45d0-855f-e10a2328400f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:18.793844 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7784a629-ebce-45d0-855f-e10a2328400f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:18.794274 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7784a629-ebce-45d0-855f-e10a2328400f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:18.922523 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-7784a629-ebce-45d0-855f-e10a2328400f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:18.930350 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-7784a629-ebce-45d0-855f-e10a2328400f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.148117 May 24 15:40:18.930922 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1151/2285] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:18 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:40:19.212343 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-0bb046d6-0d9b-4204-9641-847f7dfe4ae3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:19.212934 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-0bb046d6-0d9b-4204-9641-847f7dfe4ae3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:19.218959 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0bb046d6-0d9b-4204-9641-847f7dfe4ae3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:19.219402 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0bb046d6-0d9b-4204-9641-847f7dfe4ae3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:19.220155 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0bb046d6-0d9b-4204-9641-847f7dfe4ae3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:19.220617 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0bb046d6-0d9b-4204-9641-847f7dfe4ae3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:19.348892 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-0bb046d6-0d9b-4204-9641-847f7dfe4ae3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:19.357282 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-0bb046d6-0d9b-4204-9641-847f7dfe4ae3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.148973 May 24 15:40:19.357837 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1135/2286] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:19 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:19.686313 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-a9bc84b7-2516-4fd8-af51-a03dd224ce0c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:19.686936 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-a9bc84b7-2516-4fd8-af51-a03dd224ce0c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:19.693519 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a9bc84b7-2516-4fd8-af51-a03dd224ce0c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:19.693971 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a9bc84b7-2516-4fd8-af51-a03dd224ce0c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:19.694730 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a9bc84b7-2516-4fd8-af51-a03dd224ce0c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:19.695168 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a9bc84b7-2516-4fd8-af51-a03dd224ce0c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:19.804579 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-dd48f9ce-c96f-4205-95cd-99ac13c11461 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:19.805303 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-dd48f9ce-c96f-4205-95cd-99ac13c11461 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:19.811740 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dd48f9ce-c96f-4205-95cd-99ac13c11461 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:19.812249 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dd48f9ce-c96f-4205-95cd-99ac13c11461 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:19.813095 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dd48f9ce-c96f-4205-95cd-99ac13c11461 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:19.813533 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dd48f9ce-c96f-4205-95cd-99ac13c11461 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:19.820625 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-a9bc84b7-2516-4fd8-af51-a03dd224ce0c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:19.828658 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-a9bc84b7-2516-4fd8-af51-a03dd224ce0c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.146082 May 24 15:40:19.829223 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1152/2287] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:19 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:19.874716 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-dd48f9ce-c96f-4205-95cd-99ac13c11461 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:19.883117 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-dd48f9ce-c96f-4205-95cd-99ac13c11461 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:19.884638 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-dd48f9ce-c96f-4205-95cd-99ac13c11461 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:19.885779 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-dd48f9ce-c96f-4205-95cd-99ac13c11461 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.085135 May 24 15:40:19.886344 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1136/2288] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:40:19 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:40:19.946696 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e24b295b-fdd1-4f9a-a29f-3d0e153fe21b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:19.947224 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e24b295b-fdd1-4f9a-a29f-3d0e153fe21b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:19.953514 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e24b295b-fdd1-4f9a-a29f-3d0e153fe21b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:19.953967 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e24b295b-fdd1-4f9a-a29f-3d0e153fe21b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:19.954727 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e24b295b-fdd1-4f9a-a29f-3d0e153fe21b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:19.955162 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e24b295b-fdd1-4f9a-a29f-3d0e153fe21b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:20.082572 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e24b295b-fdd1-4f9a-a29f-3d0e153fe21b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:20.090995 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e24b295b-fdd1-4f9a-a29f-3d0e153fe21b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.148182 May 24 15:40:20.091748 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1153/2289] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:19 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:20.374951 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-0906c39d-c078-42c1-a494-6051c59cabbb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:20.375563 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-0906c39d-c078-42c1-a494-6051c59cabbb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:20.382094 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0906c39d-c078-42c1-a494-6051c59cabbb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:20.382532 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0906c39d-c078-42c1-a494-6051c59cabbb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:20.383278 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0906c39d-c078-42c1-a494-6051c59cabbb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:20.383707 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0906c39d-c078-42c1-a494-6051c59cabbb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:20.509188 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-0906c39d-c078-42c1-a494-6051c59cabbb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:20.512644 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:40:20.517882 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-0906c39d-c078-42c1-a494-6051c59cabbb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.146702 May 24 15:40:20.524657 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1137/2290] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:20 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:20.845945 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-46c60575-0d9a-45b8-ade2-a50e4c1de4e7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:20.846556 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-46c60575-0d9a-45b8-ade2-a50e4c1de4e7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:20.853471 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-46c60575-0d9a-45b8-ade2-a50e4c1de4e7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:20.853916 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-46c60575-0d9a-45b8-ade2-a50e4c1de4e7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:20.854660 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-46c60575-0d9a-45b8-ade2-a50e4c1de4e7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:20.855092 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-46c60575-0d9a-45b8-ade2-a50e4c1de4e7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:20.902867 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-6abb3094-0882-4d06-b616-08aeac3395ad tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:20.903575 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-6abb3094-0882-4d06-b616-08aeac3395ad tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:20.910257 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6abb3094-0882-4d06-b616-08aeac3395ad tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:20.910796 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6abb3094-0882-4d06-b616-08aeac3395ad tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:20.911631 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6abb3094-0882-4d06-b616-08aeac3395ad tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:20.912068 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6abb3094-0882-4d06-b616-08aeac3395ad tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:20.991510 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-46c60575-0d9a-45b8-ade2-a50e4c1de4e7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:20.995978 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-6abb3094-0882-4d06-b616-08aeac3395ad tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:20.999561 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-46c60575-0d9a-45b8-ade2-a50e4c1de4e7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.157435 May 24 15:40:21.000130 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1154/2291] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:20 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:21.004448 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-6abb3094-0882-4d06-b616-08aeac3395ad tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:21.005948 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-6abb3094-0882-4d06-b616-08aeac3395ad tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:21.007200 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-6abb3094-0882-4d06-b616-08aeac3395ad tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.108237 May 24 15:40:21.007747 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1138/2292] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:40:20 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:40:21.108979 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-41e210f4-6b7c-4097-9d66-7b5384b97677 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:21.109742 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-41e210f4-6b7c-4097-9d66-7b5384b97677 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:21.116662 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-41e210f4-6b7c-4097-9d66-7b5384b97677 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:21.117108 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-41e210f4-6b7c-4097-9d66-7b5384b97677 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:21.117865 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-41e210f4-6b7c-4097-9d66-7b5384b97677 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:21.118300 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-41e210f4-6b7c-4097-9d66-7b5384b97677 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:21.241786 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-41e210f4-6b7c-4097-9d66-7b5384b97677 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:21.249667 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-41e210f4-6b7c-4097-9d66-7b5384b97677 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.144949 May 24 15:40:21.250235 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1155/2293] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:21 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:21.534359 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-3ea47f57-3b94-45e9-8c6f-1a391dd3c5c2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:21.534963 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-3ea47f57-3b94-45e9-8c6f-1a391dd3c5c2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:21.541603 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3ea47f57-3b94-45e9-8c6f-1a391dd3c5c2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:21.542049 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3ea47f57-3b94-45e9-8c6f-1a391dd3c5c2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:21.542796 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3ea47f57-3b94-45e9-8c6f-1a391dd3c5c2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:21.543225 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3ea47f57-3b94-45e9-8c6f-1a391dd3c5c2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:21.669696 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-3ea47f57-3b94-45e9-8c6f-1a391dd3c5c2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:21.677603 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-3ea47f57-3b94-45e9-8c6f-1a391dd3c5c2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.147067 May 24 15:40:21.678171 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1139/2294] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:21 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:21.830275 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 15:40:21.830441 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Tue May 24 15:40:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 15:40:22.016756 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-a9a2a11b-6e44-4d03-ad83-ce80e8a15d98 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:22.017430 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-a9a2a11b-6e44-4d03-ad83-ce80e8a15d98 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:22.024254 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a9a2a11b-6e44-4d03-ad83-ce80e8a15d98 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:22.024743 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a9a2a11b-6e44-4d03-ad83-ce80e8a15d98 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:22.025104 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-ee6c8f0a-b8c5-4f1e-b155-e803a7581900 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:22.025526 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a9a2a11b-6e44-4d03-ad83-ce80e8a15d98 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:22.025740 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-ee6c8f0a-b8c5-4f1e-b155-e803a7581900 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:22.025932 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a9a2a11b-6e44-4d03-ad83-ce80e8a15d98 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:22.032246 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ee6c8f0a-b8c5-4f1e-b155-e803a7581900 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:22.032723 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ee6c8f0a-b8c5-4f1e-b155-e803a7581900 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:22.033483 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ee6c8f0a-b8c5-4f1e-b155-e803a7581900 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:22.033915 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ee6c8f0a-b8c5-4f1e-b155-e803a7581900 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:22.100399 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-ee6c8f0a-b8c5-4f1e-b155-e803a7581900 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:22.109069 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-ee6c8f0a-b8c5-4f1e-b155-e803a7581900 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:22.110583 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-ee6c8f0a-b8c5-4f1e-b155-e803a7581900 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:22.111733 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-ee6c8f0a-b8c5-4f1e-b155-e803a7581900 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.091024 May 24 15:40:22.112291 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1140/2295] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:40:22 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:40:22.160381 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-a9a2a11b-6e44-4d03-ad83-ce80e8a15d98 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:22.168386 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-a9a2a11b-6e44-4d03-ad83-ce80e8a15d98 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.155457 May 24 15:40:22.168937 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1156/2296] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:22 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:22.266453 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-867f2305-0eb4-4d1d-a0da-18cbb2e680e2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:22.267063 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-867f2305-0eb4-4d1d-a0da-18cbb2e680e2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:22.273122 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-867f2305-0eb4-4d1d-a0da-18cbb2e680e2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:22.273574 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-867f2305-0eb4-4d1d-a0da-18cbb2e680e2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:22.274323 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-867f2305-0eb4-4d1d-a0da-18cbb2e680e2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:22.274756 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-867f2305-0eb4-4d1d-a0da-18cbb2e680e2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:22.413558 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-867f2305-0eb4-4d1d-a0da-18cbb2e680e2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:22.421560 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-867f2305-0eb4-4d1d-a0da-18cbb2e680e2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.158932 May 24 15:40:22.422139 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1141/2297] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:22 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:22.694280 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e5289201-c2c2-436a-92b8-99525aad37ea tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:22.694817 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e5289201-c2c2-436a-92b8-99525aad37ea tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:22.700806 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e5289201-c2c2-436a-92b8-99525aad37ea tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:22.701257 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e5289201-c2c2-436a-92b8-99525aad37ea tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:22.702279 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e5289201-c2c2-436a-92b8-99525aad37ea tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:22.702724 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e5289201-c2c2-436a-92b8-99525aad37ea tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:22.902246 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e5289201-c2c2-436a-92b8-99525aad37ea tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:22.910298 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e5289201-c2c2-436a-92b8-99525aad37ea tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.220152 May 24 15:40:22.910859 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1157/2298] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:22 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:23.130434 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-bc4ee98a-483d-49b5-86cd-d3a79650ea95 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:23.131037 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-bc4ee98a-483d-49b5-86cd-d3a79650ea95 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:23.138089 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bc4ee98a-483d-49b5-86cd-d3a79650ea95 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:23.138528 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bc4ee98a-483d-49b5-86cd-d3a79650ea95 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:23.139276 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bc4ee98a-483d-49b5-86cd-d3a79650ea95 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:23.139703 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bc4ee98a-483d-49b5-86cd-d3a79650ea95 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:23.185953 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-383a1d01-1652-4852-ab98-849dd26e9e95 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:23.186596 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-383a1d01-1652-4852-ab98-849dd26e9e95 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:23.193186 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-383a1d01-1652-4852-ab98-849dd26e9e95 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:23.194122 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-383a1d01-1652-4852-ab98-849dd26e9e95 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:23.194885 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-383a1d01-1652-4852-ab98-849dd26e9e95 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:23.195318 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-383a1d01-1652-4852-ab98-849dd26e9e95 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:23.201175 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-bc4ee98a-483d-49b5-86cd-d3a79650ea95 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:23.210498 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-bc4ee98a-483d-49b5-86cd-d3a79650ea95 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:23.211996 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-bc4ee98a-483d-49b5-86cd-d3a79650ea95 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:23.213574 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-bc4ee98a-483d-49b5-86cd-d3a79650ea95 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.086688 May 24 15:40:23.216351 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1142/2299] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:40:23 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:23.367450 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-383a1d01-1652-4852-ab98-849dd26e9e95 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:23.375289 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-383a1d01-1652-4852-ab98-849dd26e9e95 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.193507 May 24 15:40:23.375844 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1158/2300] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:23 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:40:23.438812 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-34fac4cc-af7e-4cfc-83ea-4166254d451a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:23.439422 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-34fac4cc-af7e-4cfc-83ea-4166254d451a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:23.445947 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-34fac4cc-af7e-4cfc-83ea-4166254d451a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:23.446391 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-34fac4cc-af7e-4cfc-83ea-4166254d451a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:23.447146 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-34fac4cc-af7e-4cfc-83ea-4166254d451a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:23.447578 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-34fac4cc-af7e-4cfc-83ea-4166254d451a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:23.571511 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-34fac4cc-af7e-4cfc-83ea-4166254d451a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:23.579521 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-34fac4cc-af7e-4cfc-83ea-4166254d451a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.144476 May 24 15:40:23.580116 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1143/2301] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:23 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:23.927883 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-77f4875f-a157-4418-bad9-3b3d3a93a4bf tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:23.928999 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-77f4875f-a157-4418-bad9-3b3d3a93a4bf tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:23.935624 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-77f4875f-a157-4418-bad9-3b3d3a93a4bf tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:23.936444 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-77f4875f-a157-4418-bad9-3b3d3a93a4bf tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:23.937796 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-77f4875f-a157-4418-bad9-3b3d3a93a4bf tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:23.938595 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-77f4875f-a157-4418-bad9-3b3d3a93a4bf tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:24.065933 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-77f4875f-a157-4418-bad9-3b3d3a93a4bf tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:24.073964 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-77f4875f-a157-4418-bad9-3b3d3a93a4bf tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.150030 May 24 15:40:24.074522 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1159/2302] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:23 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:24.231669 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-c7abd2f9-ba64-4c20-8ffb-d7ebc0a06778 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:24.232275 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-c7abd2f9-ba64-4c20-8ffb-d7ebc0a06778 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:24.238774 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c7abd2f9-ba64-4c20-8ffb-d7ebc0a06778 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:24.239217 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c7abd2f9-ba64-4c20-8ffb-d7ebc0a06778 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:24.239967 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c7abd2f9-ba64-4c20-8ffb-d7ebc0a06778 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:24.240428 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c7abd2f9-ba64-4c20-8ffb-d7ebc0a06778 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:24.303858 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-c7abd2f9-ba64-4c20-8ffb-d7ebc0a06778 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:24.312202 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-c7abd2f9-ba64-4c20-8ffb-d7ebc0a06778 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:24.313720 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-c7abd2f9-ba64-4c20-8ffb-d7ebc0a06778 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:24.314849 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-c7abd2f9-ba64-4c20-8ffb-d7ebc0a06778 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.087054 May 24 15:40:24.315397 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1144/2303] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:40:24 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:24.392474 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-92c1f94e-1083-41e2-91a8-312755e4092a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:24.393084 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-92c1f94e-1083-41e2-91a8-312755e4092a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:24.399975 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-92c1f94e-1083-41e2-91a8-312755e4092a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:24.400451 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-92c1f94e-1083-41e2-91a8-312755e4092a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:24.401205 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-92c1f94e-1083-41e2-91a8-312755e4092a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:24.401639 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-92c1f94e-1083-41e2-91a8-312755e4092a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:24.527912 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-92c1f94e-1083-41e2-91a8-312755e4092a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:24.535852 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-92c1f94e-1083-41e2-91a8-312755e4092a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.147333 May 24 15:40:24.536462 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1160/2304] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:24 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:24.596553 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-938f9072-b66a-4629-ba6c-86849d153b26 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:24.597164 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-938f9072-b66a-4629-ba6c-86849d153b26 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:24.603706 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-938f9072-b66a-4629-ba6c-86849d153b26 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:24.604153 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-938f9072-b66a-4629-ba6c-86849d153b26 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:24.604938 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-938f9072-b66a-4629-ba6c-86849d153b26 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:24.605364 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-938f9072-b66a-4629-ba6c-86849d153b26 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:24.729350 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-938f9072-b66a-4629-ba6c-86849d153b26 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:24.737250 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-938f9072-b66a-4629-ba6c-86849d153b26 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.144521 May 24 15:40:24.737815 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1145/2305] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:24 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:25.090648 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-ee525d25-4f6c-42b0-892f-411c1167ae2d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:25.091260 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-ee525d25-4f6c-42b0-892f-411c1167ae2d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:25.097335 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ee525d25-4f6c-42b0-892f-411c1167ae2d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:25.097781 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ee525d25-4f6c-42b0-892f-411c1167ae2d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:25.098535 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ee525d25-4f6c-42b0-892f-411c1167ae2d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:25.098966 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ee525d25-4f6c-42b0-892f-411c1167ae2d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:25.224032 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ee525d25-4f6c-42b0-892f-411c1167ae2d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:25.231937 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-ee525d25-4f6c-42b0-892f-411c1167ae2d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.145133 May 24 15:40:25.232529 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1161/2306] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:25 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:25.332199 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-21d3771c-1ab5-4b00-9e1f-94cf89479dd0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:25.332764 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-21d3771c-1ab5-4b00-9e1f-94cf89479dd0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:25.339275 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-21d3771c-1ab5-4b00-9e1f-94cf89479dd0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:25.339719 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-21d3771c-1ab5-4b00-9e1f-94cf89479dd0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:25.340495 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-21d3771c-1ab5-4b00-9e1f-94cf89479dd0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:25.340926 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-21d3771c-1ab5-4b00-9e1f-94cf89479dd0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:25.401801 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-21d3771c-1ab5-4b00-9e1f-94cf89479dd0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:25.410009 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-21d3771c-1ab5-4b00-9e1f-94cf89479dd0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:25.411495 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-21d3771c-1ab5-4b00-9e1f-94cf89479dd0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:25.413148 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-21d3771c-1ab5-4b00-9e1f-94cf89479dd0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084348 May 24 15:40:25.413702 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1146/2307] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:40:25 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:25.553812 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-2e9f0383-36a0-4b8a-b472-fe6685a69c98 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:25.554415 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-2e9f0383-36a0-4b8a-b472-fe6685a69c98 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:25.560900 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2e9f0383-36a0-4b8a-b472-fe6685a69c98 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:25.561350 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2e9f0383-36a0-4b8a-b472-fe6685a69c98 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:25.562102 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2e9f0383-36a0-4b8a-b472-fe6685a69c98 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:25.562535 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2e9f0383-36a0-4b8a-b472-fe6685a69c98 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:25.580828 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:40:25.688996 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-2e9f0383-36a0-4b8a-b472-fe6685a69c98 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:25.696942 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-2e9f0383-36a0-4b8a-b472-fe6685a69c98 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.147607 May 24 15:40:25.697504 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1162/2308] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:25 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:25.754326 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-ee7fdfb6-b388-46c4-a767-418ad4f2a51e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:25.754965 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-ee7fdfb6-b388-46c4-a767-418ad4f2a51e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:25.760854 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ee7fdfb6-b388-46c4-a767-418ad4f2a51e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:25.761297 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ee7fdfb6-b388-46c4-a767-418ad4f2a51e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:25.762042 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ee7fdfb6-b388-46c4-a767-418ad4f2a51e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:25.762469 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ee7fdfb6-b388-46c4-a767-418ad4f2a51e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:25.888520 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-ee7fdfb6-b388-46c4-a767-418ad4f2a51e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:25.896593 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-ee7fdfb6-b388-46c4-a767-418ad4f2a51e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.146019 May 24 15:40:25.897594 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1147/2309] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:25 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:26.249336 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-24b64ba7-aebc-467b-9b07-30166c709479 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:26.249969 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-24b64ba7-aebc-467b-9b07-30166c709479 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:26.256457 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-24b64ba7-aebc-467b-9b07-30166c709479 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:26.256913 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-24b64ba7-aebc-467b-9b07-30166c709479 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:26.257655 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-24b64ba7-aebc-467b-9b07-30166c709479 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:26.258084 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-24b64ba7-aebc-467b-9b07-30166c709479 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:26.385399 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-24b64ba7-aebc-467b-9b07-30166c709479 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:26.393340 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-24b64ba7-aebc-467b-9b07-30166c709479 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.147802 May 24 15:40:26.393897 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1163/2310] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:26 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:26.430773 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-4eff37c9-f6ad-4a8c-b2d9-b4a6035a08f9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:26.431382 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-4eff37c9-f6ad-4a8c-b2d9-b4a6035a08f9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:26.437927 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4eff37c9-f6ad-4a8c-b2d9-b4a6035a08f9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:26.438371 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4eff37c9-f6ad-4a8c-b2d9-b4a6035a08f9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:26.439125 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4eff37c9-f6ad-4a8c-b2d9-b4a6035a08f9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:26.439559 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4eff37c9-f6ad-4a8c-b2d9-b4a6035a08f9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:26.500233 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-4eff37c9-f6ad-4a8c-b2d9-b4a6035a08f9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:26.509271 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-4eff37c9-f6ad-4a8c-b2d9-b4a6035a08f9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:26.510760 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-4eff37c9-f6ad-4a8c-b2d9-b4a6035a08f9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:26.511901 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-4eff37c9-f6ad-4a8c-b2d9-b4a6035a08f9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084996 May 24 15:40:26.512479 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1148/2311] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:40:26 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:26.713500 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-7b880a4c-1ce5-41e6-83ab-f518e339d253 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:26.714110 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-7b880a4c-1ce5-41e6-83ab-f518e339d253 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:26.720539 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7b880a4c-1ce5-41e6-83ab-f518e339d253 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:26.721005 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7b880a4c-1ce5-41e6-83ab-f518e339d253 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:26.721748 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7b880a4c-1ce5-41e6-83ab-f518e339d253 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:26.722175 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7b880a4c-1ce5-41e6-83ab-f518e339d253 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:26.845326 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-7b880a4c-1ce5-41e6-83ab-f518e339d253 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:26.853741 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-7b880a4c-1ce5-41e6-83ab-f518e339d253 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.144007 May 24 15:40:26.854300 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1164/2312] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:26 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:26.913724 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-0808e7bf-4f64-448b-856b-8913441a43f9 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:26.914333 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-0808e7bf-4f64-448b-856b-8913441a43f9 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:26.920440 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0808e7bf-4f64-448b-856b-8913441a43f9 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:26.920887 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0808e7bf-4f64-448b-856b-8913441a43f9 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:26.921640 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0808e7bf-4f64-448b-856b-8913441a43f9 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:26.922070 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0808e7bf-4f64-448b-856b-8913441a43f9 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:27.049069 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-0808e7bf-4f64-448b-856b-8913441a43f9 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:27.057578 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-0808e7bf-4f64-448b-856b-8913441a43f9 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.148252 May 24 15:40:27.058142 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1149/2313] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:26 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:27.410852 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-17961184-fdfb-4b68-86e5-3e10e87cc62b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:27.411402 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-17961184-fdfb-4b68-86e5-3e10e87cc62b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:27.418067 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-17961184-fdfb-4b68-86e5-3e10e87cc62b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:27.418509 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-17961184-fdfb-4b68-86e5-3e10e87cc62b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:27.419251 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-17961184-fdfb-4b68-86e5-3e10e87cc62b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:27.419679 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-17961184-fdfb-4b68-86e5-3e10e87cc62b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:27.528929 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-acd77103-00b2-4d8c-a50a-38b9230c502b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:27.529522 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-acd77103-00b2-4d8c-a50a-38b9230c502b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:27.535914 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-acd77103-00b2-4d8c-a50a-38b9230c502b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:27.536386 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-acd77103-00b2-4d8c-a50a-38b9230c502b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:27.537167 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-acd77103-00b2-4d8c-a50a-38b9230c502b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:27.538262 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-acd77103-00b2-4d8c-a50a-38b9230c502b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:27.547612 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-17961184-fdfb-4b68-86e5-3e10e87cc62b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:27.556065 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-17961184-fdfb-4b68-86e5-3e10e87cc62b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.149075 May 24 15:40:27.556649 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1165/2314] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:27 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:27.602662 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-acd77103-00b2-4d8c-a50a-38b9230c502b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:27.611203 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-acd77103-00b2-4d8c-a50a-38b9230c502b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:27.612755 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-acd77103-00b2-4d8c-a50a-38b9230c502b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:27.613897 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-acd77103-00b2-4d8c-a50a-38b9230c502b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.088833 May 24 15:40:27.614456 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1150/2315] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:40:27 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:40:27.870928 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-aa29e1c1-ca9a-4772-a9ee-fb8672b021cb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:27.871535 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-aa29e1c1-ca9a-4772-a9ee-fb8672b021cb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:27.878418 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-aa29e1c1-ca9a-4772-a9ee-fb8672b021cb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:27.878865 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-aa29e1c1-ca9a-4772-a9ee-fb8672b021cb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:27.879608 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-aa29e1c1-ca9a-4772-a9ee-fb8672b021cb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:27.880036 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-aa29e1c1-ca9a-4772-a9ee-fb8672b021cb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:28.011204 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-aa29e1c1-ca9a-4772-a9ee-fb8672b021cb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:28.019380 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-aa29e1c1-ca9a-4772-a9ee-fb8672b021cb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.152221 May 24 15:40:28.019941 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1166/2316] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:27 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:28.075527 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-0dc393b0-7b05-47de-b7c9-61ba49da4e79 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:28.076136 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-0dc393b0-7b05-47de-b7c9-61ba49da4e79 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:28.082277 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0dc393b0-7b05-47de-b7c9-61ba49da4e79 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:28.082719 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0dc393b0-7b05-47de-b7c9-61ba49da4e79 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:28.083469 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0dc393b0-7b05-47de-b7c9-61ba49da4e79 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:28.083894 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0dc393b0-7b05-47de-b7c9-61ba49da4e79 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:28.207895 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-0dc393b0-7b05-47de-b7c9-61ba49da4e79 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:28.215939 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-0dc393b0-7b05-47de-b7c9-61ba49da4e79 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.144511 May 24 15:40:28.216545 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1151/2317] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:28 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:28.572945 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-295b0829-90a4-49d3-a23d-d1c734e5769e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:28.573566 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-295b0829-90a4-49d3-a23d-d1c734e5769e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:28.579543 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-295b0829-90a4-49d3-a23d-d1c734e5769e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:28.579992 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-295b0829-90a4-49d3-a23d-d1c734e5769e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:28.580849 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-295b0829-90a4-49d3-a23d-d1c734e5769e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:28.581293 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-295b0829-90a4-49d3-a23d-d1c734e5769e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:28.631002 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d2b34f57-f0ca-41bf-b3c2-8b30ea96f6e3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:28.631618 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d2b34f57-f0ca-41bf-b3c2-8b30ea96f6e3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:28.638140 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d2b34f57-f0ca-41bf-b3c2-8b30ea96f6e3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:28.638591 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d2b34f57-f0ca-41bf-b3c2-8b30ea96f6e3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:28.639351 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d2b34f57-f0ca-41bf-b3c2-8b30ea96f6e3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:28.639787 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d2b34f57-f0ca-41bf-b3c2-8b30ea96f6e3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:28.700207 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-d2b34f57-f0ca-41bf-b3c2-8b30ea96f6e3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:28.707606 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-295b0829-90a4-49d3-a23d-d1c734e5769e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:28.708852 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-d2b34f57-f0ca-41bf-b3c2-8b30ea96f6e3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:28.710410 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-d2b34f57-f0ca-41bf-b3c2-8b30ea96f6e3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:28.711565 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d2b34f57-f0ca-41bf-b3c2-8b30ea96f6e3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084459 May 24 15:40:28.712131 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1152/2318] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:40:28 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:40:28.715954 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-295b0829-90a4-49d3-a23d-d1c734e5769e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.146807 May 24 15:40:28.716633 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1167/2319] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:28 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:29.036086 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d309a771-57d2-47dd-80da-0849de09bbda tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:29.036728 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d309a771-57d2-47dd-80da-0849de09bbda tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:29.043394 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d309a771-57d2-47dd-80da-0849de09bbda tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:29.043844 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d309a771-57d2-47dd-80da-0849de09bbda tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:29.044642 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d309a771-57d2-47dd-80da-0849de09bbda tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:29.045081 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d309a771-57d2-47dd-80da-0849de09bbda tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:29.170696 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-d309a771-57d2-47dd-80da-0849de09bbda tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:29.178594 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d309a771-57d2-47dd-80da-0849de09bbda tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.146352 May 24 15:40:29.179161 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1153/2320] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:29 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:29.232755 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-ecddf84a-70ab-4fa5-8cf4-fcc4be748204 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:29.233362 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-ecddf84a-70ab-4fa5-8cf4-fcc4be748204 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:29.239799 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ecddf84a-70ab-4fa5-8cf4-fcc4be748204 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:29.240190 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ecddf84a-70ab-4fa5-8cf4-fcc4be748204 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:29.241237 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ecddf84a-70ab-4fa5-8cf4-fcc4be748204 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:29.241686 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ecddf84a-70ab-4fa5-8cf4-fcc4be748204 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:29.368880 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ecddf84a-70ab-4fa5-8cf4-fcc4be748204 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:29.376801 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-ecddf84a-70ab-4fa5-8cf4-fcc4be748204 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.147865 May 24 15:40:29.377363 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1168/2321] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:29 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:29.729454 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-c5816ecb-4a0f-40f1-8989-877976373635 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:29.730069 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-c5816ecb-4a0f-40f1-8989-877976373635 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:29.732789 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-74687f31-eb8c-45e6-9ddd-349d18ecce84 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:29.733398 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-74687f31-eb8c-45e6-9ddd-349d18ecce84 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:29.736639 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c5816ecb-4a0f-40f1-8989-877976373635 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:29.737088 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c5816ecb-4a0f-40f1-8989-877976373635 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:29.737850 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c5816ecb-4a0f-40f1-8989-877976373635 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:29.738278 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c5816ecb-4a0f-40f1-8989-877976373635 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:29.739283 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-74687f31-eb8c-45e6-9ddd-349d18ecce84 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:29.739729 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-74687f31-eb8c-45e6-9ddd-349d18ecce84 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:29.741250 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-74687f31-eb8c-45e6-9ddd-349d18ecce84 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:29.741687 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-74687f31-eb8c-45e6-9ddd-349d18ecce84 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:29.757833 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:40:29.803898 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-c5816ecb-4a0f-40f1-8989-877976373635 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:29.812379 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-c5816ecb-4a0f-40f1-8989-877976373635 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:29.813890 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-c5816ecb-4a0f-40f1-8989-877976373635 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:29.815038 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-c5816ecb-4a0f-40f1-8989-877976373635 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.089490 May 24 15:40:29.815606 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1154/2322] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:40:29 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:29.868974 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-74687f31-eb8c-45e6-9ddd-349d18ecce84 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:29.876881 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-74687f31-eb8c-45e6-9ddd-349d18ecce84 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.147765 May 24 15:40:29.877448 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1169/2323] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:29 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:40:30.195172 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-098e070d-42a2-43d2-ad58-68512a176690 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:30.195776 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-098e070d-42a2-43d2-ad58-68512a176690 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:30.201775 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-098e070d-42a2-43d2-ad58-68512a176690 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:30.202214 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-098e070d-42a2-43d2-ad58-68512a176690 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:30.202961 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-098e070d-42a2-43d2-ad58-68512a176690 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:30.203386 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-098e070d-42a2-43d2-ad58-68512a176690 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:30.325515 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-098e070d-42a2-43d2-ad58-68512a176690 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:30.333321 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-098e070d-42a2-43d2-ad58-68512a176690 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.142085 May 24 15:40:30.333886 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1155/2324] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:30 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:30.394045 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c2dd3ab0-f593-4687-a9e1-d0b34b82e25b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:30.394686 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-c2dd3ab0-f593-4687-a9e1-d0b34b82e25b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:30.397548 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_api:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:40:30.402906 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c2dd3ab0-f593-4687-a9e1-d0b34b82e25b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:30.403352 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c2dd3ab0-f593-4687-a9e1-d0b34b82e25b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:30.404103 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c2dd3ab0-f593-4687-a9e1-d0b34b82e25b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:30.404565 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c2dd3ab0-f593-4687-a9e1-d0b34b82e25b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:30.750259 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-c2dd3ab0-f593-4687-a9e1-d0b34b82e25b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:30.758959 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-c2dd3ab0-f593-4687-a9e1-d0b34b82e25b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.368773 May 24 15:40:30.759517 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1170/2325] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:30 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:30.833093 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-75624fde-0129-44a4-b789-1a61a03f2742 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:30.833819 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-75624fde-0129-44a4-b789-1a61a03f2742 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:30.840949 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-75624fde-0129-44a4-b789-1a61a03f2742 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:30.841422 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-75624fde-0129-44a4-b789-1a61a03f2742 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:30.842171 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-75624fde-0129-44a4-b789-1a61a03f2742 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:30.842599 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-75624fde-0129-44a4-b789-1a61a03f2742 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:30.893603 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-3e8d1281-3314-4d42-b44d-3647dceba9d3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:30.894216 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-3e8d1281-3314-4d42-b44d-3647dceba9d3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:30.900777 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3e8d1281-3314-4d42-b44d-3647dceba9d3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:30.901222 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3e8d1281-3314-4d42-b44d-3647dceba9d3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:30.901977 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3e8d1281-3314-4d42-b44d-3647dceba9d3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:30.902532 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3e8d1281-3314-4d42-b44d-3647dceba9d3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:30.906205 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-75624fde-0129-44a4-b789-1a61a03f2742 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:30.914609 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-75624fde-0129-44a4-b789-1a61a03f2742 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:30.916110 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-75624fde-0129-44a4-b789-1a61a03f2742 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:30.917278 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-75624fde-0129-44a4-b789-1a61a03f2742 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.088024 May 24 15:40:30.917835 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1156/2326] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:40:30 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:31.029720 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-3e8d1281-3314-4d42-b44d-3647dceba9d3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:31.037574 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-3e8d1281-3314-4d42-b44d-3647dceba9d3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.147893 May 24 15:40:31.038128 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1171/2327] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:30 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:40:31.350781 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d066b065-2dba-489c-9aa0-70af589e0a58 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:31.351327 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d066b065-2dba-489c-9aa0-70af589e0a58 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:31.353215 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_api:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:40:31.358680 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d066b065-2dba-489c-9aa0-70af589e0a58 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:31.359131 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d066b065-2dba-489c-9aa0-70af589e0a58 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:31.359886 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d066b065-2dba-489c-9aa0-70af589e0a58 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:31.360342 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d066b065-2dba-489c-9aa0-70af589e0a58 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:31.701935 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-d066b065-2dba-489c-9aa0-70af589e0a58 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:31.710005 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d066b065-2dba-489c-9aa0-70af589e0a58 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.363626 May 24 15:40:31.710598 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1157/2328] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:31 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:31.775175 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-0110e59d-ae22-4dbc-9314-412c847fd409 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:31.775777 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-0110e59d-ae22-4dbc-9314-412c847fd409 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:31.782279 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0110e59d-ae22-4dbc-9314-412c847fd409 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:31.782719 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0110e59d-ae22-4dbc-9314-412c847fd409 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:31.783461 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0110e59d-ae22-4dbc-9314-412c847fd409 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:31.783887 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0110e59d-ae22-4dbc-9314-412c847fd409 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:31.913111 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-0110e59d-ae22-4dbc-9314-412c847fd409 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:31.920926 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-0110e59d-ae22-4dbc-9314-412c847fd409 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.150058 May 24 15:40:31.921482 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1172/2329] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:31 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:31.934826 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-7086ecb6-6eee-4967-a385-db72cd8f89f4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:31.935438 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-7086ecb6-6eee-4967-a385-db72cd8f89f4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:31.941835 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7086ecb6-6eee-4967-a385-db72cd8f89f4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:31.942278 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7086ecb6-6eee-4967-a385-db72cd8f89f4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:31.943036 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7086ecb6-6eee-4967-a385-db72cd8f89f4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:31.943474 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7086ecb6-6eee-4967-a385-db72cd8f89f4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:32.003700 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-7086ecb6-6eee-4967-a385-db72cd8f89f4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:32.012161 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-7086ecb6-6eee-4967-a385-db72cd8f89f4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:32.013687 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-7086ecb6-6eee-4967-a385-db72cd8f89f4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:32.014822 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-7086ecb6-6eee-4967-a385-db72cd8f89f4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.083930 May 24 15:40:32.015386 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1158/2330] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:40:31 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:32.054643 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-838d4dc5-b63a-48c8-b5ca-263a5a393aa8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:32.055278 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-838d4dc5-b63a-48c8-b5ca-263a5a393aa8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:32.061499 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-838d4dc5-b63a-48c8-b5ca-263a5a393aa8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:32.061943 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-838d4dc5-b63a-48c8-b5ca-263a5a393aa8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:32.062697 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-838d4dc5-b63a-48c8-b5ca-263a5a393aa8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:32.063137 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-838d4dc5-b63a-48c8-b5ca-263a5a393aa8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:32.187034 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-838d4dc5-b63a-48c8-b5ca-263a5a393aa8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:32.195369 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-838d4dc5-b63a-48c8-b5ca-263a5a393aa8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.144885 May 24 15:40:32.195929 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1173/2331] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:32 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:32.726682 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-56e65e93-717c-4463-94dc-b7c3cfa3dfb9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:32.727283 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-56e65e93-717c-4463-94dc-b7c3cfa3dfb9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:32.733328 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-56e65e93-717c-4463-94dc-b7c3cfa3dfb9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:32.733770 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-56e65e93-717c-4463-94dc-b7c3cfa3dfb9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:32.734513 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-56e65e93-717c-4463-94dc-b7c3cfa3dfb9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:32.734942 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-56e65e93-717c-4463-94dc-b7c3cfa3dfb9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:32.860708 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-56e65e93-717c-4463-94dc-b7c3cfa3dfb9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:32.869508 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-56e65e93-717c-4463-94dc-b7c3cfa3dfb9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.146721 May 24 15:40:32.870078 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1159/2332] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:32 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:32.937760 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-47aaa9cf-a065-4e32-af2d-0880e5bd9b8c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:32.938372 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-47aaa9cf-a065-4e32-af2d-0880e5bd9b8c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:32.944805 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-47aaa9cf-a065-4e32-af2d-0880e5bd9b8c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:32.945250 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-47aaa9cf-a065-4e32-af2d-0880e5bd9b8c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:32.945999 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-47aaa9cf-a065-4e32-af2d-0880e5bd9b8c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:32.946430 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-47aaa9cf-a065-4e32-af2d-0880e5bd9b8c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:33.032712 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f6ae1318-adc6-4e2a-8fd6-802f570601b7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:33.033328 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f6ae1318-adc6-4e2a-8fd6-802f570601b7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:33.040270 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f6ae1318-adc6-4e2a-8fd6-802f570601b7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:33.040746 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f6ae1318-adc6-4e2a-8fd6-802f570601b7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:33.041503 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f6ae1318-adc6-4e2a-8fd6-802f570601b7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:33.041929 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f6ae1318-adc6-4e2a-8fd6-802f570601b7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:33.072001 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-47aaa9cf-a065-4e32-af2d-0880e5bd9b8c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:33.080239 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-47aaa9cf-a065-4e32-af2d-0880e5bd9b8c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.146218 May 24 15:40:33.080844 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1174/2333] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:32 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:40:33.102528 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-f6ae1318-adc6-4e2a-8fd6-802f570601b7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:33.110910 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-f6ae1318-adc6-4e2a-8fd6-802f570601b7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:33.112356 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-f6ae1318-adc6-4e2a-8fd6-802f570601b7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:33.113486 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f6ae1318-adc6-4e2a-8fd6-802f570601b7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084671 May 24 15:40:33.114038 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1160/2334] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:40:33 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:40:33.211972 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-def5b3a7-96a8-4543-ad47-0158db57a51e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:33.212650 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-def5b3a7-96a8-4543-ad47-0158db57a51e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:33.218635 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-def5b3a7-96a8-4543-ad47-0158db57a51e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:33.219080 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-def5b3a7-96a8-4543-ad47-0158db57a51e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:33.219828 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-def5b3a7-96a8-4543-ad47-0158db57a51e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:33.220260 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-def5b3a7-96a8-4543-ad47-0158db57a51e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:33.347025 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-def5b3a7-96a8-4543-ad47-0158db57a51e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:33.355621 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-def5b3a7-96a8-4543-ad47-0158db57a51e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.147452 May 24 15:40:33.356186 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1175/2335] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:33 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:33.886897 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-37715f14-538d-43cc-a830-bf9763ff4aee tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:33.887542 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-37715f14-538d-43cc-a830-bf9763ff4aee tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:33.893658 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-37715f14-538d-43cc-a830-bf9763ff4aee tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:33.894113 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-37715f14-538d-43cc-a830-bf9763ff4aee tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:33.894871 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-37715f14-538d-43cc-a830-bf9763ff4aee tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:33.895307 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-37715f14-538d-43cc-a830-bf9763ff4aee tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:34.020115 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-37715f14-538d-43cc-a830-bf9763ff4aee tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:34.028162 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-37715f14-538d-43cc-a830-bf9763ff4aee tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.145104 May 24 15:40:34.028800 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1161/2336] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:33 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:34.097435 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-9f2eba70-a3fa-45c2-8c7d-0c570e6b973e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:34.098051 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-9f2eba70-a3fa-45c2-8c7d-0c570e6b973e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:34.104736 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9f2eba70-a3fa-45c2-8c7d-0c570e6b973e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:34.105188 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9f2eba70-a3fa-45c2-8c7d-0c570e6b973e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:34.105949 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9f2eba70-a3fa-45c2-8c7d-0c570e6b973e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:34.106387 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9f2eba70-a3fa-45c2-8c7d-0c570e6b973e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:34.131444 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-b6e39e16-75cf-4fda-8bd7-c549abe51495 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:34.132108 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-b6e39e16-75cf-4fda-8bd7-c549abe51495 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:34.138614 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b6e39e16-75cf-4fda-8bd7-c549abe51495 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:34.139063 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b6e39e16-75cf-4fda-8bd7-c549abe51495 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:34.139827 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b6e39e16-75cf-4fda-8bd7-c549abe51495 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:34.140265 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b6e39e16-75cf-4fda-8bd7-c549abe51495 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:34.205912 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-b6e39e16-75cf-4fda-8bd7-c549abe51495 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:34.214201 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-b6e39e16-75cf-4fda-8bd7-c549abe51495 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:34.215684 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-b6e39e16-75cf-4fda-8bd7-c549abe51495 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:34.216843 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-b6e39e16-75cf-4fda-8bd7-c549abe51495 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.089887 May 24 15:40:34.217405 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1162/2337] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:40:34 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:40:34.234167 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-9f2eba70-a3fa-45c2-8c7d-0c570e6b973e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:34.242875 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-9f2eba70-a3fa-45c2-8c7d-0c570e6b973e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.149325 May 24 15:40:34.243430 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1176/2338] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:34 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:34.372675 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-926986da-736c-4d4e-8172-8b106b8a1b3a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:34.373294 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-926986da-736c-4d4e-8172-8b106b8a1b3a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:34.379362 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-926986da-736c-4d4e-8172-8b106b8a1b3a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:34.379818 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-926986da-736c-4d4e-8172-8b106b8a1b3a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:34.380615 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-926986da-736c-4d4e-8172-8b106b8a1b3a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:34.381114 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-926986da-736c-4d4e-8172-8b106b8a1b3a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:34.505731 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-926986da-736c-4d4e-8172-8b106b8a1b3a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:34.513557 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-926986da-736c-4d4e-8172-8b106b8a1b3a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.144868 May 24 15:40:34.514127 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1163/2339] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:34 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:35.044833 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-a07511be-c886-4178-a146-7da6f386a288 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:35.045443 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-a07511be-c886-4178-a146-7da6f386a288 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:35.051474 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a07511be-c886-4178-a146-7da6f386a288 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:35.051920 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a07511be-c886-4178-a146-7da6f386a288 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:35.052697 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a07511be-c886-4178-a146-7da6f386a288 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:35.053133 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a07511be-c886-4178-a146-7da6f386a288 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:35.180347 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-a07511be-c886-4178-a146-7da6f386a288 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:35.188273 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-a07511be-c886-4178-a146-7da6f386a288 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.147276 May 24 15:40:35.188856 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1177/2340] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:35 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:35.234401 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a1be0c21-2b03-4d58-a077-bc55b7d15d9e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:35.235009 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a1be0c21-2b03-4d58-a077-bc55b7d15d9e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:35.241751 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a1be0c21-2b03-4d58-a077-bc55b7d15d9e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:35.242131 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a1be0c21-2b03-4d58-a077-bc55b7d15d9e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:35.242880 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a1be0c21-2b03-4d58-a077-bc55b7d15d9e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:35.243300 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a1be0c21-2b03-4d58-a077-bc55b7d15d9e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:35.259136 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e4c72e47-b164-4d33-a87f-7e1c009918cb tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:35.259747 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e4c72e47-b164-4d33-a87f-7e1c009918cb tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:35.265713 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e4c72e47-b164-4d33-a87f-7e1c009918cb tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:35.266161 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e4c72e47-b164-4d33-a87f-7e1c009918cb tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:35.266917 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e4c72e47-b164-4d33-a87f-7e1c009918cb tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:35.267350 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e4c72e47-b164-4d33-a87f-7e1c009918cb tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:35.303238 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-a1be0c21-2b03-4d58-a077-bc55b7d15d9e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:35.311751 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-a1be0c21-2b03-4d58-a077-bc55b7d15d9e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:35.313265 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-a1be0c21-2b03-4d58-a077-bc55b7d15d9e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:35.314402 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a1be0c21-2b03-4d58-a077-bc55b7d15d9e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.083832 May 24 15:40:35.314964 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1164/2341] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:40:35 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:35.391761 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e4c72e47-b164-4d33-a87f-7e1c009918cb tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:35.400405 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e4c72e47-b164-4d33-a87f-7e1c009918cb tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.145451 May 24 15:40:35.400969 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1178/2342] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:35 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:40:35.530408 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-0d1be649-a94a-4db4-9312-da923bc4b326 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:35.531338 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-0d1be649-a94a-4db4-9312-da923bc4b326 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:35.537624 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0d1be649-a94a-4db4-9312-da923bc4b326 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:35.538065 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0d1be649-a94a-4db4-9312-da923bc4b326 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:35.538841 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0d1be649-a94a-4db4-9312-da923bc4b326 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:35.539268 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0d1be649-a94a-4db4-9312-da923bc4b326 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:35.667085 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-0d1be649-a94a-4db4-9312-da923bc4b326 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:35.674908 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-0d1be649-a94a-4db4-9312-da923bc4b326 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.148437 May 24 15:40:35.675466 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1165/2343] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:35 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:36.205529 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-36607d8c-d00a-4cb8-920c-3cec6fdc8e23 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:36.206142 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-36607d8c-d00a-4cb8-920c-3cec6fdc8e23 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:36.212677 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-36607d8c-d00a-4cb8-920c-3cec6fdc8e23 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:36.213128 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-36607d8c-d00a-4cb8-920c-3cec6fdc8e23 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:36.213888 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-36607d8c-d00a-4cb8-920c-3cec6fdc8e23 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:36.214319 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-36607d8c-d00a-4cb8-920c-3cec6fdc8e23 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:36.218263 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:40:36.332806 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-72c64e79-b3f2-4dc1-842f-18f9b77c9ec0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:36.333363 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-72c64e79-b3f2-4dc1-842f-18f9b77c9ec0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:36.340433 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-72c64e79-b3f2-4dc1-842f-18f9b77c9ec0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:36.340882 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-72c64e79-b3f2-4dc1-842f-18f9b77c9ec0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:36.341679 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-72c64e79-b3f2-4dc1-842f-18f9b77c9ec0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:36.342120 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-72c64e79-b3f2-4dc1-842f-18f9b77c9ec0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:36.345277 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-36607d8c-d00a-4cb8-920c-3cec6fdc8e23 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:36.353805 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-36607d8c-d00a-4cb8-920c-3cec6fdc8e23 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.152121 May 24 15:40:36.354365 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1179/2344] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:36 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:36.403735 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-72c64e79-b3f2-4dc1-842f-18f9b77c9ec0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:36.412883 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-72c64e79-b3f2-4dc1-842f-18f9b77c9ec0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:36.414389 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-72c64e79-b3f2-4dc1-842f-18f9b77c9ec0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:36.415529 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-72c64e79-b3f2-4dc1-842f-18f9b77c9ec0 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.086732 May 24 15:40:36.416084 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1166/2345] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:40:36 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:40:36.417657 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-4cd38d34-4d56-47ec-ae77-d5ed555226e4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:36.418275 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-4cd38d34-4d56-47ec-ae77-d5ed555226e4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:36.424410 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4cd38d34-4d56-47ec-ae77-d5ed555226e4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:36.424857 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4cd38d34-4d56-47ec-ae77-d5ed555226e4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:36.425613 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4cd38d34-4d56-47ec-ae77-d5ed555226e4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:36.426048 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4cd38d34-4d56-47ec-ae77-d5ed555226e4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:36.549132 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-4cd38d34-4d56-47ec-ae77-d5ed555226e4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:36.557004 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-4cd38d34-4d56-47ec-ae77-d5ed555226e4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.143176 May 24 15:40:36.557564 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1180/2346] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:36 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:40:36.691281 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-640bda75-328f-4e85-bcaa-fa0eddc31be5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:36.691830 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-640bda75-328f-4e85-bcaa-fa0eddc31be5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:36.698478 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-640bda75-328f-4e85-bcaa-fa0eddc31be5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:36.698925 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-640bda75-328f-4e85-bcaa-fa0eddc31be5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:36.699682 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-640bda75-328f-4e85-bcaa-fa0eddc31be5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:36.700116 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-640bda75-328f-4e85-bcaa-fa0eddc31be5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:36.824203 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-640bda75-328f-4e85-bcaa-fa0eddc31be5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:36.832206 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-640bda75-328f-4e85-bcaa-fa0eddc31be5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.144805 May 24 15:40:36.832802 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1167/2347] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:36 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:37.370946 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c9a5898c-4e04-463d-bc45-9b8843fdf4ab tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:37.371486 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-c9a5898c-4e04-463d-bc45-9b8843fdf4ab tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:37.378146 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c9a5898c-4e04-463d-bc45-9b8843fdf4ab tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:37.378583 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c9a5898c-4e04-463d-bc45-9b8843fdf4ab tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:37.379333 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c9a5898c-4e04-463d-bc45-9b8843fdf4ab tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:37.379762 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c9a5898c-4e04-463d-bc45-9b8843fdf4ab tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:37.433871 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-067c0f9d-5898-4a97-b5a9-269fbe08b7b2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:37.434571 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-067c0f9d-5898-4a97-b5a9-269fbe08b7b2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:37.441210 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-067c0f9d-5898-4a97-b5a9-269fbe08b7b2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:37.441665 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-067c0f9d-5898-4a97-b5a9-269fbe08b7b2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:37.442426 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-067c0f9d-5898-4a97-b5a9-269fbe08b7b2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:37.442865 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-067c0f9d-5898-4a97-b5a9-269fbe08b7b2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:37.507435 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-c9a5898c-4e04-463d-bc45-9b8843fdf4ab tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:37.507661 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-067c0f9d-5898-4a97-b5a9-269fbe08b7b2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:37.515437 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-c9a5898c-4e04-463d-bc45-9b8843fdf4ab tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.148460 May 24 15:40:37.515979 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-067c0f9d-5898-4a97-b5a9-269fbe08b7b2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:37.516140 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1181/2348] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:37 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:37.517655 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-067c0f9d-5898-4a97-b5a9-269fbe08b7b2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:37.518841 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-067c0f9d-5898-4a97-b5a9-269fbe08b7b2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.088852 May 24 15:40:37.519583 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1168/2349] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:40:37 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:40:37.573545 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-42272c7a-a617-43c4-9212-946ab32b2080 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:37.574157 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-42272c7a-a617-43c4-9212-946ab32b2080 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:37.580097 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-42272c7a-a617-43c4-9212-946ab32b2080 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:37.580583 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-42272c7a-a617-43c4-9212-946ab32b2080 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:37.581343 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-42272c7a-a617-43c4-9212-946ab32b2080 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:37.581778 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-42272c7a-a617-43c4-9212-946ab32b2080 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:37.723994 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-42272c7a-a617-43c4-9212-946ab32b2080 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:37.732402 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-42272c7a-a617-43c4-9212-946ab32b2080 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.162581 May 24 15:40:37.732965 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1182/2350] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:37 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:37.850132 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-51fbf870-ed8a-4108-9426-635928f35db4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:37.850766 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-51fbf870-ed8a-4108-9426-635928f35db4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:37.856760 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-51fbf870-ed8a-4108-9426-635928f35db4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:37.857208 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-51fbf870-ed8a-4108-9426-635928f35db4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:37.857968 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-51fbf870-ed8a-4108-9426-635928f35db4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:37.858405 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-51fbf870-ed8a-4108-9426-635928f35db4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:37.983250 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-51fbf870-ed8a-4108-9426-635928f35db4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:37.991442 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-51fbf870-ed8a-4108-9426-635928f35db4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.145452 May 24 15:40:37.992016 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1169/2351] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:37 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:38.531951 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-ca8689e1-7a94-43ad-b756-c85573bf1724 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:38.532603 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-ca8689e1-7a94-43ad-b756-c85573bf1724 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:38.536352 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-bf46a764-6e1a-4f43-94ea-7da2fda002f4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:38.536985 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-bf46a764-6e1a-4f43-94ea-7da2fda002f4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:38.539087 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ca8689e1-7a94-43ad-b756-c85573bf1724 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:38.539533 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ca8689e1-7a94-43ad-b756-c85573bf1724 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:38.540287 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ca8689e1-7a94-43ad-b756-c85573bf1724 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:38.540740 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ca8689e1-7a94-43ad-b756-c85573bf1724 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:38.543326 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bf46a764-6e1a-4f43-94ea-7da2fda002f4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:38.543766 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bf46a764-6e1a-4f43-94ea-7da2fda002f4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:38.544541 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bf46a764-6e1a-4f43-94ea-7da2fda002f4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:38.544968 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bf46a764-6e1a-4f43-94ea-7da2fda002f4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:38.610546 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-bf46a764-6e1a-4f43-94ea-7da2fda002f4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:38.619721 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-bf46a764-6e1a-4f43-94ea-7da2fda002f4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:38.621263 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-bf46a764-6e1a-4f43-94ea-7da2fda002f4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:38.622415 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-bf46a764-6e1a-4f43-94ea-7da2fda002f4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.090001 May 24 15:40:38.622975 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1170/2352] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:40:38 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:40:38.670269 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ca8689e1-7a94-43ad-b756-c85573bf1724 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:38.678643 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-ca8689e1-7a94-43ad-b756-c85573bf1724 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.150545 May 24 15:40:38.679204 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1183/2353] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:38 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:38.750438 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-da60eeb8-3c89-4e26-802d-292da2f3a559 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:38.751041 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-da60eeb8-3c89-4e26-802d-292da2f3a559 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:38.757551 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-da60eeb8-3c89-4e26-802d-292da2f3a559 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:38.757993 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-da60eeb8-3c89-4e26-802d-292da2f3a559 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:38.758738 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-da60eeb8-3c89-4e26-802d-292da2f3a559 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:38.759165 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-da60eeb8-3c89-4e26-802d-292da2f3a559 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:38.763073 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:40:38.886690 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-da60eeb8-3c89-4e26-802d-292da2f3a559 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:38.894530 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-da60eeb8-3c89-4e26-802d-292da2f3a559 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.147892 May 24 15:40:38.895094 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1171/2354] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:38 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:40:39.008113 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-b68c6a6c-b3b5-4994-b949-1817ef839487 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:39.008756 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-b68c6a6c-b3b5-4994-b949-1817ef839487 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:39.014912 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b68c6a6c-b3b5-4994-b949-1817ef839487 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:39.015368 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b68c6a6c-b3b5-4994-b949-1817ef839487 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:39.016129 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b68c6a6c-b3b5-4994-b949-1817ef839487 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:39.016597 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b68c6a6c-b3b5-4994-b949-1817ef839487 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:39.144151 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-b68c6a6c-b3b5-4994-b949-1817ef839487 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:39.152135 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-b68c6a6c-b3b5-4994-b949-1817ef839487 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.147836 May 24 15:40:39.152731 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1184/2355] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:39 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:39.641140 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a8096fe3-3b3e-4c88-ad36-d7107eb7836e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:39.641688 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a8096fe3-3b3e-4c88-ad36-d7107eb7836e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:39.648646 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a8096fe3-3b3e-4c88-ad36-d7107eb7836e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:39.649096 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a8096fe3-3b3e-4c88-ad36-d7107eb7836e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:39.649854 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a8096fe3-3b3e-4c88-ad36-d7107eb7836e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:39.650288 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a8096fe3-3b3e-4c88-ad36-d7107eb7836e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:39.695367 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-a948bc8a-d8db-4f57-bcf6-8d10530cbd9a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:39.695980 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-a948bc8a-d8db-4f57-bcf6-8d10530cbd9a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:39.702430 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a948bc8a-d8db-4f57-bcf6-8d10530cbd9a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:39.702877 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a948bc8a-d8db-4f57-bcf6-8d10530cbd9a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:39.703630 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a948bc8a-d8db-4f57-bcf6-8d10530cbd9a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:39.704070 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a948bc8a-d8db-4f57-bcf6-8d10530cbd9a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:39.711140 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-a8096fe3-3b3e-4c88-ad36-d7107eb7836e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:39.720010 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-a8096fe3-3b3e-4c88-ad36-d7107eb7836e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:39.721523 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-a8096fe3-3b3e-4c88-ad36-d7107eb7836e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:39.722658 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a8096fe3-3b3e-4c88-ad36-d7107eb7836e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.085554 May 24 15:40:39.723217 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1172/2356] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:40:39 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:39.830269 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-a948bc8a-d8db-4f57-bcf6-8d10530cbd9a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:39.838716 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-a948bc8a-d8db-4f57-bcf6-8d10530cbd9a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.147768 May 24 15:40:39.839271 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1185/2357] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:39 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:40:39.910887 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f85bcd08-55ae-4b5c-b07a-46195426053f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:39.911427 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f85bcd08-55ae-4b5c-b07a-46195426053f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:39.917550 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f85bcd08-55ae-4b5c-b07a-46195426053f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:39.917993 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f85bcd08-55ae-4b5c-b07a-46195426053f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:39.918744 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f85bcd08-55ae-4b5c-b07a-46195426053f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:39.919175 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f85bcd08-55ae-4b5c-b07a-46195426053f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:40.050210 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-f85bcd08-55ae-4b5c-b07a-46195426053f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:40.058615 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f85bcd08-55ae-4b5c-b07a-46195426053f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.151602 May 24 15:40:40.059178 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1173/2358] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:39 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:40.168885 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-37b7faec-dca0-46d8-9912-3b6da3470607 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:40.169431 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-37b7faec-dca0-46d8-9912-3b6da3470607 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:40.175612 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-37b7faec-dca0-46d8-9912-3b6da3470607 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:40.176059 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-37b7faec-dca0-46d8-9912-3b6da3470607 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:40.176838 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-37b7faec-dca0-46d8-9912-3b6da3470607 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:40.177271 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-37b7faec-dca0-46d8-9912-3b6da3470607 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:40.301050 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-37b7faec-dca0-46d8-9912-3b6da3470607 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:40.309374 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-37b7faec-dca0-46d8-9912-3b6da3470607 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.144432 May 24 15:40:40.309930 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1186/2359] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:40 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:40.741331 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-3837950f-a259-4b52-9718-4ab49f9fc8f8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:40.741984 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-3837950f-a259-4b52-9718-4ab49f9fc8f8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:40.748380 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3837950f-a259-4b52-9718-4ab49f9fc8f8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:40.748830 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3837950f-a259-4b52-9718-4ab49f9fc8f8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:40.749579 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3837950f-a259-4b52-9718-4ab49f9fc8f8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:40.750009 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3837950f-a259-4b52-9718-4ab49f9fc8f8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:40.813031 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-3837950f-a259-4b52-9718-4ab49f9fc8f8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:40.821334 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-3837950f-a259-4b52-9718-4ab49f9fc8f8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:40.822816 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-3837950f-a259-4b52-9718-4ab49f9fc8f8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:40.823952 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-3837950f-a259-4b52-9718-4ab49f9fc8f8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.087461 May 24 15:40:40.824541 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1174/2360] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:40:40 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:40.855791 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-75ce90b5-caf0-4b02-927f-2432d209f3da tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:40.856519 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-75ce90b5-caf0-4b02-927f-2432d209f3da tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:40.862471 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-75ce90b5-caf0-4b02-927f-2432d209f3da tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:40.862919 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-75ce90b5-caf0-4b02-927f-2432d209f3da tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:40.863665 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-75ce90b5-caf0-4b02-927f-2432d209f3da tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:40.864097 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-75ce90b5-caf0-4b02-927f-2432d209f3da tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:40.991793 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-75ce90b5-caf0-4b02-927f-2432d209f3da tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:40.999939 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-75ce90b5-caf0-4b02-927f-2432d209f3da tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.147959 May 24 15:40:41.000526 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1187/2361] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:40 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:41.074825 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-455c4646-914f-4518-af7c-ee51b4a672a9 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:41.075441 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-455c4646-914f-4518-af7c-ee51b4a672a9 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:41.081547 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-455c4646-914f-4518-af7c-ee51b4a672a9 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:41.081992 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-455c4646-914f-4518-af7c-ee51b4a672a9 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:41.082749 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-455c4646-914f-4518-af7c-ee51b4a672a9 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:41.083182 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-455c4646-914f-4518-af7c-ee51b4a672a9 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:41.210091 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-455c4646-914f-4518-af7c-ee51b4a672a9 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:41.217947 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-455c4646-914f-4518-af7c-ee51b4a672a9 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.147001 May 24 15:40:41.218518 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1175/2362] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:41 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:41.326821 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-77532bec-a96d-4c72-bfc3-a586de115125 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:41.327422 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-77532bec-a96d-4c72-bfc3-a586de115125 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:41.334462 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-77532bec-a96d-4c72-bfc3-a586de115125 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:41.334931 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-77532bec-a96d-4c72-bfc3-a586de115125 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:41.335677 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-77532bec-a96d-4c72-bfc3-a586de115125 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:41.336108 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-77532bec-a96d-4c72-bfc3-a586de115125 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:41.460021 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-77532bec-a96d-4c72-bfc3-a586de115125 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:41.467849 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-77532bec-a96d-4c72-bfc3-a586de115125 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.144814 May 24 15:40:41.468430 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1188/2363] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:41 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:41.842045 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-98f41a17-8c36-4a89-9a4c-41350f182be5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:41.842654 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-98f41a17-8c36-4a89-9a4c-41350f182be5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:41.849270 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-98f41a17-8c36-4a89-9a4c-41350f182be5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:41.850206 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-98f41a17-8c36-4a89-9a4c-41350f182be5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:41.850994 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-98f41a17-8c36-4a89-9a4c-41350f182be5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:41.851429 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-98f41a17-8c36-4a89-9a4c-41350f182be5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:41.911324 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-98f41a17-8c36-4a89-9a4c-41350f182be5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:41.920166 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-98f41a17-8c36-4a89-9a4c-41350f182be5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:41.921701 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-98f41a17-8c36-4a89-9a4c-41350f182be5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:41.922841 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-98f41a17-8c36-4a89-9a4c-41350f182be5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084671 May 24 15:40:41.923401 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1176/2364] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:40:41 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:42.015763 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-6627ce7f-9b35-4471-94d9-0a6841a37622 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:42.016405 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-6627ce7f-9b35-4471-94d9-0a6841a37622 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:42.022517 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6627ce7f-9b35-4471-94d9-0a6841a37622 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:42.022966 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6627ce7f-9b35-4471-94d9-0a6841a37622 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:42.023719 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6627ce7f-9b35-4471-94d9-0a6841a37622 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:42.024152 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6627ce7f-9b35-4471-94d9-0a6841a37622 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:42.160582 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-6627ce7f-9b35-4471-94d9-0a6841a37622 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:42.169037 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-6627ce7f-9b35-4471-94d9-0a6841a37622 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.157113 May 24 15:40:42.169588 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1189/2365] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:42 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:42.234722 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-2d64f3a0-93f7-4f3d-9cd9-86096e34b52d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:42.235333 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-2d64f3a0-93f7-4f3d-9cd9-86096e34b52d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:42.242185 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2d64f3a0-93f7-4f3d-9cd9-86096e34b52d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:42.242625 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2d64f3a0-93f7-4f3d-9cd9-86096e34b52d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:42.243408 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2d64f3a0-93f7-4f3d-9cd9-86096e34b52d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:42.243836 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2d64f3a0-93f7-4f3d-9cd9-86096e34b52d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:42.371729 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-2d64f3a0-93f7-4f3d-9cd9-86096e34b52d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:42.379645 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-2d64f3a0-93f7-4f3d-9cd9-86096e34b52d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.148786 May 24 15:40:42.380224 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1177/2366] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:42 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:42.484425 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-358af569-9e54-490b-9e46-57fae4033a5a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:42.485038 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-358af569-9e54-490b-9e46-57fae4033a5a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:42.491698 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-358af569-9e54-490b-9e46-57fae4033a5a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:42.492144 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-358af569-9e54-490b-9e46-57fae4033a5a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:42.492925 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-358af569-9e54-490b-9e46-57fae4033a5a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:42.493367 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-358af569-9e54-490b-9e46-57fae4033a5a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:42.624703 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-358af569-9e54-490b-9e46-57fae4033a5a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:42.633294 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-358af569-9e54-490b-9e46-57fae4033a5a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.152701 May 24 15:40:42.633853 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1190/2367] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:42 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:42.941521 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-63bb3bda-0749-44a3-adce-5fcc658565f6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:42.942080 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-63bb3bda-0749-44a3-adce-5fcc658565f6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:42.949233 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-63bb3bda-0749-44a3-adce-5fcc658565f6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:42.949680 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-63bb3bda-0749-44a3-adce-5fcc658565f6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:42.950442 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-63bb3bda-0749-44a3-adce-5fcc658565f6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:42.950875 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-63bb3bda-0749-44a3-adce-5fcc658565f6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:43.012827 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-63bb3bda-0749-44a3-adce-5fcc658565f6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:43.021230 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-63bb3bda-0749-44a3-adce-5fcc658565f6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:43.022726 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-63bb3bda-0749-44a3-adce-5fcc658565f6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:43.023888 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-63bb3bda-0749-44a3-adce-5fcc658565f6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.086510 May 24 15:40:43.024479 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1178/2368] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:40:42 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:43.186538 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-19db1ae3-84d2-4258-8ad0-f1c0f9aedf2b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:43.187155 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-19db1ae3-84d2-4258-8ad0-f1c0f9aedf2b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:43.193935 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-19db1ae3-84d2-4258-8ad0-f1c0f9aedf2b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:43.194327 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-19db1ae3-84d2-4258-8ad0-f1c0f9aedf2b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:43.195084 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-19db1ae3-84d2-4258-8ad0-f1c0f9aedf2b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:43.195520 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-19db1ae3-84d2-4258-8ad0-f1c0f9aedf2b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:43.323030 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-19db1ae3-84d2-4258-8ad0-f1c0f9aedf2b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:43.330892 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-19db1ae3-84d2-4258-8ad0-f1c0f9aedf2b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.148226 May 24 15:40:43.331448 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1191/2369] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:43 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:43.396200 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-11228c9d-1bb8-48d1-8be2-89cc91bf52e3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:43.396857 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-11228c9d-1bb8-48d1-8be2-89cc91bf52e3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:43.402927 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-11228c9d-1bb8-48d1-8be2-89cc91bf52e3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:43.403373 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-11228c9d-1bb8-48d1-8be2-89cc91bf52e3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:43.404125 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-11228c9d-1bb8-48d1-8be2-89cc91bf52e3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:43.404583 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-11228c9d-1bb8-48d1-8be2-89cc91bf52e3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:43.531015 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-11228c9d-1bb8-48d1-8be2-89cc91bf52e3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:43.539394 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-11228c9d-1bb8-48d1-8be2-89cc91bf52e3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.147025 May 24 15:40:43.539958 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1179/2370] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:43 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:43.650578 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-cd200e5d-4826-4fff-a217-28d4617f1858 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:43.652467 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-cd200e5d-4826-4fff-a217-28d4617f1858 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:43.659107 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cd200e5d-4826-4fff-a217-28d4617f1858 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:43.659597 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cd200e5d-4826-4fff-a217-28d4617f1858 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:43.660578 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cd200e5d-4826-4fff-a217-28d4617f1858 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:43.661105 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cd200e5d-4826-4fff-a217-28d4617f1858 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:43.790850 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-cd200e5d-4826-4fff-a217-28d4617f1858 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:43.798811 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-cd200e5d-4826-4fff-a217-28d4617f1858 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.152079 May 24 15:40:43.799366 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1192/2371] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:43 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:44.042756 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-7b4b33e0-37ec-49a9-9c15-e0d45ad03b49 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:44.043303 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-7b4b33e0-37ec-49a9-9c15-e0d45ad03b49 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:44.049853 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7b4b33e0-37ec-49a9-9c15-e0d45ad03b49 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:44.050307 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7b4b33e0-37ec-49a9-9c15-e0d45ad03b49 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:44.051070 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7b4b33e0-37ec-49a9-9c15-e0d45ad03b49 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:44.051505 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7b4b33e0-37ec-49a9-9c15-e0d45ad03b49 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:44.118703 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-7b4b33e0-37ec-49a9-9c15-e0d45ad03b49 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:44.127032 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-7b4b33e0-37ec-49a9-9c15-e0d45ad03b49 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:44.128562 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-7b4b33e0-37ec-49a9-9c15-e0d45ad03b49 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:44.129699 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-7b4b33e0-37ec-49a9-9c15-e0d45ad03b49 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.090984 May 24 15:40:44.130262 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1180/2372] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:40:44 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:44.347681 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-76502bf5-390a-432a-9194-875737f1bad7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:44.348231 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-76502bf5-390a-432a-9194-875737f1bad7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:44.354548 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-76502bf5-390a-432a-9194-875737f1bad7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:44.354993 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-76502bf5-390a-432a-9194-875737f1bad7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:44.355740 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-76502bf5-390a-432a-9194-875737f1bad7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:44.356169 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-76502bf5-390a-432a-9194-875737f1bad7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:44.488997 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-76502bf5-390a-432a-9194-875737f1bad7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:44.497970 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-76502bf5-390a-432a-9194-875737f1bad7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.154155 May 24 15:40:44.498532 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1193/2373] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:44 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:44.556757 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-034e6f05-2fa8-4d48-a0c0-f6c9a439a989 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:44.557373 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-034e6f05-2fa8-4d48-a0c0-f6c9a439a989 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:44.563427 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-034e6f05-2fa8-4d48-a0c0-f6c9a439a989 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:44.563880 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-034e6f05-2fa8-4d48-a0c0-f6c9a439a989 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:44.564666 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-034e6f05-2fa8-4d48-a0c0-f6c9a439a989 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:44.565110 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-034e6f05-2fa8-4d48-a0c0-f6c9a439a989 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:44.690972 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-034e6f05-2fa8-4d48-a0c0-f6c9a439a989 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:44.699616 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-034e6f05-2fa8-4d48-a0c0-f6c9a439a989 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.147260 May 24 15:40:44.700183 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1181/2374] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:44 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:44.815852 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-8ed57e55-ebb8-4398-b90e-ec8db3475e37 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:44.816489 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-8ed57e55-ebb8-4398-b90e-ec8db3475e37 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:44.823434 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8ed57e55-ebb8-4398-b90e-ec8db3475e37 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:44.823910 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8ed57e55-ebb8-4398-b90e-ec8db3475e37 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:44.824695 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8ed57e55-ebb8-4398-b90e-ec8db3475e37 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:44.825127 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8ed57e55-ebb8-4398-b90e-ec8db3475e37 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:44.954011 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-8ed57e55-ebb8-4398-b90e-ec8db3475e37 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:44.961925 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-8ed57e55-ebb8-4398-b90e-ec8db3475e37 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.149920 May 24 15:40:44.962476 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1194/2375] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:44 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:45.147976 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-cf7825ce-01f1-489a-a968-94aeadb0f95c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:45.148603 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-cf7825ce-01f1-489a-a968-94aeadb0f95c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:45.155138 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cf7825ce-01f1-489a-a968-94aeadb0f95c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:45.155524 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cf7825ce-01f1-489a-a968-94aeadb0f95c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:45.156270 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cf7825ce-01f1-489a-a968-94aeadb0f95c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:45.156724 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cf7825ce-01f1-489a-a968-94aeadb0f95c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:45.217363 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-cf7825ce-01f1-489a-a968-94aeadb0f95c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:45.226460 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-cf7825ce-01f1-489a-a968-94aeadb0f95c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:45.227962 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-cf7825ce-01f1-489a-a968-94aeadb0f95c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:45.229122 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-cf7825ce-01f1-489a-a968-94aeadb0f95c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.085004 May 24 15:40:45.229686 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1182/2376] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:40:45 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:45.515218 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-9287bdec-599b-43a5-86bc-8c679fbe41d2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:45.515829 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-9287bdec-599b-43a5-86bc-8c679fbe41d2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:45.521897 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9287bdec-599b-43a5-86bc-8c679fbe41d2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:45.522341 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9287bdec-599b-43a5-86bc-8c679fbe41d2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:45.523580 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9287bdec-599b-43a5-86bc-8c679fbe41d2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:45.524010 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9287bdec-599b-43a5-86bc-8c679fbe41d2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:45.651865 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-9287bdec-599b-43a5-86bc-8c679fbe41d2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:45.655299 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:40:45.660532 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-9287bdec-599b-43a5-86bc-8c679fbe41d2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.149086 May 24 15:40:45.661099 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1195/2377] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:45 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:45.716747 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-db7fdfed-f321-4682-ae4c-25c70c24486b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:45.717360 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-db7fdfed-f321-4682-ae4c-25c70c24486b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:45.723347 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-db7fdfed-f321-4682-ae4c-25c70c24486b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:45.723796 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-db7fdfed-f321-4682-ae4c-25c70c24486b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:45.724584 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-db7fdfed-f321-4682-ae4c-25c70c24486b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:45.725019 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-db7fdfed-f321-4682-ae4c-25c70c24486b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:45.852892 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-db7fdfed-f321-4682-ae4c-25c70c24486b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:45.860755 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-db7fdfed-f321-4682-ae4c-25c70c24486b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.147826 May 24 15:40:45.861319 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1183/2378] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:45 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:45.978815 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-a8bcec21-2339-40aa-b0f5-cd3e87943a54 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:45.979424 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-a8bcec21-2339-40aa-b0f5-cd3e87943a54 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:45.985883 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a8bcec21-2339-40aa-b0f5-cd3e87943a54 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:45.986335 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a8bcec21-2339-40aa-b0f5-cd3e87943a54 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:45.987094 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a8bcec21-2339-40aa-b0f5-cd3e87943a54 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:45.987533 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a8bcec21-2339-40aa-b0f5-cd3e87943a54 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:46.124003 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-a8bcec21-2339-40aa-b0f5-cd3e87943a54 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:46.131919 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-a8bcec21-2339-40aa-b0f5-cd3e87943a54 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.157189 May 24 15:40:46.133104 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1196/2379] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:45 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:46.247491 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f8cb2947-4864-4509-b9ae-d154b0c0286c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:46.248103 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f8cb2947-4864-4509-b9ae-d154b0c0286c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:46.254602 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f8cb2947-4864-4509-b9ae-d154b0c0286c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:46.255047 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f8cb2947-4864-4509-b9ae-d154b0c0286c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:46.255809 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f8cb2947-4864-4509-b9ae-d154b0c0286c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:46.256241 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f8cb2947-4864-4509-b9ae-d154b0c0286c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:46.317433 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-f8cb2947-4864-4509-b9ae-d154b0c0286c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:46.326547 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-f8cb2947-4864-4509-b9ae-d154b0c0286c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:46.328042 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-f8cb2947-4864-4509-b9ae-d154b0c0286c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:46.329201 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f8cb2947-4864-4509-b9ae-d154b0c0286c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.085653 May 24 15:40:46.329771 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1184/2380] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:40:46 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:46.677161 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-dbf14192-c31f-4306-abfe-c8ee36e61ed5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:46.677732 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-dbf14192-c31f-4306-abfe-c8ee36e61ed5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:46.684420 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dbf14192-c31f-4306-abfe-c8ee36e61ed5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:46.684866 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dbf14192-c31f-4306-abfe-c8ee36e61ed5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:46.685651 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dbf14192-c31f-4306-abfe-c8ee36e61ed5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:46.686084 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dbf14192-c31f-4306-abfe-c8ee36e61ed5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:46.809576 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-dbf14192-c31f-4306-abfe-c8ee36e61ed5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:46.817440 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-dbf14192-c31f-4306-abfe-c8ee36e61ed5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.144147 May 24 15:40:46.818002 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1197/2381] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:46 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:46.877977 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-400e0eca-c945-41fb-916d-09d17635749e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:46.878583 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-400e0eca-c945-41fb-916d-09d17635749e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:46.884860 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-400e0eca-c945-41fb-916d-09d17635749e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:46.885304 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-400e0eca-c945-41fb-916d-09d17635749e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:46.886051 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-400e0eca-c945-41fb-916d-09d17635749e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:46.886479 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-400e0eca-c945-41fb-916d-09d17635749e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:47.014423 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-400e0eca-c945-41fb-916d-09d17635749e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:47.022328 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-400e0eca-c945-41fb-916d-09d17635749e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.148183 May 24 15:40:47.023417 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1185/2382] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:46 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:47.149067 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-969cadcb-0e3d-4b47-8529-c40260557fda tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:47.149687 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-969cadcb-0e3d-4b47-8529-c40260557fda tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:47.156157 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-969cadcb-0e3d-4b47-8529-c40260557fda tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:47.156629 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-969cadcb-0e3d-4b47-8529-c40260557fda tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:47.157384 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-969cadcb-0e3d-4b47-8529-c40260557fda tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:47.157818 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-969cadcb-0e3d-4b47-8529-c40260557fda tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:47.282127 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-969cadcb-0e3d-4b47-8529-c40260557fda tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:47.289998 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-969cadcb-0e3d-4b47-8529-c40260557fda tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.145430 May 24 15:40:47.290570 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1198/2383] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:47 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:47.346806 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-991f580a-0c45-4bcd-b075-21d0edcb3567 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:47.347415 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-991f580a-0c45-4bcd-b075-21d0edcb3567 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:47.354074 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-991f580a-0c45-4bcd-b075-21d0edcb3567 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:47.354525 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-991f580a-0c45-4bcd-b075-21d0edcb3567 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:47.355281 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-991f580a-0c45-4bcd-b075-21d0edcb3567 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:47.355710 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-991f580a-0c45-4bcd-b075-21d0edcb3567 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:47.421137 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-991f580a-0c45-4bcd-b075-21d0edcb3567 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:47.429417 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-991f580a-0c45-4bcd-b075-21d0edcb3567 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:47.430894 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-991f580a-0c45-4bcd-b075-21d0edcb3567 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:47.432038 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-991f580a-0c45-4bcd-b075-21d0edcb3567 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.089100 May 24 15:40:47.432645 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1186/2384] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:40:47 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:47.833804 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-34e800ed-a526-4285-9ccf-62c4bbb89ae6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:47.834416 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-34e800ed-a526-4285-9ccf-62c4bbb89ae6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:47.840573 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-34e800ed-a526-4285-9ccf-62c4bbb89ae6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:47.841028 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-34e800ed-a526-4285-9ccf-62c4bbb89ae6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:47.841784 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-34e800ed-a526-4285-9ccf-62c4bbb89ae6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:47.842222 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-34e800ed-a526-4285-9ccf-62c4bbb89ae6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:47.970079 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-34e800ed-a526-4285-9ccf-62c4bbb89ae6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:47.978482 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-34e800ed-a526-4285-9ccf-62c4bbb89ae6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.148485 May 24 15:40:47.979050 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1199/2385] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:47 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:48.039514 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-c7fdc144-b8df-4d09-9ffa-18fa8f5385b7 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:48.040122 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-c7fdc144-b8df-4d09-9ffa-18fa8f5385b7 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:48.046455 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c7fdc144-b8df-4d09-9ffa-18fa8f5385b7 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:48.046902 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c7fdc144-b8df-4d09-9ffa-18fa8f5385b7 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:48.047659 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c7fdc144-b8df-4d09-9ffa-18fa8f5385b7 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:48.048093 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c7fdc144-b8df-4d09-9ffa-18fa8f5385b7 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:48.172338 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-c7fdc144-b8df-4d09-9ffa-18fa8f5385b7 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:48.175709 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:40:48.181903 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-c7fdc144-b8df-4d09-9ffa-18fa8f5385b7 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.146691 May 24 15:40:48.182464 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1187/2386] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:48 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:48.306554 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e858423e-0e61-4b55-a9f9-9609dfc28da5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:48.307160 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e858423e-0e61-4b55-a9f9-9609dfc28da5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:48.313557 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e858423e-0e61-4b55-a9f9-9609dfc28da5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:48.313999 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e858423e-0e61-4b55-a9f9-9609dfc28da5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:48.314742 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e858423e-0e61-4b55-a9f9-9609dfc28da5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:48.315170 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e858423e-0e61-4b55-a9f9-9609dfc28da5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:48.444526 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e858423e-0e61-4b55-a9f9-9609dfc28da5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:48.450414 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-04d2b503-a498-45d9-93dd-c7088126a4fd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:48.451024 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-04d2b503-a498-45d9-93dd-c7088126a4fd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:48.452862 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e858423e-0e61-4b55-a9f9-9609dfc28da5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.150137 May 24 15:40:48.453427 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1200/2387] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:48 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:48.457631 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-04d2b503-a498-45d9-93dd-c7088126a4fd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:48.458070 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-04d2b503-a498-45d9-93dd-c7088126a4fd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:48.458824 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-04d2b503-a498-45d9-93dd-c7088126a4fd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:48.459259 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-04d2b503-a498-45d9-93dd-c7088126a4fd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:48.519330 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-04d2b503-a498-45d9-93dd-c7088126a4fd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:48.528021 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-04d2b503-a498-45d9-93dd-c7088126a4fd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:48.529537 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-04d2b503-a498-45d9-93dd-c7088126a4fd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:48.530661 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-04d2b503-a498-45d9-93dd-c7088126a4fd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084406 May 24 15:40:48.531215 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1188/2388] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:40:48 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:40:48.995502 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d24aa739-3efe-481b-9c42-c0d606f3b446 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:48.996116 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d24aa739-3efe-481b-9c42-c0d606f3b446 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:49.002170 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d24aa739-3efe-481b-9c42-c0d606f3b446 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:49.002621 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d24aa739-3efe-481b-9c42-c0d606f3b446 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:49.003380 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d24aa739-3efe-481b-9c42-c0d606f3b446 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:49.003822 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d24aa739-3efe-481b-9c42-c0d606f3b446 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:49.131983 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-d24aa739-3efe-481b-9c42-c0d606f3b446 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:49.140548 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d24aa739-3efe-481b-9c42-c0d606f3b446 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.149575 May 24 15:40:49.141141 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1201/2389] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:48 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:49.199291 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-5d18fd06-baec-4c38-839f-44bd725a85c9 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:49.199904 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-5d18fd06-baec-4c38-839f-44bd725a85c9 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:49.205954 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5d18fd06-baec-4c38-839f-44bd725a85c9 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:49.206399 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5d18fd06-baec-4c38-839f-44bd725a85c9 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:49.207152 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5d18fd06-baec-4c38-839f-44bd725a85c9 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:49.207586 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5d18fd06-baec-4c38-839f-44bd725a85c9 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:49.333820 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-5d18fd06-baec-4c38-839f-44bd725a85c9 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:49.341849 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-5d18fd06-baec-4c38-839f-44bd725a85c9 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.147004 May 24 15:40:49.342414 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1189/2390] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:49 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:49.470116 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-92f785cb-5156-4acd-adca-9950973d32c5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:49.470727 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-92f785cb-5156-4acd-adca-9950973d32c5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:49.477196 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-92f785cb-5156-4acd-adca-9950973d32c5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:49.477644 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-92f785cb-5156-4acd-adca-9950973d32c5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:49.478397 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-92f785cb-5156-4acd-adca-9950973d32c5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:49.478834 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-92f785cb-5156-4acd-adca-9950973d32c5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:49.548345 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a0983a57-5ef6-47e6-a0e1-f8f569889051 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:49.548923 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a0983a57-5ef6-47e6-a0e1-f8f569889051 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:49.555316 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a0983a57-5ef6-47e6-a0e1-f8f569889051 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:49.555765 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a0983a57-5ef6-47e6-a0e1-f8f569889051 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:49.556551 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a0983a57-5ef6-47e6-a0e1-f8f569889051 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:49.556987 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a0983a57-5ef6-47e6-a0e1-f8f569889051 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:49.606305 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-92f785cb-5156-4acd-adca-9950973d32c5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:49.614420 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-92f785cb-5156-4acd-adca-9950973d32c5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.148098 May 24 15:40:49.615195 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1202/2391] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:49 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:49.617609 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-a0983a57-5ef6-47e6-a0e1-f8f569889051 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:49.626101 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-a0983a57-5ef6-47e6-a0e1-f8f569889051 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:49.627593 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-a0983a57-5ef6-47e6-a0e1-f8f569889051 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:49.628771 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a0983a57-5ef6-47e6-a0e1-f8f569889051 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084440 May 24 15:40:49.629361 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1190/2392] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:40:49 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:40:50.157367 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e758c6e1-4de0-4a11-a65b-478df7d4aa6c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:50.158003 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e758c6e1-4de0-4a11-a65b-478df7d4aa6c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:50.164523 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e758c6e1-4de0-4a11-a65b-478df7d4aa6c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:50.164970 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e758c6e1-4de0-4a11-a65b-478df7d4aa6c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:50.165708 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e758c6e1-4de0-4a11-a65b-478df7d4aa6c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:50.166132 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e758c6e1-4de0-4a11-a65b-478df7d4aa6c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:50.294714 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e758c6e1-4de0-4a11-a65b-478df7d4aa6c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:50.302923 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e758c6e1-4de0-4a11-a65b-478df7d4aa6c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.149380 May 24 15:40:50.303477 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1203/2393] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:50 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:50.358796 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-ba6e6a97-5183-4b24-b4b7-5095b0e5cdee tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:50.359344 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-ba6e6a97-5183-4b24-b4b7-5095b0e5cdee tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:50.365493 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ba6e6a97-5183-4b24-b4b7-5095b0e5cdee tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:50.366192 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ba6e6a97-5183-4b24-b4b7-5095b0e5cdee tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:50.367572 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ba6e6a97-5183-4b24-b4b7-5095b0e5cdee tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:50.368010 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ba6e6a97-5183-4b24-b4b7-5095b0e5cdee tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:50.493676 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-ba6e6a97-5183-4b24-b4b7-5095b0e5cdee tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:50.501560 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-ba6e6a97-5183-4b24-b4b7-5095b0e5cdee tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.146667 May 24 15:40:50.502127 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1191/2394] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:50 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:50.631533 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-0c6bd1ce-9cef-4ef6-83e6-1ef9f00d5abd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:50.632065 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-0c6bd1ce-9cef-4ef6-83e6-1ef9f00d5abd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:50.638382 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0c6bd1ce-9cef-4ef6-83e6-1ef9f00d5abd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:50.638823 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0c6bd1ce-9cef-4ef6-83e6-1ef9f00d5abd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:50.639572 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0c6bd1ce-9cef-4ef6-83e6-1ef9f00d5abd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:50.640001 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0c6bd1ce-9cef-4ef6-83e6-1ef9f00d5abd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:50.647123 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-093ff183-8d1d-4549-927c-28a0b9d76485 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:50.648474 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-093ff183-8d1d-4549-927c-28a0b9d76485 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:50.654699 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-093ff183-8d1d-4549-927c-28a0b9d76485 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:50.655181 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-093ff183-8d1d-4549-927c-28a0b9d76485 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:50.655942 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-093ff183-8d1d-4549-927c-28a0b9d76485 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:50.656396 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-093ff183-8d1d-4549-927c-28a0b9d76485 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:50.720886 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-093ff183-8d1d-4549-927c-28a0b9d76485 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:50.730285 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-093ff183-8d1d-4549-927c-28a0b9d76485 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:50.731785 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-093ff183-8d1d-4549-927c-28a0b9d76485 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:50.732975 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-093ff183-8d1d-4549-927c-28a0b9d76485 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.090090 May 24 15:40:50.733542 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1192/2395] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:40:50 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:40:50.766924 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-0c6bd1ce-9cef-4ef6-83e6-1ef9f00d5abd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:50.775389 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-0c6bd1ce-9cef-4ef6-83e6-1ef9f00d5abd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.147835 May 24 15:40:50.775936 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1204/2396] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:50 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:51.320252 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-959ab75e-a1b1-4d8c-9b22-29401e208f0a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:51.320829 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-959ab75e-a1b1-4d8c-9b22-29401e208f0a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:51.327016 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-959ab75e-a1b1-4d8c-9b22-29401e208f0a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:51.327458 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-959ab75e-a1b1-4d8c-9b22-29401e208f0a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:51.328207 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-959ab75e-a1b1-4d8c-9b22-29401e208f0a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:51.328668 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-959ab75e-a1b1-4d8c-9b22-29401e208f0a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:51.453171 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-959ab75e-a1b1-4d8c-9b22-29401e208f0a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:51.461113 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-959ab75e-a1b1-4d8c-9b22-29401e208f0a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.145407 May 24 15:40:51.461675 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1193/2397] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:51 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:51.518423 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-4077d15e-acee-4d33-ac67-9922d3e2c1dd tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:51.519066 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-4077d15e-acee-4d33-ac67-9922d3e2c1dd tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:51.525093 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4077d15e-acee-4d33-ac67-9922d3e2c1dd tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:51.525542 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4077d15e-acee-4d33-ac67-9922d3e2c1dd tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:51.526287 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4077d15e-acee-4d33-ac67-9922d3e2c1dd tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:51.526716 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4077d15e-acee-4d33-ac67-9922d3e2c1dd tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:51.653135 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-4077d15e-acee-4d33-ac67-9922d3e2c1dd tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:51.661130 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-4077d15e-acee-4d33-ac67-9922d3e2c1dd tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.146608 May 24 15:40:51.661686 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1205/2398] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:51 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:51.751620 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-9a26bb6a-7328-4417-a136-573bbc0a227a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:51.752251 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-9a26bb6a-7328-4417-a136-573bbc0a227a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:51.758661 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9a26bb6a-7328-4417-a136-573bbc0a227a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:51.759100 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9a26bb6a-7328-4417-a136-573bbc0a227a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:51.759844 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9a26bb6a-7328-4417-a136-573bbc0a227a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:51.760272 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9a26bb6a-7328-4417-a136-573bbc0a227a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:51.792372 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-7c4cf8d4-0d2c-4cb1-b706-7c4a1a6d9e42 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:51.792989 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-7c4cf8d4-0d2c-4cb1-b706-7c4a1a6d9e42 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:51.798981 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7c4cf8d4-0d2c-4cb1-b706-7c4a1a6d9e42 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:51.799435 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7c4cf8d4-0d2c-4cb1-b706-7c4a1a6d9e42 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:51.800198 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7c4cf8d4-0d2c-4cb1-b706-7c4a1a6d9e42 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:51.800667 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7c4cf8d4-0d2c-4cb1-b706-7c4a1a6d9e42 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:51.822385 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-9a26bb6a-7328-4417-a136-573bbc0a227a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:51.830803 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-9a26bb6a-7328-4417-a136-573bbc0a227a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:51.832406 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-9a26bb6a-7328-4417-a136-573bbc0a227a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:51.833657 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-9a26bb6a-7328-4417-a136-573bbc0a227a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.085906 May 24 15:40:51.834643 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1194/2399] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:40:51 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:51.930117 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-7c4cf8d4-0d2c-4cb1-b706-7c4a1a6d9e42 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:51.938029 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-7c4cf8d4-0d2c-4cb1-b706-7c4a1a6d9e42 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.149913 May 24 15:40:51.938593 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1206/2400] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:51 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:40:52.478272 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-150b6858-0927-4793-a85a-a79e5db6b22c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:52.478881 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-150b6858-0927-4793-a85a-a79e5db6b22c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:52.484929 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-150b6858-0927-4793-a85a-a79e5db6b22c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:52.485366 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-150b6858-0927-4793-a85a-a79e5db6b22c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:52.486116 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-150b6858-0927-4793-a85a-a79e5db6b22c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:52.486544 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-150b6858-0927-4793-a85a-a79e5db6b22c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:52.614802 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-150b6858-0927-4793-a85a-a79e5db6b22c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:52.623629 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-150b6858-0927-4793-a85a-a79e5db6b22c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.149724 May 24 15:40:52.624189 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1195/2401] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:52 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:52.678641 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-93de66ad-4e76-4137-b4d3-9ff6fb7d2874 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:52.679824 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-93de66ad-4e76-4137-b4d3-9ff6fb7d2874 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:52.690119 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-93de66ad-4e76-4137-b4d3-9ff6fb7d2874 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:52.690567 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-93de66ad-4e76-4137-b4d3-9ff6fb7d2874 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:52.691350 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-93de66ad-4e76-4137-b4d3-9ff6fb7d2874 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:52.691786 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-93de66ad-4e76-4137-b4d3-9ff6fb7d2874 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:52.817829 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-93de66ad-4e76-4137-b4d3-9ff6fb7d2874 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:52.825805 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-93de66ad-4e76-4137-b4d3-9ff6fb7d2874 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.151074 May 24 15:40:52.826366 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1207/2402] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:52 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:52.851389 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-6d97ab57-a5b1-44d0-b075-246f86250266 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:52.851995 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-6d97ab57-a5b1-44d0-b075-246f86250266 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:52.858365 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6d97ab57-a5b1-44d0-b075-246f86250266 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:52.858794 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6d97ab57-a5b1-44d0-b075-246f86250266 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:52.859538 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6d97ab57-a5b1-44d0-b075-246f86250266 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:52.859966 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6d97ab57-a5b1-44d0-b075-246f86250266 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:52.920356 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-6d97ab57-a5b1-44d0-b075-246f86250266 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:52.928672 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-6d97ab57-a5b1-44d0-b075-246f86250266 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:52.930174 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-6d97ab57-a5b1-44d0-b075-246f86250266 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:52.931305 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-6d97ab57-a5b1-44d0-b075-246f86250266 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084401 May 24 15:40:52.931858 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1196/2403] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:40:52 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:52.954651 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-ad99c51d-650e-4cf8-8653-616df857348a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:52.955261 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-ad99c51d-650e-4cf8-8653-616df857348a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:52.961703 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ad99c51d-650e-4cf8-8653-616df857348a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:52.962148 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ad99c51d-650e-4cf8-8653-616df857348a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:52.962899 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ad99c51d-650e-4cf8-8653-616df857348a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:52.963330 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ad99c51d-650e-4cf8-8653-616df857348a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:53.096871 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ad99c51d-650e-4cf8-8653-616df857348a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:53.104741 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-ad99c51d-650e-4cf8-8653-616df857348a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.153803 May 24 15:40:53.105298 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1208/2404] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:52 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:53.640512 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-605cec10-2ef2-4fce-818f-b88acb3384d9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:53.641129 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-605cec10-2ef2-4fce-818f-b88acb3384d9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:53.647238 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-605cec10-2ef2-4fce-818f-b88acb3384d9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:53.647682 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-605cec10-2ef2-4fce-818f-b88acb3384d9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:53.648498 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-605cec10-2ef2-4fce-818f-b88acb3384d9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:53.648933 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-605cec10-2ef2-4fce-818f-b88acb3384d9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:53.774020 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-605cec10-2ef2-4fce-818f-b88acb3384d9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:53.781943 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-605cec10-2ef2-4fce-818f-b88acb3384d9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.145296 May 24 15:40:53.782493 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1197/2405] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:53 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:53.842982 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-1273128e-6c4b-4aff-9a90-a281369ce4c3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:53.843601 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-1273128e-6c4b-4aff-9a90-a281369ce4c3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:53.850058 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1273128e-6c4b-4aff-9a90-a281369ce4c3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:53.850501 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1273128e-6c4b-4aff-9a90-a281369ce4c3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:53.851743 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1273128e-6c4b-4aff-9a90-a281369ce4c3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:53.852167 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1273128e-6c4b-4aff-9a90-a281369ce4c3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:53.949302 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-376597b3-1df7-4fa1-92b3-3d2c47810670 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:53.950210 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-376597b3-1df7-4fa1-92b3-3d2c47810670 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:53.956733 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-376597b3-1df7-4fa1-92b3-3d2c47810670 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:53.957183 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-376597b3-1df7-4fa1-92b3-3d2c47810670 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:53.957976 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-376597b3-1df7-4fa1-92b3-3d2c47810670 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:53.958624 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-376597b3-1df7-4fa1-92b3-3d2c47810670 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:53.980636 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-1273128e-6c4b-4aff-9a90-a281369ce4c3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:53.988731 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-1273128e-6c4b-4aff-9a90-a281369ce4c3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.149472 May 24 15:40:53.989307 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1209/2406] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:53 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:54.023484 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-376597b3-1df7-4fa1-92b3-3d2c47810670 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:54.031906 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-376597b3-1df7-4fa1-92b3-3d2c47810670 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:54.033451 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-376597b3-1df7-4fa1-92b3-3d2c47810670 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:54.034593 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-376597b3-1df7-4fa1-92b3-3d2c47810670 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.089310 May 24 15:40:54.035154 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1198/2407] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:40:53 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:40:54.122294 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-afc42982-e237-416b-a686-b4f90e2b514a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:54.123027 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-afc42982-e237-416b-a686-b4f90e2b514a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:54.130036 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-afc42982-e237-416b-a686-b4f90e2b514a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:54.130523 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-afc42982-e237-416b-a686-b4f90e2b514a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:54.131293 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-afc42982-e237-416b-a686-b4f90e2b514a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:54.131729 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-afc42982-e237-416b-a686-b4f90e2b514a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:54.256596 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-afc42982-e237-416b-a686-b4f90e2b514a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:54.264663 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-afc42982-e237-416b-a686-b4f90e2b514a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.146266 May 24 15:40:54.265233 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1210/2408] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:54 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:54.797940 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-36683d95-72fc-4b28-adff-5ccf054eaf81 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:54.798545 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-36683d95-72fc-4b28-adff-5ccf054eaf81 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:54.804645 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-36683d95-72fc-4b28-adff-5ccf054eaf81 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:54.805095 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-36683d95-72fc-4b28-adff-5ccf054eaf81 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:54.805844 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-36683d95-72fc-4b28-adff-5ccf054eaf81 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:54.806274 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-36683d95-72fc-4b28-adff-5ccf054eaf81 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:54.931523 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-36683d95-72fc-4b28-adff-5ccf054eaf81 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:54.939406 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-36683d95-72fc-4b28-adff-5ccf054eaf81 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.145314 May 24 15:40:54.940006 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1199/2409] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:54 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:55.006438 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c5218ea4-0123-433a-a2aa-af13537fb4f1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:55.007516 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-c5218ea4-0123-433a-a2aa-af13537fb4f1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:55.014002 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c5218ea4-0123-433a-a2aa-af13537fb4f1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:55.014455 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c5218ea4-0123-433a-a2aa-af13537fb4f1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:55.015214 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c5218ea4-0123-433a-a2aa-af13537fb4f1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:55.015647 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c5218ea4-0123-433a-a2aa-af13537fb4f1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:55.052825 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-02131963-6195-4b6d-9137-d4a5e2f86f4b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:55.053336 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-02131963-6195-4b6d-9137-d4a5e2f86f4b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:55.060438 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-02131963-6195-4b6d-9137-d4a5e2f86f4b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:55.060885 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-02131963-6195-4b6d-9137-d4a5e2f86f4b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:55.061655 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-02131963-6195-4b6d-9137-d4a5e2f86f4b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:55.062088 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-02131963-6195-4b6d-9137-d4a5e2f86f4b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:55.124821 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-02131963-6195-4b6d-9137-d4a5e2f86f4b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:55.133950 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-02131963-6195-4b6d-9137-d4a5e2f86f4b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:55.135536 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-02131963-6195-4b6d-9137-d4a5e2f86f4b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:55.136800 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-02131963-6195-4b6d-9137-d4a5e2f86f4b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.087938 May 24 15:40:55.137363 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1200/2410] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:40:55 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:40:55.148238 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-c5218ea4-0123-433a-a2aa-af13537fb4f1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:55.156188 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-c5218ea4-0123-433a-a2aa-af13537fb4f1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.153720 May 24 15:40:55.156777 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1211/2411] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:55 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:55.281976 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-60d9a204-eb26-41c9-a9eb-28e6be77dabd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:55.282583 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-60d9a204-eb26-41c9-a9eb-28e6be77dabd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:55.288515 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-60d9a204-eb26-41c9-a9eb-28e6be77dabd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:55.288955 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-60d9a204-eb26-41c9-a9eb-28e6be77dabd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:55.289697 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-60d9a204-eb26-41c9-a9eb-28e6be77dabd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:55.290152 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-60d9a204-eb26-41c9-a9eb-28e6be77dabd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:55.419363 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-60d9a204-eb26-41c9-a9eb-28e6be77dabd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:55.427786 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-60d9a204-eb26-41c9-a9eb-28e6be77dabd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.149553 May 24 15:40:55.428384 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1201/2412] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:55 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:55.956453 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-609da5a7-6772-41e1-9b0d-09eef65085aa tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:55.957064 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-609da5a7-6772-41e1-9b0d-09eef65085aa tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:55.963162 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-609da5a7-6772-41e1-9b0d-09eef65085aa tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:55.963615 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-609da5a7-6772-41e1-9b0d-09eef65085aa tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:55.964385 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-609da5a7-6772-41e1-9b0d-09eef65085aa tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:55.964820 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-609da5a7-6772-41e1-9b0d-09eef65085aa tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:55.982359 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:40:56.091242 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-609da5a7-6772-41e1-9b0d-09eef65085aa tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:56.099387 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-609da5a7-6772-41e1-9b0d-09eef65085aa tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.146794 May 24 15:40:56.099945 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1212/2413] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:55 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:56.154404 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-95f94bff-5862-4884-906d-8577bcf1b89a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:56.155009 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-95f94bff-5862-4884-906d-8577bcf1b89a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:56.161619 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-95f94bff-5862-4884-906d-8577bcf1b89a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:56.162060 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-95f94bff-5862-4884-906d-8577bcf1b89a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:56.162809 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-95f94bff-5862-4884-906d-8577bcf1b89a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:56.163720 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-95f94bff-5862-4884-906d-8577bcf1b89a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:56.172840 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d67bec2f-65ed-4646-be0b-4d0031cc558d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:56.173440 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d67bec2f-65ed-4646-be0b-4d0031cc558d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:56.179843 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d67bec2f-65ed-4646-be0b-4d0031cc558d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:56.180281 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d67bec2f-65ed-4646-be0b-4d0031cc558d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:56.181055 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d67bec2f-65ed-4646-be0b-4d0031cc558d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:56.181480 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d67bec2f-65ed-4646-be0b-4d0031cc558d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:56.226445 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-95f94bff-5862-4884-906d-8577bcf1b89a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:56.234900 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-95f94bff-5862-4884-906d-8577bcf1b89a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:56.236415 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-95f94bff-5862-4884-906d-8577bcf1b89a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:56.237560 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-95f94bff-5862-4884-906d-8577bcf1b89a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.087064 May 24 15:40:56.238118 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1202/2414] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:40:56 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:56.312086 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-d67bec2f-65ed-4646-be0b-4d0031cc558d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:56.320244 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d67bec2f-65ed-4646-be0b-4d0031cc558d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.151077 May 24 15:40:56.320844 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1213/2415] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:56 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:40:56.444478 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-fb8a9029-b017-4161-8cc9-92f837d1868b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:56.445098 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-fb8a9029-b017-4161-8cc9-92f837d1868b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:56.451166 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fb8a9029-b017-4161-8cc9-92f837d1868b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:56.451612 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fb8a9029-b017-4161-8cc9-92f837d1868b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:56.452387 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fb8a9029-b017-4161-8cc9-92f837d1868b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:56.452826 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fb8a9029-b017-4161-8cc9-92f837d1868b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:56.576059 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-fb8a9029-b017-4161-8cc9-92f837d1868b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:56.583941 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-fb8a9029-b017-4161-8cc9-92f837d1868b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.143306 May 24 15:40:56.584533 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1203/2416] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:56 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:57.118021 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-b717d43d-80c9-4c62-81fa-890abd250ded tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:57.118641 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-b717d43d-80c9-4c62-81fa-890abd250ded tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:57.125162 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b717d43d-80c9-4c62-81fa-890abd250ded tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:57.125614 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b717d43d-80c9-4c62-81fa-890abd250ded tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:57.126377 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b717d43d-80c9-4c62-81fa-890abd250ded tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:57.126813 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b717d43d-80c9-4c62-81fa-890abd250ded tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:57.250014 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-b717d43d-80c9-4c62-81fa-890abd250ded tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:57.257059 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-141abdba-adbd-4315-8004-b31ae0eb6c30 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:57.257665 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-141abdba-adbd-4315-8004-b31ae0eb6c30 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:57.258509 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-b717d43d-80c9-4c62-81fa-890abd250ded tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.145144 May 24 15:40:57.259083 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1214/2417] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:57 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:57.264076 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-141abdba-adbd-4315-8004-b31ae0eb6c30 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:57.264548 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-141abdba-adbd-4315-8004-b31ae0eb6c30 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:57.265312 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-141abdba-adbd-4315-8004-b31ae0eb6c30 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:57.265745 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-141abdba-adbd-4315-8004-b31ae0eb6c30 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:57.283789 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:40:57.330687 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-141abdba-adbd-4315-8004-b31ae0eb6c30 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:57.338243 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-8ee5d9d5-95d9-4f62-8d75-89223c31eb08 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:57.338860 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-8ee5d9d5-95d9-4f62-8d75-89223c31eb08 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:57.339743 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-141abdba-adbd-4315-8004-b31ae0eb6c30 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:57.341273 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-141abdba-adbd-4315-8004-b31ae0eb6c30 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:57.342422 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-141abdba-adbd-4315-8004-b31ae0eb6c30 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.090515 May 24 15:40:57.342984 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1204/2418] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:40:57 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:40:57.345083 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8ee5d9d5-95d9-4f62-8d75-89223c31eb08 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:57.345540 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8ee5d9d5-95d9-4f62-8d75-89223c31eb08 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:57.346307 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8ee5d9d5-95d9-4f62-8d75-89223c31eb08 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:57.346747 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8ee5d9d5-95d9-4f62-8d75-89223c31eb08 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:57.473764 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-8ee5d9d5-95d9-4f62-8d75-89223c31eb08 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:57.482255 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-8ee5d9d5-95d9-4f62-8d75-89223c31eb08 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.148337 May 24 15:40:57.482820 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1215/2419] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:57 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:40:57.601045 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f65c312f-5612-4ed5-96a6-c44bb7fe4b3c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:57.601721 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f65c312f-5612-4ed5-96a6-c44bb7fe4b3c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:57.608007 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f65c312f-5612-4ed5-96a6-c44bb7fe4b3c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:57.608500 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f65c312f-5612-4ed5-96a6-c44bb7fe4b3c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:57.609250 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f65c312f-5612-4ed5-96a6-c44bb7fe4b3c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:57.609679 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f65c312f-5612-4ed5-96a6-c44bb7fe4b3c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:57.736002 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-f65c312f-5612-4ed5-96a6-c44bb7fe4b3c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:57.744142 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f65c312f-5612-4ed5-96a6-c44bb7fe4b3c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.146947 May 24 15:40:57.744735 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1205/2420] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:57 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:58.275043 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-08788efb-18d5-40c2-ae0a-03afa84c297e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:58.275648 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-08788efb-18d5-40c2-ae0a-03afa84c297e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:58.282173 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-08788efb-18d5-40c2-ae0a-03afa84c297e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:58.282610 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-08788efb-18d5-40c2-ae0a-03afa84c297e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:58.283356 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-08788efb-18d5-40c2-ae0a-03afa84c297e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:58.283790 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-08788efb-18d5-40c2-ae0a-03afa84c297e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:58.360172 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-00f1c913-f32f-4b49-b701-8788f864c15b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:58.360817 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-00f1c913-f32f-4b49-b701-8788f864c15b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:58.368386 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-00f1c913-f32f-4b49-b701-8788f864c15b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:58.368836 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-00f1c913-f32f-4b49-b701-8788f864c15b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:58.369599 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-00f1c913-f32f-4b49-b701-8788f864c15b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:58.370032 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-00f1c913-f32f-4b49-b701-8788f864c15b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:58.409443 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-08788efb-18d5-40c2-ae0a-03afa84c297e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:58.419100 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-08788efb-18d5-40c2-ae0a-03afa84c297e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.147858 May 24 15:40:58.419676 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1216/2421] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:58 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:58.431765 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-00f1c913-f32f-4b49-b701-8788f864c15b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:58.440244 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-00f1c913-f32f-4b49-b701-8788f864c15b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:58.441780 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-00f1c913-f32f-4b49-b701-8788f864c15b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:58.442922 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-00f1c913-f32f-4b49-b701-8788f864c15b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.087110 May 24 15:40:58.443483 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1206/2422] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:40:58 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:40:58.499109 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-a4da5c31-7805-46c1-99d9-c1a1f7a0fe82 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:58.499726 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-a4da5c31-7805-46c1-99d9-c1a1f7a0fe82 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:58.505693 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a4da5c31-7805-46c1-99d9-c1a1f7a0fe82 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:58.506137 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a4da5c31-7805-46c1-99d9-c1a1f7a0fe82 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:58.506963 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a4da5c31-7805-46c1-99d9-c1a1f7a0fe82 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:58.507453 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a4da5c31-7805-46c1-99d9-c1a1f7a0fe82 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:58.633542 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-a4da5c31-7805-46c1-99d9-c1a1f7a0fe82 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:58.641478 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-a4da5c31-7805-46c1-99d9-c1a1f7a0fe82 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.146113 May 24 15:40:58.642043 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1217/2423] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:58 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:58.761036 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-6b99eb32-eb47-474b-92d6-cc7eaf30d15e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:58.761903 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-6b99eb32-eb47-474b-92d6-cc7eaf30d15e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:58.763802 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_api:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:40:58.769364 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6b99eb32-eb47-474b-92d6-cc7eaf30d15e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:58.769812 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6b99eb32-eb47-474b-92d6-cc7eaf30d15e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:58.770573 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6b99eb32-eb47-474b-92d6-cc7eaf30d15e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:58.771010 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6b99eb32-eb47-474b-92d6-cc7eaf30d15e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:58.898323 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-6b99eb32-eb47-474b-92d6-cc7eaf30d15e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:58.906163 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-6b99eb32-eb47-474b-92d6-cc7eaf30d15e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.149548 May 24 15:40:58.906740 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1207/2424] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:58 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:59.436062 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-bc29ff6b-0285-46b9-b10d-a5aed5cf6e8f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:59.436696 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-bc29ff6b-0285-46b9-b10d-a5aed5cf6e8f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:59.443263 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bc29ff6b-0285-46b9-b10d-a5aed5cf6e8f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:59.443702 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bc29ff6b-0285-46b9-b10d-a5aed5cf6e8f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:59.444475 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bc29ff6b-0285-46b9-b10d-a5aed5cf6e8f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:59.444905 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bc29ff6b-0285-46b9-b10d-a5aed5cf6e8f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:59.461019 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-756e3b9b-e537-4b75-81aa-90ad298f0b1e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:59.461654 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-756e3b9b-e537-4b75-81aa-90ad298f0b1e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:59.468065 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-756e3b9b-e537-4b75-81aa-90ad298f0b1e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:59.468544 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-756e3b9b-e537-4b75-81aa-90ad298f0b1e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:59.469308 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-756e3b9b-e537-4b75-81aa-90ad298f0b1e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:59.469747 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-756e3b9b-e537-4b75-81aa-90ad298f0b1e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:59.530816 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-756e3b9b-e537-4b75-81aa-90ad298f0b1e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:59.540023 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-756e3b9b-e537-4b75-81aa-90ad298f0b1e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:59.541552 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-756e3b9b-e537-4b75-81aa-90ad298f0b1e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:59.542732 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-756e3b9b-e537-4b75-81aa-90ad298f0b1e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.086113 May 24 15:40:59.543302 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1208/2425] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:40:59 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:40:59.574374 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-bc29ff6b-0285-46b9-b10d-a5aed5cf6e8f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:59.582233 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-bc29ff6b-0285-46b9-b10d-a5aed5cf6e8f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.150081 May 24 15:40:59.582787 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1218/2426] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:59 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:59.658221 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-bd0ddf54-1d84-4158-b7f6-2c82cae2726d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:59.658867 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-bd0ddf54-1d84-4158-b7f6-2c82cae2726d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:59.665012 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bd0ddf54-1d84-4158-b7f6-2c82cae2726d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:59.665480 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bd0ddf54-1d84-4158-b7f6-2c82cae2726d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:59.666244 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bd0ddf54-1d84-4158-b7f6-2c82cae2726d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:59.666678 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bd0ddf54-1d84-4158-b7f6-2c82cae2726d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:59.789954 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-bd0ddf54-1d84-4158-b7f6-2c82cae2726d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:59.797871 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-bd0ddf54-1d84-4158-b7f6-2c82cae2726d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.143417 May 24 15:40:59.798436 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1209/2427] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:59 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:59.923179 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-cb5f6f1a-e892-4400-85b9-d6d4ba9b4494 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:59.923788 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-cb5f6f1a-e892-4400-85b9-d6d4ba9b4494 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:59.930183 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cb5f6f1a-e892-4400-85b9-d6d4ba9b4494 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:59.930627 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cb5f6f1a-e892-4400-85b9-d6d4ba9b4494 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:59.931372 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cb5f6f1a-e892-4400-85b9-d6d4ba9b4494 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:59.931799 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cb5f6f1a-e892-4400-85b9-d6d4ba9b4494 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:00.055933 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-cb5f6f1a-e892-4400-85b9-d6d4ba9b4494 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:00.063707 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-cb5f6f1a-e892-4400-85b9-d6d4ba9b4494 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.144290 May 24 15:41:00.064263 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1219/2428] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:40:59 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:00.560754 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e4b5c129-227e-45f7-b07a-888d6bb1b05c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:00.561367 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-e4b5c129-227e-45f7-b07a-888d6bb1b05c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:00.567884 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e4b5c129-227e-45f7-b07a-888d6bb1b05c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:00.568354 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e4b5c129-227e-45f7-b07a-888d6bb1b05c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:00.569152 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e4b5c129-227e-45f7-b07a-888d6bb1b05c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:00.569548 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e4b5c129-227e-45f7-b07a-888d6bb1b05c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:00.598762 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c1382516-4fe2-485f-8480-21cf30241727 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:00.599574 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-c1382516-4fe2-485f-8480-21cf30241727 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:00.602493 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_api:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:41:00.607992 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c1382516-4fe2-485f-8480-21cf30241727 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:00.608474 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c1382516-4fe2-485f-8480-21cf30241727 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:00.609242 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c1382516-4fe2-485f-8480-21cf30241727 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:00.609674 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c1382516-4fe2-485f-8480-21cf30241727 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:00.635999 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-e4b5c129-227e-45f7-b07a-888d6bb1b05c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:00.645087 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-e4b5c129-227e-45f7-b07a-888d6bb1b05c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:00.646655 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-e4b5c129-227e-45f7-b07a-888d6bb1b05c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:00.648396 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-e4b5c129-227e-45f7-b07a-888d6bb1b05c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.091583 May 24 15:41:00.649065 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1210/2429] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:41:00 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:00.738309 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-c1382516-4fe2-485f-8480-21cf30241727 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:00.746748 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-c1382516-4fe2-485f-8480-21cf30241727 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.151736 May 24 15:41:00.747321 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1220/2430] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:00 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:41:00.814037 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e401ad81-d7d2-413b-9fd1-b1f3a7c53ba1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:00.814592 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-e401ad81-d7d2-413b-9fd1-b1f3a7c53ba1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:00.820608 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e401ad81-d7d2-413b-9fd1-b1f3a7c53ba1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:00.821062 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e401ad81-d7d2-413b-9fd1-b1f3a7c53ba1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:00.821856 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e401ad81-d7d2-413b-9fd1-b1f3a7c53ba1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:00.822295 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e401ad81-d7d2-413b-9fd1-b1f3a7c53ba1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:00.948267 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-e401ad81-d7d2-413b-9fd1-b1f3a7c53ba1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:00.956964 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-e401ad81-d7d2-413b-9fd1-b1f3a7c53ba1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.146398 May 24 15:41:00.957682 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1211/2431] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:00 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:01.081178 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-fa7147ff-742c-4ccb-8b25-9dd838d7e235 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:01.081783 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-fa7147ff-742c-4ccb-8b25-9dd838d7e235 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:01.087742 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fa7147ff-742c-4ccb-8b25-9dd838d7e235 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:01.088184 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fa7147ff-742c-4ccb-8b25-9dd838d7e235 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:01.088960 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fa7147ff-742c-4ccb-8b25-9dd838d7e235 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:01.089390 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fa7147ff-742c-4ccb-8b25-9dd838d7e235 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:01.216263 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-fa7147ff-742c-4ccb-8b25-9dd838d7e235 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:01.224137 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-fa7147ff-742c-4ccb-8b25-9dd838d7e235 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.146837 May 24 15:41:01.224729 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1221/2432] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:01 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:01.665932 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-84698679-0be4-4503-a310-7352ad2719d8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:01.666611 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-84698679-0be4-4503-a310-7352ad2719d8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:01.673162 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-84698679-0be4-4503-a310-7352ad2719d8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:01.673602 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-84698679-0be4-4503-a310-7352ad2719d8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:01.674347 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-84698679-0be4-4503-a310-7352ad2719d8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:01.674776 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-84698679-0be4-4503-a310-7352ad2719d8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:01.734611 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-84698679-0be4-4503-a310-7352ad2719d8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:01.743572 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-84698679-0be4-4503-a310-7352ad2719d8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:01.745092 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-84698679-0be4-4503-a310-7352ad2719d8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:01.746233 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-84698679-0be4-4503-a310-7352ad2719d8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084208 May 24 15:41:01.746785 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1212/2433] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:41:01 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:01.763545 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-1ef6be05-a4d1-45ec-9297-001f0b199da4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:01.764168 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-1ef6be05-a4d1-45ec-9297-001f0b199da4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:01.770653 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1ef6be05-a4d1-45ec-9297-001f0b199da4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:01.771104 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1ef6be05-a4d1-45ec-9297-001f0b199da4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:01.771863 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1ef6be05-a4d1-45ec-9297-001f0b199da4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:01.772320 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1ef6be05-a4d1-45ec-9297-001f0b199da4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:01.895490 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-1ef6be05-a4d1-45ec-9297-001f0b199da4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:01.903359 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-1ef6be05-a4d1-45ec-9297-001f0b199da4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.143702 May 24 15:41:01.903915 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1222/2434] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:01 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:01.973491 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-72285a00-97b2-4c06-bf80-c60493aa2453 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:01.974098 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-72285a00-97b2-4c06-bf80-c60493aa2453 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:01.980574 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-72285a00-97b2-4c06-bf80-c60493aa2453 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:01.981014 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-72285a00-97b2-4c06-bf80-c60493aa2453 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:01.981759 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-72285a00-97b2-4c06-bf80-c60493aa2453 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:01.982187 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-72285a00-97b2-4c06-bf80-c60493aa2453 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:02.110251 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-72285a00-97b2-4c06-bf80-c60493aa2453 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:02.119384 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-72285a00-97b2-4c06-bf80-c60493aa2453 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.149716 May 24 15:41:02.119929 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1213/2435] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:01 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:02.241629 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-33df411e-c783-483d-aed6-238c5c8f6d13 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:02.242165 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-33df411e-c783-483d-aed6-238c5c8f6d13 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:02.248278 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-33df411e-c783-483d-aed6-238c5c8f6d13 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:02.248753 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-33df411e-c783-483d-aed6-238c5c8f6d13 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:02.249503 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-33df411e-c783-483d-aed6-238c5c8f6d13 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:02.249931 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-33df411e-c783-483d-aed6-238c5c8f6d13 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:02.378411 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-33df411e-c783-483d-aed6-238c5c8f6d13 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:02.386346 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-33df411e-c783-483d-aed6-238c5c8f6d13 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.148863 May 24 15:41:02.386908 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1223/2436] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:02 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:02.763803 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d5adda5b-8249-467e-b35a-3fa9926d6012 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:02.764443 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d5adda5b-8249-467e-b35a-3fa9926d6012 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:02.770932 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d5adda5b-8249-467e-b35a-3fa9926d6012 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:02.771383 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d5adda5b-8249-467e-b35a-3fa9926d6012 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:02.772165 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d5adda5b-8249-467e-b35a-3fa9926d6012 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:02.773232 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d5adda5b-8249-467e-b35a-3fa9926d6012 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:02.832361 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-d5adda5b-8249-467e-b35a-3fa9926d6012 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:02.841288 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-d5adda5b-8249-467e-b35a-3fa9926d6012 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:02.842786 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-d5adda5b-8249-467e-b35a-3fa9926d6012 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:02.843914 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d5adda5b-8249-467e-b35a-3fa9926d6012 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084071 May 24 15:41:02.844523 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1214/2437] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:41:02 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:02.919673 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-15f50b2d-738f-40f6-ab1d-a8224d0be997 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:02.920217 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-15f50b2d-738f-40f6-ab1d-a8224d0be997 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:02.926773 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-15f50b2d-738f-40f6-ab1d-a8224d0be997 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:02.927218 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-15f50b2d-738f-40f6-ab1d-a8224d0be997 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:02.927970 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-15f50b2d-738f-40f6-ab1d-a8224d0be997 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:02.928923 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-15f50b2d-738f-40f6-ab1d-a8224d0be997 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:03.054482 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-15f50b2d-738f-40f6-ab1d-a8224d0be997 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:03.062397 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-15f50b2d-738f-40f6-ab1d-a8224d0be997 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.146632 May 24 15:41:03.062954 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1224/2438] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:02 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:03.136807 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-484c137e-806e-4bb5-8413-48580ab2a985 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:03.137441 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-484c137e-806e-4bb5-8413-48580ab2a985 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:03.143461 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-484c137e-806e-4bb5-8413-48580ab2a985 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:03.143901 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-484c137e-806e-4bb5-8413-48580ab2a985 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:03.144668 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-484c137e-806e-4bb5-8413-48580ab2a985 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:03.145098 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-484c137e-806e-4bb5-8413-48580ab2a985 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:03.269297 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-484c137e-806e-4bb5-8413-48580ab2a985 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:03.277491 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-484c137e-806e-4bb5-8413-48580ab2a985 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.144485 May 24 15:41:03.278055 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1215/2439] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:03 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:03.403486 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-a8831964-70db-4651-94b0-dbeeac27e774 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:03.404087 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-a8831964-70db-4651-94b0-dbeeac27e774 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:03.410072 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a8831964-70db-4651-94b0-dbeeac27e774 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:03.410514 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a8831964-70db-4651-94b0-dbeeac27e774 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:03.411259 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a8831964-70db-4651-94b0-dbeeac27e774 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:03.411689 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a8831964-70db-4651-94b0-dbeeac27e774 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:03.538277 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-a8831964-70db-4651-94b0-dbeeac27e774 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:03.546163 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-a8831964-70db-4651-94b0-dbeeac27e774 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.146536 May 24 15:41:03.546721 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1225/2440] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:03 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:03.861627 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-9904478b-c74d-4dd2-a27e-db42983f0807 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:03.862173 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-9904478b-c74d-4dd2-a27e-db42983f0807 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:03.869457 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9904478b-c74d-4dd2-a27e-db42983f0807 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:03.869905 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9904478b-c74d-4dd2-a27e-db42983f0807 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:03.870660 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9904478b-c74d-4dd2-a27e-db42983f0807 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:03.871096 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9904478b-c74d-4dd2-a27e-db42983f0807 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:03.935086 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-9904478b-c74d-4dd2-a27e-db42983f0807 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:03.943508 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-9904478b-c74d-4dd2-a27e-db42983f0807 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:03.945656 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-9904478b-c74d-4dd2-a27e-db42983f0807 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:03.946790 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-9904478b-c74d-4dd2-a27e-db42983f0807 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.089221 May 24 15:41:03.947347 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1216/2441] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:41:03 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:04.078786 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-61d2ce71-4c0e-49c8-94b2-dae20c8da89b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:04.079406 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-61d2ce71-4c0e-49c8-94b2-dae20c8da89b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:04.085904 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-61d2ce71-4c0e-49c8-94b2-dae20c8da89b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:04.086349 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-61d2ce71-4c0e-49c8-94b2-dae20c8da89b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:04.087105 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-61d2ce71-4c0e-49c8-94b2-dae20c8da89b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:04.087536 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-61d2ce71-4c0e-49c8-94b2-dae20c8da89b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:04.213668 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-61d2ce71-4c0e-49c8-94b2-dae20c8da89b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:04.221448 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-61d2ce71-4c0e-49c8-94b2-dae20c8da89b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.146467 May 24 15:41:04.222005 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1226/2442] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:04 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:04.294647 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-0f3b6576-0c7c-4dc5-b06b-81060087bc8c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:04.295261 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-0f3b6576-0c7c-4dc5-b06b-81060087bc8c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:04.301291 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0f3b6576-0c7c-4dc5-b06b-81060087bc8c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:04.301767 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0f3b6576-0c7c-4dc5-b06b-81060087bc8c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:04.302500 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0f3b6576-0c7c-4dc5-b06b-81060087bc8c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:04.302936 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0f3b6576-0c7c-4dc5-b06b-81060087bc8c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:04.429583 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-0f3b6576-0c7c-4dc5-b06b-81060087bc8c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:04.437484 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-0f3b6576-0c7c-4dc5-b06b-81060087bc8c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.146657 May 24 15:41:04.438055 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1217/2443] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:04 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:04.562283 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-a2b03d12-c296-4a87-afe8-d906ace34dda tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:04.562889 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-a2b03d12-c296-4a87-afe8-d906ace34dda tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:04.568827 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a2b03d12-c296-4a87-afe8-d906ace34dda tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:04.569871 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a2b03d12-c296-4a87-afe8-d906ace34dda tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:04.570617 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a2b03d12-c296-4a87-afe8-d906ace34dda tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:04.571043 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a2b03d12-c296-4a87-afe8-d906ace34dda tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:04.699608 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-a2b03d12-c296-4a87-afe8-d906ace34dda tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:04.707545 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-a2b03d12-c296-4a87-afe8-d906ace34dda tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.149044 May 24 15:41:04.708108 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1227/2444] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:04 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:04.964680 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-3223187b-c686-4869-ae09-756c43ffb413 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:04.965230 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-3223187b-c686-4869-ae09-756c43ffb413 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:04.971754 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3223187b-c686-4869-ae09-756c43ffb413 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:04.972204 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3223187b-c686-4869-ae09-756c43ffb413 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:04.972994 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3223187b-c686-4869-ae09-756c43ffb413 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:04.973427 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3223187b-c686-4869-ae09-756c43ffb413 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:05.035611 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-3223187b-c686-4869-ae09-756c43ffb413 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:05.044651 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-3223187b-c686-4869-ae09-756c43ffb413 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:05.046144 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-3223187b-c686-4869-ae09-756c43ffb413 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:05.047289 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-3223187b-c686-4869-ae09-756c43ffb413 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.086698 May 24 15:41:05.047890 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1218/2445] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:41:04 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:41:05.238637 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-6e8b819e-e2e7-46bd-928d-09b97d9c4cd7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:05.239252 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-6e8b819e-e2e7-46bd-928d-09b97d9c4cd7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:05.246137 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6e8b819e-e2e7-46bd-928d-09b97d9c4cd7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:05.246588 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6e8b819e-e2e7-46bd-928d-09b97d9c4cd7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:05.247342 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6e8b819e-e2e7-46bd-928d-09b97d9c4cd7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:05.247779 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6e8b819e-e2e7-46bd-928d-09b97d9c4cd7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:05.371693 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-6e8b819e-e2e7-46bd-928d-09b97d9c4cd7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:05.379530 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-6e8b819e-e2e7-46bd-928d-09b97d9c4cd7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.144722 May 24 15:41:05.380093 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1228/2446] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:05 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:05.454719 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-8e65e1f0-0f1f-4af9-b052-f24ad3ab4207 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:05.455334 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-8e65e1f0-0f1f-4af9-b052-f24ad3ab4207 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:05.461870 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8e65e1f0-0f1f-4af9-b052-f24ad3ab4207 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:05.462317 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8e65e1f0-0f1f-4af9-b052-f24ad3ab4207 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:05.463074 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8e65e1f0-0f1f-4af9-b052-f24ad3ab4207 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:05.463505 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8e65e1f0-0f1f-4af9-b052-f24ad3ab4207 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:05.598421 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-8e65e1f0-0f1f-4af9-b052-f24ad3ab4207 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:05.606505 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-8e65e1f0-0f1f-4af9-b052-f24ad3ab4207 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.155495 May 24 15:41:05.607082 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1219/2447] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:05 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:05.724284 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d1d0e34b-9feb-4e96-8383-55987cc7ac2a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:05.724907 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d1d0e34b-9feb-4e96-8383-55987cc7ac2a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:05.731194 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d1d0e34b-9feb-4e96-8383-55987cc7ac2a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:05.731643 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d1d0e34b-9feb-4e96-8383-55987cc7ac2a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:05.732425 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d1d0e34b-9feb-4e96-8383-55987cc7ac2a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:05.732854 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d1d0e34b-9feb-4e96-8383-55987cc7ac2a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:05.736745 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:41:05.858746 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-d1d0e34b-9feb-4e96-8383-55987cc7ac2a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:05.866908 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d1d0e34b-9feb-4e96-8383-55987cc7ac2a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.146481 May 24 15:41:05.867981 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1229/2448] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:05 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:06.065068 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-292c53c0-a063-4413-8137-575c928f2177 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:06.065600 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-292c53c0-a063-4413-8137-575c928f2177 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:06.072841 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-292c53c0-a063-4413-8137-575c928f2177 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:06.073288 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-292c53c0-a063-4413-8137-575c928f2177 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:06.074049 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-292c53c0-a063-4413-8137-575c928f2177 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:06.074515 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-292c53c0-a063-4413-8137-575c928f2177 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:06.135716 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-292c53c0-a063-4413-8137-575c928f2177 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:06.144097 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-292c53c0-a063-4413-8137-575c928f2177 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:06.145611 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-292c53c0-a063-4413-8137-575c928f2177 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:06.146740 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-292c53c0-a063-4413-8137-575c928f2177 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.085650 May 24 15:41:06.147294 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1220/2449] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:41:06 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:06.396393 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-15a37f8a-2fba-4ab1-8108-7f7ab66ac0f9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:06.396928 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-15a37f8a-2fba-4ab1-8108-7f7ab66ac0f9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:06.404093 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-15a37f8a-2fba-4ab1-8108-7f7ab66ac0f9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:06.404598 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-15a37f8a-2fba-4ab1-8108-7f7ab66ac0f9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:06.405352 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-15a37f8a-2fba-4ab1-8108-7f7ab66ac0f9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:06.405787 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-15a37f8a-2fba-4ab1-8108-7f7ab66ac0f9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:06.531728 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-15a37f8a-2fba-4ab1-8108-7f7ab66ac0f9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:06.539719 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-15a37f8a-2fba-4ab1-8108-7f7ab66ac0f9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.147261 May 24 15:41:06.540341 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1230/2450] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:06 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:06.623807 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-ab1b1fc7-c665-4e1b-a548-eec431eacfae tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:06.624439 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-ab1b1fc7-c665-4e1b-a548-eec431eacfae tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:06.630545 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ab1b1fc7-c665-4e1b-a548-eec431eacfae tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:06.630985 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ab1b1fc7-c665-4e1b-a548-eec431eacfae tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:06.631730 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ab1b1fc7-c665-4e1b-a548-eec431eacfae tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:06.632155 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ab1b1fc7-c665-4e1b-a548-eec431eacfae tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:06.636662 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:41:06.757840 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-ab1b1fc7-c665-4e1b-a548-eec431eacfae tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:06.766615 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-ab1b1fc7-c665-4e1b-a548-eec431eacfae tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.146620 May 24 15:41:06.767195 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1221/2451] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:06 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:06.883728 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-71a4a4e2-844c-4914-87a6-c8e7f781bb90 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:06.884999 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-71a4a4e2-844c-4914-87a6-c8e7f781bb90 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:06.890934 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-71a4a4e2-844c-4914-87a6-c8e7f781bb90 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:06.891383 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-71a4a4e2-844c-4914-87a6-c8e7f781bb90 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:06.892137 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-71a4a4e2-844c-4914-87a6-c8e7f781bb90 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:06.892593 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-71a4a4e2-844c-4914-87a6-c8e7f781bb90 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:07.029214 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-71a4a4e2-844c-4914-87a6-c8e7f781bb90 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:07.037148 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-71a4a4e2-844c-4914-87a6-c8e7f781bb90 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.157228 May 24 15:41:07.037708 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1231/2452] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:06 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:07.164581 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-5de03fc9-96b3-48c0-a0d3-03584b323132 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:07.165870 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-5de03fc9-96b3-48c0-a0d3-03584b323132 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:07.172373 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5de03fc9-96b3-48c0-a0d3-03584b323132 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:07.172819 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5de03fc9-96b3-48c0-a0d3-03584b323132 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:07.173605 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5de03fc9-96b3-48c0-a0d3-03584b323132 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:07.174039 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5de03fc9-96b3-48c0-a0d3-03584b323132 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:07.237811 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-5de03fc9-96b3-48c0-a0d3-03584b323132 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:07.247148 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-5de03fc9-96b3-48c0-a0d3-03584b323132 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:07.248671 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-5de03fc9-96b3-48c0-a0d3-03584b323132 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:07.249810 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-5de03fc9-96b3-48c0-a0d3-03584b323132 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.089193 May 24 15:41:07.250368 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1222/2453] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:41:07 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:07.556448 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-01bd5004-e28f-4ac6-98dc-2d22c661e0fa tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:07.557010 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-01bd5004-e28f-4ac6-98dc-2d22c661e0fa tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:07.563408 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-01bd5004-e28f-4ac6-98dc-2d22c661e0fa tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:07.563835 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-01bd5004-e28f-4ac6-98dc-2d22c661e0fa tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:07.564600 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-01bd5004-e28f-4ac6-98dc-2d22c661e0fa tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:07.565030 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-01bd5004-e28f-4ac6-98dc-2d22c661e0fa tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:07.691989 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-01bd5004-e28f-4ac6-98dc-2d22c661e0fa tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:07.699815 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-01bd5004-e28f-4ac6-98dc-2d22c661e0fa tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.147320 May 24 15:41:07.700389 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1232/2454] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:07 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:07.783329 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-aee32c18-2bd3-46aa-9759-4e5dd6c3f1ff tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:07.783967 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-aee32c18-2bd3-46aa-9759-4e5dd6c3f1ff tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:07.790168 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-aee32c18-2bd3-46aa-9759-4e5dd6c3f1ff tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:07.790612 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-aee32c18-2bd3-46aa-9759-4e5dd6c3f1ff tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:07.791368 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-aee32c18-2bd3-46aa-9759-4e5dd6c3f1ff tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:07.791805 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-aee32c18-2bd3-46aa-9759-4e5dd6c3f1ff tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:07.914985 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-aee32c18-2bd3-46aa-9759-4e5dd6c3f1ff tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:07.922856 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-aee32c18-2bd3-46aa-9759-4e5dd6c3f1ff tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.143370 May 24 15:41:07.923423 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1223/2455] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:07 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:08.053608 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-dae332ae-def2-4dc2-b649-b9d66f7e3676 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:08.054212 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-dae332ae-def2-4dc2-b649-b9d66f7e3676 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:08.060148 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dae332ae-def2-4dc2-b649-b9d66f7e3676 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:08.060638 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dae332ae-def2-4dc2-b649-b9d66f7e3676 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:08.061365 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dae332ae-def2-4dc2-b649-b9d66f7e3676 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:08.061796 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dae332ae-def2-4dc2-b649-b9d66f7e3676 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:08.232529 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-dae332ae-def2-4dc2-b649-b9d66f7e3676 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:08.240290 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-dae332ae-def2-4dc2-b649-b9d66f7e3676 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.190501 May 24 15:41:08.240857 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1233/2456] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:08 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:08.266925 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-67298ae6-edde-4a6c-b811-acef843ba4f3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:08.267540 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-67298ae6-edde-4a6c-b811-acef843ba4f3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:08.273988 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-67298ae6-edde-4a6c-b811-acef843ba4f3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:08.274452 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-67298ae6-edde-4a6c-b811-acef843ba4f3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:08.275206 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-67298ae6-edde-4a6c-b811-acef843ba4f3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:08.275671 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-67298ae6-edde-4a6c-b811-acef843ba4f3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:08.335793 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-67298ae6-edde-4a6c-b811-acef843ba4f3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:08.344672 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-67298ae6-edde-4a6c-b811-acef843ba4f3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:08.346178 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-67298ae6-edde-4a6c-b811-acef843ba4f3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:08.347347 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-67298ae6-edde-4a6c-b811-acef843ba4f3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084456 May 24 15:41:08.347899 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1224/2457] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:41:08 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:08.716845 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d597ab65-b216-43f5-96d3-3d795943518e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:08.717431 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d597ab65-b216-43f5-96d3-3d795943518e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:08.723871 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d597ab65-b216-43f5-96d3-3d795943518e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:08.724321 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d597ab65-b216-43f5-96d3-3d795943518e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:08.725082 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d597ab65-b216-43f5-96d3-3d795943518e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:08.725506 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d597ab65-b216-43f5-96d3-3d795943518e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:08.851017 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-d597ab65-b216-43f5-96d3-3d795943518e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:08.858794 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d597ab65-b216-43f5-96d3-3d795943518e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.145725 May 24 15:41:08.859349 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1234/2458] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:08 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:08.939412 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f467fdcf-049c-486b-be27-de80bedee8eb tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:08.940049 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f467fdcf-049c-486b-be27-de80bedee8eb tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:08.946094 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f467fdcf-049c-486b-be27-de80bedee8eb tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:08.947112 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f467fdcf-049c-486b-be27-de80bedee8eb tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:08.947865 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f467fdcf-049c-486b-be27-de80bedee8eb tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:08.948314 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f467fdcf-049c-486b-be27-de80bedee8eb tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:09.120252 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-f467fdcf-049c-486b-be27-de80bedee8eb tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:09.128167 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f467fdcf-049c-486b-be27-de80bedee8eb tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.192561 May 24 15:41:09.128755 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1225/2459] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:08 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:09.257792 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-05b042ab-0004-4737-bee8-8ee5cb7042b2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:09.258334 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-05b042ab-0004-4737-bee8-8ee5cb7042b2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:09.264264 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-05b042ab-0004-4737-bee8-8ee5cb7042b2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:09.264757 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-05b042ab-0004-4737-bee8-8ee5cb7042b2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:09.265516 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-05b042ab-0004-4737-bee8-8ee5cb7042b2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:09.265956 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-05b042ab-0004-4737-bee8-8ee5cb7042b2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:09.365705 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-7cce15a1-7659-4602-8331-2ca2287643a3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:09.366570 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-7cce15a1-7659-4602-8331-2ca2287643a3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:09.375560 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7cce15a1-7659-4602-8331-2ca2287643a3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:09.376015 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7cce15a1-7659-4602-8331-2ca2287643a3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:09.376843 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7cce15a1-7659-4602-8331-2ca2287643a3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:09.377277 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7cce15a1-7659-4602-8331-2ca2287643a3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:09.405855 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-05b042ab-0004-4737-bee8-8ee5cb7042b2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:09.413984 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-05b042ab-0004-4737-bee8-8ee5cb7042b2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.160045 May 24 15:41:09.414543 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1235/2460] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:09 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:09.440546 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-7cce15a1-7659-4602-8331-2ca2287643a3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:09.449010 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-7cce15a1-7659-4602-8331-2ca2287643a3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:09.450503 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-7cce15a1-7659-4602-8331-2ca2287643a3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:09.451677 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-7cce15a1-7659-4602-8331-2ca2287643a3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.089819 May 24 15:41:09.452233 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1226/2461] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:41:09 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:41:09.876274 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-a618ade6-d828-4af1-b75c-80d609a4cb20 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:09.876899 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-a618ade6-d828-4af1-b75c-80d609a4cb20 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:09.883273 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a618ade6-d828-4af1-b75c-80d609a4cb20 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:09.883774 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a618ade6-d828-4af1-b75c-80d609a4cb20 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:09.884560 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a618ade6-d828-4af1-b75c-80d609a4cb20 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:09.884987 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a618ade6-d828-4af1-b75c-80d609a4cb20 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:10.013811 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-a618ade6-d828-4af1-b75c-80d609a4cb20 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:10.021879 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-a618ade6-d828-4af1-b75c-80d609a4cb20 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.149445 May 24 15:41:10.022434 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1236/2462] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:09 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:10.146127 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-682fd1ad-0711-4935-86a5-f71b8fb21a36 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:10.146671 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-682fd1ad-0711-4935-86a5-f71b8fb21a36 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:10.153625 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-682fd1ad-0711-4935-86a5-f71b8fb21a36 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:10.154063 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-682fd1ad-0711-4935-86a5-f71b8fb21a36 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:10.154811 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-682fd1ad-0711-4935-86a5-f71b8fb21a36 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:10.155236 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-682fd1ad-0711-4935-86a5-f71b8fb21a36 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:10.280179 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-682fd1ad-0711-4935-86a5-f71b8fb21a36 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:10.288114 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-682fd1ad-0711-4935-86a5-f71b8fb21a36 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.145958 May 24 15:41:10.288714 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1227/2463] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:10 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:10.431745 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-27818657-c65b-4b60-b895-01fb7a53408c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:10.432272 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-27818657-c65b-4b60-b895-01fb7a53408c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:10.438230 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-27818657-c65b-4b60-b895-01fb7a53408c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:10.438668 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-27818657-c65b-4b60-b895-01fb7a53408c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:10.439703 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-27818657-c65b-4b60-b895-01fb7a53408c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:10.440135 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-27818657-c65b-4b60-b895-01fb7a53408c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:10.469262 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e7c66073-b1df-467a-bbe1-a50d6be25366 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:10.469865 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-e7c66073-b1df-467a-bbe1-a50d6be25366 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:10.475913 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e7c66073-b1df-467a-bbe1-a50d6be25366 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:10.476394 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e7c66073-b1df-467a-bbe1-a50d6be25366 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:10.477158 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e7c66073-b1df-467a-bbe1-a50d6be25366 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:10.477602 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e7c66073-b1df-467a-bbe1-a50d6be25366 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:10.541875 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-e7c66073-b1df-467a-bbe1-a50d6be25366 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:10.550453 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-e7c66073-b1df-467a-bbe1-a50d6be25366 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:10.552116 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-e7c66073-b1df-467a-bbe1-a50d6be25366 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:10.553322 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-e7c66073-b1df-467a-bbe1-a50d6be25366 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.087936 May 24 15:41:10.553878 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1228/2464] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:41:10 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:41:10.572919 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-27818657-c65b-4b60-b895-01fb7a53408c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:10.580943 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-27818657-c65b-4b60-b895-01fb7a53408c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.153556 May 24 15:41:10.581560 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1237/2465] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:10 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:11.039133 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-12183127-928e-4ba7-a043-b50d93ec71b7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:11.039742 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-12183127-928e-4ba7-a043-b50d93ec71b7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:11.046230 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-12183127-928e-4ba7-a043-b50d93ec71b7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:11.046670 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-12183127-928e-4ba7-a043-b50d93ec71b7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:11.047452 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-12183127-928e-4ba7-a043-b50d93ec71b7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:11.047876 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-12183127-928e-4ba7-a043-b50d93ec71b7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:11.175644 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-12183127-928e-4ba7-a043-b50d93ec71b7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:11.183670 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-12183127-928e-4ba7-a043-b50d93ec71b7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.148411 May 24 15:41:11.184231 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1229/2466] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:11 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:11.304100 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-b1c1e289-ce67-49b9-8052-788934862002 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:11.304737 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-b1c1e289-ce67-49b9-8052-788934862002 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:11.311251 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b1c1e289-ce67-49b9-8052-788934862002 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:11.311701 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b1c1e289-ce67-49b9-8052-788934862002 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:11.312487 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b1c1e289-ce67-49b9-8052-788934862002 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:11.312923 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b1c1e289-ce67-49b9-8052-788934862002 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:11.437057 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-b1c1e289-ce67-49b9-8052-788934862002 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:11.444902 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-b1c1e289-ce67-49b9-8052-788934862002 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.144612 May 24 15:41:11.445474 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1238/2467] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:11 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:11.572210 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-58c5e5ee-0096-4c52-aae2-2a29c706e4b6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:11.572849 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-58c5e5ee-0096-4c52-aae2-2a29c706e4b6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:11.578861 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-58c5e5ee-0096-4c52-aae2-2a29c706e4b6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:11.579304 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-58c5e5ee-0096-4c52-aae2-2a29c706e4b6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:11.580056 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-58c5e5ee-0096-4c52-aae2-2a29c706e4b6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:11.580518 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-58c5e5ee-0096-4c52-aae2-2a29c706e4b6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:11.598312 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-3c213cf8-b4ad-4053-95ef-9068df044c7c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:11.598949 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-3c213cf8-b4ad-4053-95ef-9068df044c7c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:11.604900 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3c213cf8-b4ad-4053-95ef-9068df044c7c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:11.605339 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3c213cf8-b4ad-4053-95ef-9068df044c7c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:11.606086 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3c213cf8-b4ad-4053-95ef-9068df044c7c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:11.606514 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3c213cf8-b4ad-4053-95ef-9068df044c7c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:11.641266 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-58c5e5ee-0096-4c52-aae2-2a29c706e4b6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:11.650449 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-58c5e5ee-0096-4c52-aae2-2a29c706e4b6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:11.651949 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-58c5e5ee-0096-4c52-aae2-2a29c706e4b6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:11.653134 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-58c5e5ee-0096-4c52-aae2-2a29c706e4b6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.085276 May 24 15:41:11.653697 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1230/2468] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:41:11 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:11.733928 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-3c213cf8-b4ad-4053-95ef-9068df044c7c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:11.742031 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-3c213cf8-b4ad-4053-95ef-9068df044c7c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.147559 May 24 15:41:11.742583 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1239/2469] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:11 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:41:12.200231 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d94ecaee-d742-49b9-9a1e-e62f38431db0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:12.200883 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d94ecaee-d742-49b9-9a1e-e62f38431db0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:12.207427 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d94ecaee-d742-49b9-9a1e-e62f38431db0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:12.207870 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d94ecaee-d742-49b9-9a1e-e62f38431db0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:12.208651 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d94ecaee-d742-49b9-9a1e-e62f38431db0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:12.209084 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d94ecaee-d742-49b9-9a1e-e62f38431db0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:12.336045 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-d94ecaee-d742-49b9-9a1e-e62f38431db0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:12.344670 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d94ecaee-d742-49b9-9a1e-e62f38431db0 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.148899 May 24 15:41:12.345238 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1231/2470] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:12 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:12.462369 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-39987920-d740-4c8d-be94-6cee89a45972 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:12.462994 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-39987920-d740-4c8d-be94-6cee89a45972 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:12.469574 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-39987920-d740-4c8d-be94-6cee89a45972 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:12.470017 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-39987920-d740-4c8d-be94-6cee89a45972 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:12.470766 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-39987920-d740-4c8d-be94-6cee89a45972 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:12.471200 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-39987920-d740-4c8d-be94-6cee89a45972 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:12.595447 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-39987920-d740-4c8d-be94-6cee89a45972 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:12.604722 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-39987920-d740-4c8d-be94-6cee89a45972 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.146656 May 24 15:41:12.605269 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1240/2471] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:12 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:12.670354 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f916c5d2-0eb6-4b3e-b369-36dc37487685 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:12.671110 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f916c5d2-0eb6-4b3e-b369-36dc37487685 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:12.677655 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f916c5d2-0eb6-4b3e-b369-36dc37487685 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:12.678095 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f916c5d2-0eb6-4b3e-b369-36dc37487685 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:12.678846 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f916c5d2-0eb6-4b3e-b369-36dc37487685 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:12.679272 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f916c5d2-0eb6-4b3e-b369-36dc37487685 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:12.738744 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-f916c5d2-0eb6-4b3e-b369-36dc37487685 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:12.747649 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-f916c5d2-0eb6-4b3e-b369-36dc37487685 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:12.749159 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-f916c5d2-0eb6-4b3e-b369-36dc37487685 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:12.754781 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f916c5d2-0eb6-4b3e-b369-36dc37487685 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084099 May 24 15:41:12.755367 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1232/2472] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:41:12 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:12.759553 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-f2c9d9f1-36d2-4258-81ad-88981c8b0028 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:12.760219 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-f2c9d9f1-36d2-4258-81ad-88981c8b0028 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:12.766204 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f2c9d9f1-36d2-4258-81ad-88981c8b0028 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:12.766648 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f2c9d9f1-36d2-4258-81ad-88981c8b0028 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:12.767392 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f2c9d9f1-36d2-4258-81ad-88981c8b0028 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:12.767824 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f2c9d9f1-36d2-4258-81ad-88981c8b0028 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:12.891455 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-f2c9d9f1-36d2-4258-81ad-88981c8b0028 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:12.899425 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-f2c9d9f1-36d2-4258-81ad-88981c8b0028 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.144572 May 24 15:41:12.899989 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1241/2473] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:12 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:41:13.361246 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-1e5445de-83e8-49d3-aad4-14ab39f6e9f6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:13.361863 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-1e5445de-83e8-49d3-aad4-14ab39f6e9f6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:13.368647 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1e5445de-83e8-49d3-aad4-14ab39f6e9f6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:13.369086 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1e5445de-83e8-49d3-aad4-14ab39f6e9f6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:13.369833 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1e5445de-83e8-49d3-aad4-14ab39f6e9f6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:13.370261 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1e5445de-83e8-49d3-aad4-14ab39f6e9f6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:13.495321 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-1e5445de-83e8-49d3-aad4-14ab39f6e9f6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:13.503292 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-1e5445de-83e8-49d3-aad4-14ab39f6e9f6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.145902 May 24 15:41:13.503853 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1233/2474] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:13 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:13.622454 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-712c15cb-2d4d-4d9b-be83-bc104869709e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:13.622983 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-712c15cb-2d4d-4d9b-be83-bc104869709e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:13.629527 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-712c15cb-2d4d-4d9b-be83-bc104869709e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:13.629970 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-712c15cb-2d4d-4d9b-be83-bc104869709e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:13.630714 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-712c15cb-2d4d-4d9b-be83-bc104869709e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:13.631149 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-712c15cb-2d4d-4d9b-be83-bc104869709e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:13.761755 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-712c15cb-2d4d-4d9b-be83-bc104869709e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:13.769753 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-712c15cb-2d4d-4d9b-be83-bc104869709e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.151281 May 24 15:41:13.770308 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1242/2475] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:13 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:13.773131 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-07081d7b-e988-401e-b811-ec2563f86f0f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:13.773748 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-07081d7b-e988-401e-b811-ec2563f86f0f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:13.780437 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-07081d7b-e988-401e-b811-ec2563f86f0f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:13.780888 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-07081d7b-e988-401e-b811-ec2563f86f0f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:13.781663 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-07081d7b-e988-401e-b811-ec2563f86f0f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:13.782082 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-07081d7b-e988-401e-b811-ec2563f86f0f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:13.845401 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-07081d7b-e988-401e-b811-ec2563f86f0f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:13.854329 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-07081d7b-e988-401e-b811-ec2563f86f0f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:13.855825 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-07081d7b-e988-401e-b811-ec2563f86f0f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:13.857009 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-07081d7b-e988-401e-b811-ec2563f86f0f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.087711 May 24 15:41:13.857566 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1234/2476] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:41:13 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:41:13.916648 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-605c2087-a434-4014-b2b6-26c50bb77472 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:13.917187 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-605c2087-a434-4014-b2b6-26c50bb77472 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:13.923080 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-605c2087-a434-4014-b2b6-26c50bb77472 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:13.923521 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-605c2087-a434-4014-b2b6-26c50bb77472 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:13.924263 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-605c2087-a434-4014-b2b6-26c50bb77472 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:13.924724 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-605c2087-a434-4014-b2b6-26c50bb77472 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:14.051104 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-605c2087-a434-4014-b2b6-26c50bb77472 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:14.059541 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-605c2087-a434-4014-b2b6-26c50bb77472 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.147249 May 24 15:41:14.060133 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1243/2477] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:13 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:14.519607 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d15e2141-34b6-49bd-b198-01feb1fbcfd8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:14.520218 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d15e2141-34b6-49bd-b198-01feb1fbcfd8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:14.527511 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d15e2141-34b6-49bd-b198-01feb1fbcfd8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:14.527955 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d15e2141-34b6-49bd-b198-01feb1fbcfd8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:14.528742 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d15e2141-34b6-49bd-b198-01feb1fbcfd8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:14.529178 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d15e2141-34b6-49bd-b198-01feb1fbcfd8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:14.652157 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-d15e2141-34b6-49bd-b198-01feb1fbcfd8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:14.660073 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d15e2141-34b6-49bd-b198-01feb1fbcfd8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.144287 May 24 15:41:14.660672 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1235/2478] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:14 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:14.787513 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-db24a21b-7a59-4c14-a0c7-3d6aae807330 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:14.788117 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-db24a21b-7a59-4c14-a0c7-3d6aae807330 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:14.794620 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-db24a21b-7a59-4c14-a0c7-3d6aae807330 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:14.795057 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-db24a21b-7a59-4c14-a0c7-3d6aae807330 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:14.795796 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-db24a21b-7a59-4c14-a0c7-3d6aae807330 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:14.796221 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-db24a21b-7a59-4c14-a0c7-3d6aae807330 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:14.874956 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-7f49de2f-e6aa-453a-8ffd-74e53dfd5cc9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:14.875592 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-7f49de2f-e6aa-453a-8ffd-74e53dfd5cc9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:14.881887 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7f49de2f-e6aa-453a-8ffd-74e53dfd5cc9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:14.882339 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7f49de2f-e6aa-453a-8ffd-74e53dfd5cc9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:14.883103 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7f49de2f-e6aa-453a-8ffd-74e53dfd5cc9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:14.883538 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7f49de2f-e6aa-453a-8ffd-74e53dfd5cc9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:14.925768 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-db24a21b-7a59-4c14-a0c7-3d6aae807330 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:14.934307 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-db24a21b-7a59-4c14-a0c7-3d6aae807330 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.150627 May 24 15:41:14.934928 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1244/2479] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:14 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:14.944949 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-7f49de2f-e6aa-453a-8ffd-74e53dfd5cc9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:14.954034 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-7f49de2f-e6aa-453a-8ffd-74e53dfd5cc9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:14.955541 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-7f49de2f-e6aa-453a-8ffd-74e53dfd5cc9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:14.956716 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-7f49de2f-e6aa-453a-8ffd-74e53dfd5cc9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.085634 May 24 15:41:14.957270 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1236/2480] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:41:14 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:41:15.077128 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-36e3fd17-e2b7-4fc2-8994-d020aad00448 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:15.077777 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-36e3fd17-e2b7-4fc2-8994-d020aad00448 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:15.083870 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-36e3fd17-e2b7-4fc2-8994-d020aad00448 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:15.084351 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-36e3fd17-e2b7-4fc2-8994-d020aad00448 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:15.085119 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-36e3fd17-e2b7-4fc2-8994-d020aad00448 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:15.085561 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-36e3fd17-e2b7-4fc2-8994-d020aad00448 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:15.211074 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-36e3fd17-e2b7-4fc2-8994-d020aad00448 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:15.214490 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:41:15.219997 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-36e3fd17-e2b7-4fc2-8994-d020aad00448 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.146784 May 24 15:41:15.220591 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1245/2481] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:15 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:41:15.677392 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d1df4176-1e60-4b46-80d1-a3c426fa4c45 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:15.678006 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d1df4176-1e60-4b46-80d1-a3c426fa4c45 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:15.684684 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d1df4176-1e60-4b46-80d1-a3c426fa4c45 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:15.685131 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d1df4176-1e60-4b46-80d1-a3c426fa4c45 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:15.685890 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d1df4176-1e60-4b46-80d1-a3c426fa4c45 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:15.686368 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d1df4176-1e60-4b46-80d1-a3c426fa4c45 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:15.813640 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-d1df4176-1e60-4b46-80d1-a3c426fa4c45 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:15.817073 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:41:15.822923 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d1df4176-1e60-4b46-80d1-a3c426fa4c45 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.149376 May 24 15:41:15.823497 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1237/2482] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:15 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:15.952621 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-66419dc7-88d5-4a03-bf30-04fd30c7a45c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:15.953165 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-66419dc7-88d5-4a03-bf30-04fd30c7a45c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:15.959603 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-66419dc7-88d5-4a03-bf30-04fd30c7a45c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:15.960053 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-66419dc7-88d5-4a03-bf30-04fd30c7a45c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:15.960838 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-66419dc7-88d5-4a03-bf30-04fd30c7a45c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:15.961277 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-66419dc7-88d5-4a03-bf30-04fd30c7a45c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:15.974186 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-b0b79e6f-b48a-454f-9ea4-e931403ee819 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:15.974797 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-b0b79e6f-b48a-454f-9ea4-e931403ee819 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:15.981445 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b0b79e6f-b48a-454f-9ea4-e931403ee819 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:15.981895 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b0b79e6f-b48a-454f-9ea4-e931403ee819 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:15.982652 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b0b79e6f-b48a-454f-9ea4-e931403ee819 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:15.983087 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b0b79e6f-b48a-454f-9ea4-e931403ee819 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:16.047131 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-b0b79e6f-b48a-454f-9ea4-e931403ee819 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:16.055952 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-b0b79e6f-b48a-454f-9ea4-e931403ee819 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:16.057486 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-b0b79e6f-b48a-454f-9ea4-e931403ee819 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:16.058633 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-b0b79e6f-b48a-454f-9ea4-e931403ee819 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.088285 May 24 15:41:16.059197 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1238/2483] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:41:15 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:41:16.091306 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-66419dc7-88d5-4a03-bf30-04fd30c7a45c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:16.099358 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-66419dc7-88d5-4a03-bf30-04fd30c7a45c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.150872 May 24 15:41:16.099919 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1246/2484] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:15 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:16.236861 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-7daeae01-048b-41a1-843b-c5a85696a3a0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:16.237610 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-7daeae01-048b-41a1-843b-c5a85696a3a0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:16.243923 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7daeae01-048b-41a1-843b-c5a85696a3a0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:16.244409 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7daeae01-048b-41a1-843b-c5a85696a3a0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:16.245172 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7daeae01-048b-41a1-843b-c5a85696a3a0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:16.245608 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7daeae01-048b-41a1-843b-c5a85696a3a0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:16.372966 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-7daeae01-048b-41a1-843b-c5a85696a3a0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:16.380888 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-7daeae01-048b-41a1-843b-c5a85696a3a0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.147911 May 24 15:41:16.381475 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1239/2485] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:16 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:16.838861 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-0fe2b18f-deae-4b06-9c11-bfc9dca63a03 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:16.839497 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-0fe2b18f-deae-4b06-9c11-bfc9dca63a03 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:16.845468 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0fe2b18f-deae-4b06-9c11-bfc9dca63a03 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:16.845904 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0fe2b18f-deae-4b06-9c11-bfc9dca63a03 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:16.846647 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0fe2b18f-deae-4b06-9c11-bfc9dca63a03 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:16.847077 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0fe2b18f-deae-4b06-9c11-bfc9dca63a03 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:16.978957 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-0fe2b18f-deae-4b06-9c11-bfc9dca63a03 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:16.987325 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-0fe2b18f-deae-4b06-9c11-bfc9dca63a03 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.152308 May 24 15:41:16.988080 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1247/2486] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:16 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:17.076277 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-ee1e09dd-efc2-44aa-826b-efc2efe05245 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:17.076908 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-ee1e09dd-efc2-44aa-826b-efc2efe05245 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:17.084283 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ee1e09dd-efc2-44aa-826b-efc2efe05245 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:17.085496 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ee1e09dd-efc2-44aa-826b-efc2efe05245 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:17.085689 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ee1e09dd-efc2-44aa-826b-efc2efe05245 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:17.085958 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ee1e09dd-efc2-44aa-826b-efc2efe05245 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:17.115855 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-44a01726-ffa1-4f4e-b15a-a2910aa392a6 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:17.116759 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-44a01726-ffa1-4f4e-b15a-a2910aa392a6 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:17.122784 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-44a01726-ffa1-4f4e-b15a-a2910aa392a6 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:17.123233 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-44a01726-ffa1-4f4e-b15a-a2910aa392a6 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:17.123997 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-44a01726-ffa1-4f4e-b15a-a2910aa392a6 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:17.124460 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-44a01726-ffa1-4f4e-b15a-a2910aa392a6 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:17.156375 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-ee1e09dd-efc2-44aa-826b-efc2efe05245 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:17.165122 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-ee1e09dd-efc2-44aa-826b-efc2efe05245 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:17.167232 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-ee1e09dd-efc2-44aa-826b-efc2efe05245 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:17.168425 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-ee1e09dd-efc2-44aa-826b-efc2efe05245 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.096086 May 24 15:41:17.168990 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1240/2487] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:41:17 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:17.249964 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-44a01726-ffa1-4f4e-b15a-a2910aa392a6 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:17.257958 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-44a01726-ffa1-4f4e-b15a-a2910aa392a6 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.145953 May 24 15:41:17.258516 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1248/2488] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:17 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:41:17.398528 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-989e1e44-bbb1-4005-a902-106ca0f0cb97 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:17.399060 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-989e1e44-bbb1-4005-a902-106ca0f0cb97 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:17.405542 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-989e1e44-bbb1-4005-a902-106ca0f0cb97 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:17.405981 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-989e1e44-bbb1-4005-a902-106ca0f0cb97 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:17.406733 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-989e1e44-bbb1-4005-a902-106ca0f0cb97 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:17.407162 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-989e1e44-bbb1-4005-a902-106ca0f0cb97 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:17.534424 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-989e1e44-bbb1-4005-a902-106ca0f0cb97 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:17.542460 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-989e1e44-bbb1-4005-a902-106ca0f0cb97 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.147951 May 24 15:41:17.543008 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1241/2489] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:17 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:18.005093 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d3a2ad0e-faca-4fdd-9f71-5ffb02204578 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:18.005733 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d3a2ad0e-faca-4fdd-9f71-5ffb02204578 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:18.012570 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d3a2ad0e-faca-4fdd-9f71-5ffb02204578 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:18.013016 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d3a2ad0e-faca-4fdd-9f71-5ffb02204578 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:18.013770 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d3a2ad0e-faca-4fdd-9f71-5ffb02204578 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:18.014197 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d3a2ad0e-faca-4fdd-9f71-5ffb02204578 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:18.143117 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-d3a2ad0e-faca-4fdd-9f71-5ffb02204578 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:18.151492 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d3a2ad0e-faca-4fdd-9f71-5ffb02204578 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.150238 May 24 15:41:18.152076 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1249/2490] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:18 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:18.186081 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-0863f34c-0dfb-49d7-8f73-8df98325acd1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:18.186690 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-0863f34c-0dfb-49d7-8f73-8df98325acd1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:18.193476 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0863f34c-0dfb-49d7-8f73-8df98325acd1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:18.193923 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0863f34c-0dfb-49d7-8f73-8df98325acd1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:18.194677 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0863f34c-0dfb-49d7-8f73-8df98325acd1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:18.195108 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0863f34c-0dfb-49d7-8f73-8df98325acd1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:18.255419 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-0863f34c-0dfb-49d7-8f73-8df98325acd1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:18.264200 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-0863f34c-0dfb-49d7-8f73-8df98325acd1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:18.265712 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-0863f34c-0dfb-49d7-8f73-8df98325acd1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:18.266838 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-0863f34c-0dfb-49d7-8f73-8df98325acd1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084689 May 24 15:41:18.267402 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1242/2491] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:41:18 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:18.274602 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-5c5520ae-6e8c-4da9-b3ef-e6fde963dae6 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:18.275871 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-5c5520ae-6e8c-4da9-b3ef-e6fde963dae6 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:18.281803 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5c5520ae-6e8c-4da9-b3ef-e6fde963dae6 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:18.282239 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5c5520ae-6e8c-4da9-b3ef-e6fde963dae6 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:18.282981 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5c5520ae-6e8c-4da9-b3ef-e6fde963dae6 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:18.283408 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5c5520ae-6e8c-4da9-b3ef-e6fde963dae6 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:18.408220 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-5c5520ae-6e8c-4da9-b3ef-e6fde963dae6 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:18.416519 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-5c5520ae-6e8c-4da9-b3ef-e6fde963dae6 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.145609 May 24 15:41:18.417098 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1250/2492] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:18 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:18.559663 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-56ac0708-79c4-4cb5-bc94-9689e3be7533 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:18.560318 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-56ac0708-79c4-4cb5-bc94-9689e3be7533 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:18.566384 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-56ac0708-79c4-4cb5-bc94-9689e3be7533 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:18.566833 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-56ac0708-79c4-4cb5-bc94-9689e3be7533 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:18.567591 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-56ac0708-79c4-4cb5-bc94-9689e3be7533 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:18.568022 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-56ac0708-79c4-4cb5-bc94-9689e3be7533 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:18.695237 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-56ac0708-79c4-4cb5-bc94-9689e3be7533 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:18.703835 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-56ac0708-79c4-4cb5-bc94-9689e3be7533 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.148556 May 24 15:41:18.704425 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1243/2493] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:18 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:19.172056 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-5aa05a5c-f629-4735-9926-4116871d5677 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:19.172778 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-5aa05a5c-f629-4735-9926-4116871d5677 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:19.179312 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5aa05a5c-f629-4735-9926-4116871d5677 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:19.179765 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5aa05a5c-f629-4735-9926-4116871d5677 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:19.180552 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5aa05a5c-f629-4735-9926-4116871d5677 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:19.180994 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5aa05a5c-f629-4735-9926-4116871d5677 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:19.285562 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a366e5b7-08ea-411c-85d8-687859c5ed27 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:19.286180 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a366e5b7-08ea-411c-85d8-687859c5ed27 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:19.293178 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a366e5b7-08ea-411c-85d8-687859c5ed27 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:19.293629 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a366e5b7-08ea-411c-85d8-687859c5ed27 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:19.294394 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a366e5b7-08ea-411c-85d8-687859c5ed27 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:19.294830 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a366e5b7-08ea-411c-85d8-687859c5ed27 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:19.309332 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-5aa05a5c-f629-4735-9926-4116871d5677 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:19.317301 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-5aa05a5c-f629-4735-9926-4116871d5677 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.149077 May 24 15:41:19.317870 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1251/2494] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:19 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:19.356493 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-a366e5b7-08ea-411c-85d8-687859c5ed27 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:19.364930 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-a366e5b7-08ea-411c-85d8-687859c5ed27 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:19.366713 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-a366e5b7-08ea-411c-85d8-687859c5ed27 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:19.367849 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a366e5b7-08ea-411c-85d8-687859c5ed27 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.086311 May 24 15:41:19.368470 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1244/2495] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:41:19 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:41:19.433245 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-5d87e819-bd50-4ecd-8d48-6fd71e903b80 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:19.433860 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-5d87e819-bd50-4ecd-8d48-6fd71e903b80 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:19.439870 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5d87e819-bd50-4ecd-8d48-6fd71e903b80 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:19.440677 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5d87e819-bd50-4ecd-8d48-6fd71e903b80 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:19.441702 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5d87e819-bd50-4ecd-8d48-6fd71e903b80 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:19.442148 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5d87e819-bd50-4ecd-8d48-6fd71e903b80 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:19.566481 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-5d87e819-bd50-4ecd-8d48-6fd71e903b80 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:19.574339 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-5d87e819-bd50-4ecd-8d48-6fd71e903b80 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.145024 May 24 15:41:19.574910 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1252/2496] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:19 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:19.719931 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-12acc264-962c-4e5f-9417-2352e3a28e9e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:19.720571 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-12acc264-962c-4e5f-9417-2352e3a28e9e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:19.726562 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-12acc264-962c-4e5f-9417-2352e3a28e9e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:19.727016 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-12acc264-962c-4e5f-9417-2352e3a28e9e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:19.727780 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-12acc264-962c-4e5f-9417-2352e3a28e9e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:19.728221 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-12acc264-962c-4e5f-9417-2352e3a28e9e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:19.852134 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-12acc264-962c-4e5f-9417-2352e3a28e9e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:19.860455 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-12acc264-962c-4e5f-9417-2352e3a28e9e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.144273 May 24 15:41:19.861024 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1245/2497] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:19 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:20.334655 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-ca8b4e78-e8ef-4122-ad31-c84a1f8940dc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:20.335261 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-ca8b4e78-e8ef-4122-ad31-c84a1f8940dc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:20.341775 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ca8b4e78-e8ef-4122-ad31-c84a1f8940dc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:20.342217 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ca8b4e78-e8ef-4122-ad31-c84a1f8940dc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:20.342956 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ca8b4e78-e8ef-4122-ad31-c84a1f8940dc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:20.343381 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ca8b4e78-e8ef-4122-ad31-c84a1f8940dc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:20.386328 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-99f54b50-c559-4257-b424-e46ff049cb14 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:20.387171 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-99f54b50-c559-4257-b424-e46ff049cb14 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:20.393719 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-99f54b50-c559-4257-b424-e46ff049cb14 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:20.394169 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-99f54b50-c559-4257-b424-e46ff049cb14 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:20.394933 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-99f54b50-c559-4257-b424-e46ff049cb14 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:20.395368 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-99f54b50-c559-4257-b424-e46ff049cb14 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:20.461514 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-99f54b50-c559-4257-b424-e46ff049cb14 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:20.470081 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-99f54b50-c559-4257-b424-e46ff049cb14 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:20.470234 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ca8b4e78-e8ef-4122-ad31-c84a1f8940dc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:20.471580 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-99f54b50-c559-4257-b424-e46ff049cb14 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:20.472759 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-99f54b50-c559-4257-b424-e46ff049cb14 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.090922 May 24 15:41:20.473321 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1246/2498] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:41:20 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:41:20.478068 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-ca8b4e78-e8ef-4122-ad31-c84a1f8940dc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.147509 May 24 15:41:20.479268 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1253/2499] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:20 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:20.592386 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-048fd454-2939-4c15-a1b5-6fa225c64129 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:20.593271 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-048fd454-2939-4c15-a1b5-6fa225c64129 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:20.599266 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-048fd454-2939-4c15-a1b5-6fa225c64129 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:20.599708 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-048fd454-2939-4c15-a1b5-6fa225c64129 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:20.600490 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-048fd454-2939-4c15-a1b5-6fa225c64129 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:20.600919 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-048fd454-2939-4c15-a1b5-6fa225c64129 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:20.733022 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-048fd454-2939-4c15-a1b5-6fa225c64129 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:20.740891 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-048fd454-2939-4c15-a1b5-6fa225c64129 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.153876 May 24 15:41:20.741715 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1247/2500] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:20 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:20.877330 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-42ffeaef-c0bd-448e-8fa3-9357d0a62909 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:20.877863 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-42ffeaef-c0bd-448e-8fa3-9357d0a62909 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:20.883777 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-42ffeaef-c0bd-448e-8fa3-9357d0a62909 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:20.884225 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-42ffeaef-c0bd-448e-8fa3-9357d0a62909 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:20.885061 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-42ffeaef-c0bd-448e-8fa3-9357d0a62909 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:20.885491 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-42ffeaef-c0bd-448e-8fa3-9357d0a62909 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:21.014074 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-42ffeaef-c0bd-448e-8fa3-9357d0a62909 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:21.022038 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-42ffeaef-c0bd-448e-8fa3-9357d0a62909 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.148519 May 24 15:41:21.022600 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1254/2501] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:20 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:21.491758 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-82fb64d4-d08b-42bd-b2ae-612d66f5bc62 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:21.492366 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-82fb64d4-d08b-42bd-b2ae-612d66f5bc62 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:21.494871 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-cae9d855-3145-4a87-b07d-293bf1bdec0d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:21.495474 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-cae9d855-3145-4a87-b07d-293bf1bdec0d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:21.499733 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-82fb64d4-d08b-42bd-b2ae-612d66f5bc62 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:21.500188 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-82fb64d4-d08b-42bd-b2ae-612d66f5bc62 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:21.501005 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-82fb64d4-d08b-42bd-b2ae-612d66f5bc62 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:21.501443 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-82fb64d4-d08b-42bd-b2ae-612d66f5bc62 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:21.502009 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cae9d855-3145-4a87-b07d-293bf1bdec0d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:21.502456 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cae9d855-3145-4a87-b07d-293bf1bdec0d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:21.503208 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cae9d855-3145-4a87-b07d-293bf1bdec0d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:21.503635 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cae9d855-3145-4a87-b07d-293bf1bdec0d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:21.564105 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-82fb64d4-d08b-42bd-b2ae-612d66f5bc62 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:21.573185 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-82fb64d4-d08b-42bd-b2ae-612d66f5bc62 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:21.574694 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-82fb64d4-d08b-42bd-b2ae-612d66f5bc62 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:21.575841 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-82fb64d4-d08b-42bd-b2ae-612d66f5bc62 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.088342 May 24 15:41:21.576411 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1248/2502] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:41:21 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:21.629334 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-cae9d855-3145-4a87-b07d-293bf1bdec0d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:21.637705 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-cae9d855-3145-4a87-b07d-293bf1bdec0d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.146896 May 24 15:41:21.638261 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1255/2503] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:21 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:21.757984 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-8d5e81e5-bf09-44ed-b290-ef3f386221a4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:21.758551 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-8d5e81e5-bf09-44ed-b290-ef3f386221a4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:21.765280 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8d5e81e5-bf09-44ed-b290-ef3f386221a4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:21.765725 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8d5e81e5-bf09-44ed-b290-ef3f386221a4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:21.766490 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8d5e81e5-bf09-44ed-b290-ef3f386221a4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:21.766953 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8d5e81e5-bf09-44ed-b290-ef3f386221a4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:21.893816 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-8d5e81e5-bf09-44ed-b290-ef3f386221a4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:21.902342 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-8d5e81e5-bf09-44ed-b290-ef3f386221a4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.148329 May 24 15:41:21.902906 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1249/2504] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:21 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:22.038889 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-60645e79-6a49-42dd-b080-0ca7f7d0df90 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:22.039422 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-60645e79-6a49-42dd-b080-0ca7f7d0df90 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:22.045462 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-60645e79-6a49-42dd-b080-0ca7f7d0df90 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:22.045904 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-60645e79-6a49-42dd-b080-0ca7f7d0df90 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:22.046650 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-60645e79-6a49-42dd-b080-0ca7f7d0df90 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:22.047076 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-60645e79-6a49-42dd-b080-0ca7f7d0df90 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:22.179998 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-60645e79-6a49-42dd-b080-0ca7f7d0df90 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:22.188185 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-60645e79-6a49-42dd-b080-0ca7f7d0df90 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.153212 May 24 15:41:22.188780 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1256/2505] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:22 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:22.592838 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-ca3225ce-7033-455c-ae88-73fe15042e01 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:22.593442 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-ca3225ce-7033-455c-ae88-73fe15042e01 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:22.599983 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ca3225ce-7033-455c-ae88-73fe15042e01 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:22.600456 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ca3225ce-7033-455c-ae88-73fe15042e01 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:22.601215 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ca3225ce-7033-455c-ae88-73fe15042e01 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:22.601644 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ca3225ce-7033-455c-ae88-73fe15042e01 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:22.654586 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-9b77b260-671f-44c1-97c9-d8f3e59bfb9f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:22.655198 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-9b77b260-671f-44c1-97c9-d8f3e59bfb9f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:22.661991 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9b77b260-671f-44c1-97c9-d8f3e59bfb9f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:22.662440 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9b77b260-671f-44c1-97c9-d8f3e59bfb9f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:22.663123 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-ca3225ce-7033-455c-ae88-73fe15042e01 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:22.663258 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9b77b260-671f-44c1-97c9-d8f3e59bfb9f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:22.663613 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9b77b260-671f-44c1-97c9-d8f3e59bfb9f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:22.672203 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-ca3225ce-7033-455c-ae88-73fe15042e01 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:22.674071 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-ca3225ce-7033-455c-ae88-73fe15042e01 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:22.675213 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-ca3225ce-7033-455c-ae88-73fe15042e01 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.086266 May 24 15:41:22.675768 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1250/2506] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:41:22 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:22.789521 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-9b77b260-671f-44c1-97c9-d8f3e59bfb9f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:22.797860 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-9b77b260-671f-44c1-97c9-d8f3e59bfb9f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.147166 May 24 15:41:22.798421 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1257/2507] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:22 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:41:22.919777 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-1af5276e-39be-4da5-9e5f-8840140847ad tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:22.920337 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-1af5276e-39be-4da5-9e5f-8840140847ad tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:22.926304 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1af5276e-39be-4da5-9e5f-8840140847ad tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:22.926749 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1af5276e-39be-4da5-9e5f-8840140847ad tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:22.927495 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1af5276e-39be-4da5-9e5f-8840140847ad tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:22.927924 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1af5276e-39be-4da5-9e5f-8840140847ad tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:23.051869 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-1af5276e-39be-4da5-9e5f-8840140847ad tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:23.060384 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-1af5276e-39be-4da5-9e5f-8840140847ad tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.145088 May 24 15:41:23.060940 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1251/2508] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:22 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:41:23.205552 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e6536d26-8ea0-4bff-9dc7-2f928c5f5601 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:23.206099 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e6536d26-8ea0-4bff-9dc7-2f928c5f5601 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:23.212096 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e6536d26-8ea0-4bff-9dc7-2f928c5f5601 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:23.213104 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e6536d26-8ea0-4bff-9dc7-2f928c5f5601 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:23.213858 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e6536d26-8ea0-4bff-9dc7-2f928c5f5601 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:23.214290 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e6536d26-8ea0-4bff-9dc7-2f928c5f5601 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:23.338061 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e6536d26-8ea0-4bff-9dc7-2f928c5f5601 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:23.345950 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e6536d26-8ea0-4bff-9dc7-2f928c5f5601 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.144342 May 24 15:41:23.346503 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1258/2509] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:23 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:23.693545 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a30f5c94-c442-41e1-8014-651bd46cf6df tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:23.694155 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a30f5c94-c442-41e1-8014-651bd46cf6df tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:23.701081 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a30f5c94-c442-41e1-8014-651bd46cf6df tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:23.701529 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a30f5c94-c442-41e1-8014-651bd46cf6df tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:23.702403 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a30f5c94-c442-41e1-8014-651bd46cf6df tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:23.702836 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a30f5c94-c442-41e1-8014-651bd46cf6df tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:23.766766 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-a30f5c94-c442-41e1-8014-651bd46cf6df tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:23.775144 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-a30f5c94-c442-41e1-8014-651bd46cf6df tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:23.776654 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-a30f5c94-c442-41e1-8014-651bd46cf6df tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:23.777784 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a30f5c94-c442-41e1-8014-651bd46cf6df tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.088352 May 24 15:41:23.778333 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1252/2510] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:41:23 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:23.814889 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-58dcc454-2a34-45c6-891a-a808929cab10 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:23.815494 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-58dcc454-2a34-45c6-891a-a808929cab10 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:23.822139 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-58dcc454-2a34-45c6-891a-a808929cab10 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:23.822582 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-58dcc454-2a34-45c6-891a-a808929cab10 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:23.823324 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-58dcc454-2a34-45c6-891a-a808929cab10 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:23.823751 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-58dcc454-2a34-45c6-891a-a808929cab10 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:23.950827 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-58dcc454-2a34-45c6-891a-a808929cab10 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:23.958594 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-58dcc454-2a34-45c6-891a-a808929cab10 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.147479 May 24 15:41:23.959151 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1259/2511] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:23 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:24.077846 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-1f518206-a8e3-4e12-b5b7-6b2bed23cf1a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:24.078460 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-1f518206-a8e3-4e12-b5b7-6b2bed23cf1a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:24.084599 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1f518206-a8e3-4e12-b5b7-6b2bed23cf1a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:24.085044 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1f518206-a8e3-4e12-b5b7-6b2bed23cf1a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:24.085800 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1f518206-a8e3-4e12-b5b7-6b2bed23cf1a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:24.086233 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1f518206-a8e3-4e12-b5b7-6b2bed23cf1a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:24.213901 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-1f518206-a8e3-4e12-b5b7-6b2bed23cf1a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:24.222010 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-1f518206-a8e3-4e12-b5b7-6b2bed23cf1a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.148461 May 24 15:41:24.222581 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1253/2512] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:24 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:24.363014 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d1f1fe63-a309-43f3-9c6f-64ff012ca050 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:24.363630 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d1f1fe63-a309-43f3-9c6f-64ff012ca050 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:24.370119 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d1f1fe63-a309-43f3-9c6f-64ff012ca050 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:24.370571 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d1f1fe63-a309-43f3-9c6f-64ff012ca050 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:24.371333 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d1f1fe63-a309-43f3-9c6f-64ff012ca050 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:24.371774 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d1f1fe63-a309-43f3-9c6f-64ff012ca050 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:24.499047 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-d1f1fe63-a309-43f3-9c6f-64ff012ca050 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:24.506925 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d1f1fe63-a309-43f3-9c6f-64ff012ca050 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.147781 May 24 15:41:24.507479 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1260/2513] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:24 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:24.796780 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-17b2d52f-f511-4be4-8aa0-bd6a072e35dd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:24.797385 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-17b2d52f-f511-4be4-8aa0-bd6a072e35dd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:24.803783 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-17b2d52f-f511-4be4-8aa0-bd6a072e35dd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:24.804222 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-17b2d52f-f511-4be4-8aa0-bd6a072e35dd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:24.805008 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-17b2d52f-f511-4be4-8aa0-bd6a072e35dd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:24.805433 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-17b2d52f-f511-4be4-8aa0-bd6a072e35dd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:24.823298 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:41:24.869272 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-17b2d52f-f511-4be4-8aa0-bd6a072e35dd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:24.877935 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-17b2d52f-f511-4be4-8aa0-bd6a072e35dd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:24.879440 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-17b2d52f-f511-4be4-8aa0-bd6a072e35dd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:24.880620 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-17b2d52f-f511-4be4-8aa0-bd6a072e35dd tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.087784 May 24 15:41:24.881192 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1254/2514] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:41:24 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:24.975031 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-16101754-2dec-44a0-8b35-d69ac22643d3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:24.975750 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-16101754-2dec-44a0-8b35-d69ac22643d3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:24.982295 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-16101754-2dec-44a0-8b35-d69ac22643d3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:24.982814 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-16101754-2dec-44a0-8b35-d69ac22643d3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:24.983640 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-16101754-2dec-44a0-8b35-d69ac22643d3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:24.984138 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-16101754-2dec-44a0-8b35-d69ac22643d3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:25.188895 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-16101754-2dec-44a0-8b35-d69ac22643d3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:25.197019 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-16101754-2dec-44a0-8b35-d69ac22643d3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.225988 May 24 15:41:25.197604 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1261/2515] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:24 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:25.238820 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-3e3cebd6-604d-430e-92ec-ded5a1e1c3d4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:25.239440 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-3e3cebd6-604d-430e-92ec-ded5a1e1c3d4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:25.246554 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3e3cebd6-604d-430e-92ec-ded5a1e1c3d4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:25.247026 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3e3cebd6-604d-430e-92ec-ded5a1e1c3d4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:25.247783 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3e3cebd6-604d-430e-92ec-ded5a1e1c3d4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:25.248217 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3e3cebd6-604d-430e-92ec-ded5a1e1c3d4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:25.377645 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-3e3cebd6-604d-430e-92ec-ded5a1e1c3d4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:25.386013 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-3e3cebd6-604d-430e-92ec-ded5a1e1c3d4 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.150976 May 24 15:41:25.395623 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1255/2516] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:25 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:25.523625 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-2e3f4e2a-31e6-432f-8191-c77a8e758586 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:25.524236 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-2e3f4e2a-31e6-432f-8191-c77a8e758586 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:25.530653 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2e3f4e2a-31e6-432f-8191-c77a8e758586 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:25.531093 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2e3f4e2a-31e6-432f-8191-c77a8e758586 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:25.531835 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2e3f4e2a-31e6-432f-8191-c77a8e758586 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:25.532266 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2e3f4e2a-31e6-432f-8191-c77a8e758586 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:25.550245 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:41:25.658490 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-2e3f4e2a-31e6-432f-8191-c77a8e758586 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:25.666971 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-2e3f4e2a-31e6-432f-8191-c77a8e758586 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.147199 May 24 15:41:25.667529 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1262/2517] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:25 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:25.897649 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-06e53ce4-c5b6-41e2-a728-55408a9bacb3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:25.898209 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-06e53ce4-c5b6-41e2-a728-55408a9bacb3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:25.905354 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-06e53ce4-c5b6-41e2-a728-55408a9bacb3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:25.905800 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-06e53ce4-c5b6-41e2-a728-55408a9bacb3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:25.906563 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-06e53ce4-c5b6-41e2-a728-55408a9bacb3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:25.907012 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-06e53ce4-c5b6-41e2-a728-55408a9bacb3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:25.969851 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-06e53ce4-c5b6-41e2-a728-55408a9bacb3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:25.978215 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-06e53ce4-c5b6-41e2-a728-55408a9bacb3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:25.979708 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-06e53ce4-c5b6-41e2-a728-55408a9bacb3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:25.980873 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-06e53ce4-c5b6-41e2-a728-55408a9bacb3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.087236 May 24 15:41:25.981433 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1256/2518] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:41:25 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:26.213831 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-5dac69b5-2d07-4959-9d7f-c7c38416124a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:26.214349 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-5dac69b5-2d07-4959-9d7f-c7c38416124a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:26.220888 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5dac69b5-2d07-4959-9d7f-c7c38416124a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:26.221331 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5dac69b5-2d07-4959-9d7f-c7c38416124a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:26.222095 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5dac69b5-2d07-4959-9d7f-c7c38416124a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:26.222526 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5dac69b5-2d07-4959-9d7f-c7c38416124a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:26.345946 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-5dac69b5-2d07-4959-9d7f-c7c38416124a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:26.353852 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-5dac69b5-2d07-4959-9d7f-c7c38416124a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.143985 May 24 15:41:26.354407 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1263/2519] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:26 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:26.402782 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-cd55830a-25d6-4cc2-beab-f2a8aeb11abe tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:26.403431 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-cd55830a-25d6-4cc2-beab-f2a8aeb11abe tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:26.405343 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_api:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:41:26.411535 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cd55830a-25d6-4cc2-beab-f2a8aeb11abe tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:26.411972 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cd55830a-25d6-4cc2-beab-f2a8aeb11abe tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:26.412776 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cd55830a-25d6-4cc2-beab-f2a8aeb11abe tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:26.413216 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cd55830a-25d6-4cc2-beab-f2a8aeb11abe tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:26.538012 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-cd55830a-25d6-4cc2-beab-f2a8aeb11abe tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:26.546465 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-cd55830a-25d6-4cc2-beab-f2a8aeb11abe tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.147539 May 24 15:41:26.547029 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1257/2520] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:26 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:26.683403 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-24282867-b657-419b-abc8-ea4014fbb28b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:26.684005 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-24282867-b657-419b-abc8-ea4014fbb28b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:26.689990 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-24282867-b657-419b-abc8-ea4014fbb28b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:26.690428 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-24282867-b657-419b-abc8-ea4014fbb28b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:26.691172 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-24282867-b657-419b-abc8-ea4014fbb28b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:26.691600 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-24282867-b657-419b-abc8-ea4014fbb28b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:26.819508 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-24282867-b657-419b-abc8-ea4014fbb28b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:26.828025 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-24282867-b657-419b-abc8-ea4014fbb28b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.148332 May 24 15:41:26.828624 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1264/2521] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:26 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:26.999018 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-ec519953-9015-46f6-af17-4aa8d4911656 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:26.999637 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-ec519953-9015-46f6-af17-4aa8d4911656 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:27.006127 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ec519953-9015-46f6-af17-4aa8d4911656 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:27.006581 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ec519953-9015-46f6-af17-4aa8d4911656 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:27.007341 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ec519953-9015-46f6-af17-4aa8d4911656 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:27.007780 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ec519953-9015-46f6-af17-4aa8d4911656 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:27.071584 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-ec519953-9015-46f6-af17-4aa8d4911656 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:27.080724 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-ec519953-9015-46f6-af17-4aa8d4911656 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:27.082222 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-ec519953-9015-46f6-af17-4aa8d4911656 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:27.083381 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-ec519953-9015-46f6-af17-4aa8d4911656 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.088269 May 24 15:41:27.083939 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1258/2522] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:41:26 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:27.371672 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-520515de-c82f-43b4-a2bf-56ee248f895f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:27.372229 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-520515de-c82f-43b4-a2bf-56ee248f895f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:27.378773 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-520515de-c82f-43b4-a2bf-56ee248f895f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:27.379219 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-520515de-c82f-43b4-a2bf-56ee248f895f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:27.379973 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-520515de-c82f-43b4-a2bf-56ee248f895f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:27.380435 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-520515de-c82f-43b4-a2bf-56ee248f895f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:27.505609 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-520515de-c82f-43b4-a2bf-56ee248f895f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:27.513518 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-520515de-c82f-43b4-a2bf-56ee248f895f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.146464 May 24 15:41:27.514080 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1265/2523] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:27 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:27.563221 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-7dacb4e5-d85a-4d8b-82e1-8d80b987971f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:27.563828 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-7dacb4e5-d85a-4d8b-82e1-8d80b987971f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:27.569834 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7dacb4e5-d85a-4d8b-82e1-8d80b987971f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:27.570278 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7dacb4e5-d85a-4d8b-82e1-8d80b987971f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:27.571029 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7dacb4e5-d85a-4d8b-82e1-8d80b987971f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:27.571463 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7dacb4e5-d85a-4d8b-82e1-8d80b987971f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:27.695516 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-7dacb4e5-d85a-4d8b-82e1-8d80b987971f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:27.703443 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-7dacb4e5-d85a-4d8b-82e1-8d80b987971f tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.144061 May 24 15:41:27.704013 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1259/2524] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:27 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:27.844820 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-0f3050e0-700f-470f-942c-4fb52d766fb7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:27.845433 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-0f3050e0-700f-470f-942c-4fb52d766fb7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:27.851400 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0f3050e0-700f-470f-942c-4fb52d766fb7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:27.851853 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0f3050e0-700f-470f-942c-4fb52d766fb7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:27.852645 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0f3050e0-700f-470f-942c-4fb52d766fb7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:27.853738 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0f3050e0-700f-470f-942c-4fb52d766fb7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:27.979964 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-0f3050e0-700f-470f-942c-4fb52d766fb7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:27.987996 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-0f3050e0-700f-470f-942c-4fb52d766fb7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.147000 May 24 15:41:27.988599 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1266/2525] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:27 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:28.100958 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-3c75271b-1068-44f2-8349-98551b17f46b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:28.101576 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-3c75271b-1068-44f2-8349-98551b17f46b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:28.109211 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3c75271b-1068-44f2-8349-98551b17f46b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:28.109665 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3c75271b-1068-44f2-8349-98551b17f46b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:28.110429 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3c75271b-1068-44f2-8349-98551b17f46b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:28.110870 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3c75271b-1068-44f2-8349-98551b17f46b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:28.171395 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-3c75271b-1068-44f2-8349-98551b17f46b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:28.179787 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-3c75271b-1068-44f2-8349-98551b17f46b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:28.181423 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-3c75271b-1068-44f2-8349-98551b17f46b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:28.182523 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-3c75271b-1068-44f2-8349-98551b17f46b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.085449 May 24 15:41:28.183089 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1260/2526] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:41:28 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:28.530384 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-b1ba386a-e040-4efd-a098-c94b60ae9a7e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:28.530997 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-b1ba386a-e040-4efd-a098-c94b60ae9a7e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:28.537482 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b1ba386a-e040-4efd-a098-c94b60ae9a7e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:28.537932 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b1ba386a-e040-4efd-a098-c94b60ae9a7e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:28.538683 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b1ba386a-e040-4efd-a098-c94b60ae9a7e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:28.539118 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b1ba386a-e040-4efd-a098-c94b60ae9a7e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:28.677691 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-b1ba386a-e040-4efd-a098-c94b60ae9a7e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:28.686048 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-b1ba386a-e040-4efd-a098-c94b60ae9a7e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.159550 May 24 15:41:28.686616 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1267/2527] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:28 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:28.720916 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-26bc4162-003f-4d96-908a-4cb696667393 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:28.721532 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-26bc4162-003f-4d96-908a-4cb696667393 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:28.727661 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-26bc4162-003f-4d96-908a-4cb696667393 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:28.728631 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-26bc4162-003f-4d96-908a-4cb696667393 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:28.729398 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-26bc4162-003f-4d96-908a-4cb696667393 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:28.729837 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-26bc4162-003f-4d96-908a-4cb696667393 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:28.856928 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-26bc4162-003f-4d96-908a-4cb696667393 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:28.864848 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-26bc4162-003f-4d96-908a-4cb696667393 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.147774 May 24 15:41:28.865427 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1261/2528] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:28 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:29.005392 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-49abbda9-4d5b-4a58-b093-1243cc94fb10 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:29.005999 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-49abbda9-4d5b-4a58-b093-1243cc94fb10 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:29.011963 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-49abbda9-4d5b-4a58-b093-1243cc94fb10 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:29.012442 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-49abbda9-4d5b-4a58-b093-1243cc94fb10 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:29.013205 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-49abbda9-4d5b-4a58-b093-1243cc94fb10 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:29.013613 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-49abbda9-4d5b-4a58-b093-1243cc94fb10 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:29.141832 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-49abbda9-4d5b-4a58-b093-1243cc94fb10 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:29.149704 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-49abbda9-4d5b-4a58-b093-1243cc94fb10 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.148219 May 24 15:41:29.150753 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1268/2529] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:29 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:41:29.200396 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-21a62430-7918-470a-add5-0a09c7d0f95f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:29.201042 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-21a62430-7918-470a-add5-0a09c7d0f95f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:29.207555 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-21a62430-7918-470a-add5-0a09c7d0f95f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:29.208005 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-21a62430-7918-470a-add5-0a09c7d0f95f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:29.208799 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-21a62430-7918-470a-add5-0a09c7d0f95f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:29.209239 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-21a62430-7918-470a-add5-0a09c7d0f95f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:29.270085 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-21a62430-7918-470a-add5-0a09c7d0f95f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:29.278892 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-21a62430-7918-470a-add5-0a09c7d0f95f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:29.280435 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-21a62430-7918-470a-add5-0a09c7d0f95f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:29.281610 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-21a62430-7918-470a-add5-0a09c7d0f95f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.085063 May 24 15:41:29.282167 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1262/2530] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:41:29 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:29.703313 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-fe8d3e2c-47e8-4072-b498-d18d6dcbfe8c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:29.703918 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-fe8d3e2c-47e8-4072-b498-d18d6dcbfe8c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:29.710378 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fe8d3e2c-47e8-4072-b498-d18d6dcbfe8c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:29.710823 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fe8d3e2c-47e8-4072-b498-d18d6dcbfe8c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:29.711567 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fe8d3e2c-47e8-4072-b498-d18d6dcbfe8c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:29.711994 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fe8d3e2c-47e8-4072-b498-d18d6dcbfe8c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:29.837122 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-fe8d3e2c-47e8-4072-b498-d18d6dcbfe8c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:29.845057 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-fe8d3e2c-47e8-4072-b498-d18d6dcbfe8c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.145618 May 24 15:41:29.845911 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1269/2531] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:29 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:29.882696 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-7e0b2660-a535-4565-8e0e-19afb236d550 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:29.883300 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-7e0b2660-a535-4565-8e0e-19afb236d550 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:29.889971 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7e0b2660-a535-4565-8e0e-19afb236d550 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:29.890410 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7e0b2660-a535-4565-8e0e-19afb236d550 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:29.891153 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7e0b2660-a535-4565-8e0e-19afb236d550 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:29.891575 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7e0b2660-a535-4565-8e0e-19afb236d550 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:30.015140 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-7e0b2660-a535-4565-8e0e-19afb236d550 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:30.023034 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-7e0b2660-a535-4565-8e0e-19afb236d550 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.144268 May 24 15:41:30.023592 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1263/2532] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:29 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:30.166481 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-0fd29221-1887-42bc-b200-a0bcd2ac69ae tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:30.167090 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-0fd29221-1887-42bc-b200-a0bcd2ac69ae tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:30.168929 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_api:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:41:30.174630 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0fd29221-1887-42bc-b200-a0bcd2ac69ae tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:30.175072 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0fd29221-1887-42bc-b200-a0bcd2ac69ae tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:30.175945 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0fd29221-1887-42bc-b200-a0bcd2ac69ae tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:30.176398 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0fd29221-1887-42bc-b200-a0bcd2ac69ae tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:30.299244 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f9c3c5fc-96b1-43f2-8b41-7590ff23c209 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:30.300608 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f9c3c5fc-96b1-43f2-8b41-7590ff23c209 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:30.302056 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-0fd29221-1887-42bc-b200-a0bcd2ac69ae tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:30.307765 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f9c3c5fc-96b1-43f2-8b41-7590ff23c209 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:30.308214 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f9c3c5fc-96b1-43f2-8b41-7590ff23c209 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:30.309003 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f9c3c5fc-96b1-43f2-8b41-7590ff23c209 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:30.309435 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f9c3c5fc-96b1-43f2-8b41-7590ff23c209 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:30.310715 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-0fd29221-1887-42bc-b200-a0bcd2ac69ae tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.148084 May 24 15:41:30.311287 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1270/2533] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:30 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:30.372918 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-f9c3c5fc-96b1-43f2-8b41-7590ff23c209 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:30.381207 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-f9c3c5fc-96b1-43f2-8b41-7590ff23c209 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:30.382704 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-f9c3c5fc-96b1-43f2-8b41-7590ff23c209 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:30.383842 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f9c3c5fc-96b1-43f2-8b41-7590ff23c209 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.088495 May 24 15:41:30.384506 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1264/2534] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:41:30 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:41:30.861795 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-cff7860f-4d67-4b76-a41b-787492286641 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:30.862409 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-cff7860f-4d67-4b76-a41b-787492286641 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:30.869143 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cff7860f-4d67-4b76-a41b-787492286641 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:30.869588 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cff7860f-4d67-4b76-a41b-787492286641 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:30.870340 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cff7860f-4d67-4b76-a41b-787492286641 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:30.870771 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cff7860f-4d67-4b76-a41b-787492286641 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:31.040058 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-10af5f24-acec-41d0-b5e1-11810d8cc569 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:31.040805 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-10af5f24-acec-41d0-b5e1-11810d8cc569 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:31.047545 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-10af5f24-acec-41d0-b5e1-11810d8cc569 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:31.047993 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-10af5f24-acec-41d0-b5e1-11810d8cc569 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:31.048842 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-10af5f24-acec-41d0-b5e1-11810d8cc569 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:31.049285 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-10af5f24-acec-41d0-b5e1-11810d8cc569 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:31.183639 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-10af5f24-acec-41d0-b5e1-11810d8cc569 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:31.191773 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-10af5f24-acec-41d0-b5e1-11810d8cc569 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.155676 May 24 15:41:31.192375 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1265/2535] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:31 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:41:31.218108 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-cff7860f-4d67-4b76-a41b-787492286641 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:31.226020 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-cff7860f-4d67-4b76-a41b-787492286641 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.368057 May 24 15:41:31.226579 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1271/2536] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:30 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:31.327235 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f420fefb-bfb5-4c62-b6e4-d911d7f0df47 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:31.327852 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f420fefb-bfb5-4c62-b6e4-d911d7f0df47 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:31.334336 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f420fefb-bfb5-4c62-b6e4-d911d7f0df47 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:31.334788 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f420fefb-bfb5-4c62-b6e4-d911d7f0df47 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:31.335558 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f420fefb-bfb5-4c62-b6e4-d911d7f0df47 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:31.335994 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f420fefb-bfb5-4c62-b6e4-d911d7f0df47 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:31.401465 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-585396fd-2474-4ebf-9302-24223ee5105f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:31.402016 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-585396fd-2474-4ebf-9302-24223ee5105f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:31.408061 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-585396fd-2474-4ebf-9302-24223ee5105f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:31.408548 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-585396fd-2474-4ebf-9302-24223ee5105f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:31.409316 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-585396fd-2474-4ebf-9302-24223ee5105f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:31.409747 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-585396fd-2474-4ebf-9302-24223ee5105f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:31.462991 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-f420fefb-bfb5-4c62-b6e4-d911d7f0df47 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:31.470400 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-585396fd-2474-4ebf-9302-24223ee5105f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:31.471249 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f420fefb-bfb5-4c62-b6e4-d911d7f0df47 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.147913 May 24 15:41:31.471832 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1266/2537] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:31 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:31.478850 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-585396fd-2474-4ebf-9302-24223ee5105f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:31.480363 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-585396fd-2474-4ebf-9302-24223ee5105f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:31.481495 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-585396fd-2474-4ebf-9302-24223ee5105f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084085 May 24 15:41:31.482039 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1272/2538] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:41:31 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:41:32.209334 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-b87c3a8d-2935-4c92-bd6b-482bae482aca tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:32.209940 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-b87c3a8d-2935-4c92-bd6b-482bae482aca tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:32.216494 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b87c3a8d-2935-4c92-bd6b-482bae482aca tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:32.216937 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b87c3a8d-2935-4c92-bd6b-482bae482aca tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:32.217684 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b87c3a8d-2935-4c92-bd6b-482bae482aca tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:32.218111 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b87c3a8d-2935-4c92-bd6b-482bae482aca tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:32.242958 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-6c22b54c-8ffc-466b-9b69-6621a713fc75 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:32.243547 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-6c22b54c-8ffc-466b-9b69-6621a713fc75 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:32.250009 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6c22b54c-8ffc-466b-9b69-6621a713fc75 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:32.250453 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6c22b54c-8ffc-466b-9b69-6621a713fc75 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:32.251201 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6c22b54c-8ffc-466b-9b69-6621a713fc75 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:32.251629 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6c22b54c-8ffc-466b-9b69-6621a713fc75 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:32.351225 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-b87c3a8d-2935-4c92-bd6b-482bae482aca tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:32.359872 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-b87c3a8d-2935-4c92-bd6b-482bae482aca tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.154373 May 24 15:41:32.360471 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1267/2539] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:32 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:41:32.383660 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-6c22b54c-8ffc-466b-9b69-6621a713fc75 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:32.391666 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-6c22b54c-8ffc-466b-9b69-6621a713fc75 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.152748 May 24 15:41:32.392223 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1273/2540] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:32 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:41:32.487991 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-9df2c2ef-5562-4a3c-a5d5-0a702d3f6ed4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:32.488631 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-9df2c2ef-5562-4a3c-a5d5-0a702d3f6ed4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:32.495373 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9df2c2ef-5562-4a3c-a5d5-0a702d3f6ed4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:32.495823 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9df2c2ef-5562-4a3c-a5d5-0a702d3f6ed4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:32.496627 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9df2c2ef-5562-4a3c-a5d5-0a702d3f6ed4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:32.497065 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9df2c2ef-5562-4a3c-a5d5-0a702d3f6ed4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:32.498631 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-ab450632-8f50-4208-87fe-150f42b898a1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:32.499234 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-ab450632-8f50-4208-87fe-150f42b898a1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:32.505097 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ab450632-8f50-4208-87fe-150f42b898a1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:32.505533 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ab450632-8f50-4208-87fe-150f42b898a1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:32.506278 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ab450632-8f50-4208-87fe-150f42b898a1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:32.506703 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ab450632-8f50-4208-87fe-150f42b898a1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:32.568852 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ab450632-8f50-4208-87fe-150f42b898a1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:32.578061 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ab450632-8f50-4208-87fe-150f42b898a1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:32.579541 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ab450632-8f50-4208-87fe-150f42b898a1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:32.580690 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-ab450632-8f50-4208-87fe-150f42b898a1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.085811 May 24 15:41:32.581251 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1274/2541] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:41:32 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:32.626660 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-9df2c2ef-5562-4a3c-a5d5-0a702d3f6ed4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:32.635071 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-9df2c2ef-5562-4a3c-a5d5-0a702d3f6ed4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.151004 May 24 15:41:32.635635 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1268/2542] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:32 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:33.376334 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-b51d641a-a4dc-49f1-9823-76a6e2e96660 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:33.376863 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-b51d641a-a4dc-49f1-9823-76a6e2e96660 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:33.383612 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b51d641a-a4dc-49f1-9823-76a6e2e96660 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:33.384643 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b51d641a-a4dc-49f1-9823-76a6e2e96660 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:33.385402 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b51d641a-a4dc-49f1-9823-76a6e2e96660 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:33.385842 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b51d641a-a4dc-49f1-9823-76a6e2e96660 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:33.408813 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-23c42079-597a-4443-bd95-e9290ed6a562 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:33.409467 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-23c42079-597a-4443-bd95-e9290ed6a562 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:33.415926 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-23c42079-597a-4443-bd95-e9290ed6a562 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:33.416399 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-23c42079-597a-4443-bd95-e9290ed6a562 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:33.417163 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-23c42079-597a-4443-bd95-e9290ed6a562 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:33.417603 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-23c42079-597a-4443-bd95-e9290ed6a562 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:33.513944 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-b51d641a-a4dc-49f1-9823-76a6e2e96660 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:33.521843 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-b51d641a-a4dc-49f1-9823-76a6e2e96660 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.149449 May 24 15:41:33.522407 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1275/2543] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:33 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:33.548858 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-23c42079-597a-4443-bd95-e9290ed6a562 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:33.557353 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-23c42079-597a-4443-bd95-e9290ed6a562 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.152375 May 24 15:41:33.557924 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1269/2544] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:33 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:41:33.598844 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e5455edc-d621-43d6-a8d0-9f2911a5d37d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:33.599458 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e5455edc-d621-43d6-a8d0-9f2911a5d37d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:33.605500 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e5455edc-d621-43d6-a8d0-9f2911a5d37d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:33.605945 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e5455edc-d621-43d6-a8d0-9f2911a5d37d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:33.606704 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e5455edc-d621-43d6-a8d0-9f2911a5d37d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:33.607139 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e5455edc-d621-43d6-a8d0-9f2911a5d37d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:33.650829 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e74ea084-de0b-4d0a-bb62-58573f6d1e50 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:33.651374 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-e74ea084-de0b-4d0a-bb62-58573f6d1e50 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:33.657499 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e74ea084-de0b-4d0a-bb62-58573f6d1e50 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:33.657954 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e74ea084-de0b-4d0a-bb62-58573f6d1e50 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:33.658720 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e74ea084-de0b-4d0a-bb62-58573f6d1e50 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:33.659156 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e74ea084-de0b-4d0a-bb62-58573f6d1e50 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:33.666945 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e5455edc-d621-43d6-a8d0-9f2911a5d37d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:33.675305 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e5455edc-d621-43d6-a8d0-9f2911a5d37d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:33.676833 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e5455edc-d621-43d6-a8d0-9f2911a5d37d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:33.677970 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e5455edc-d621-43d6-a8d0-9f2911a5d37d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.083002 May 24 15:41:33.678530 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1276/2545] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:41:33 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:33.785230 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-e74ea084-de0b-4d0a-bb62-58573f6d1e50 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:33.793069 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-e74ea084-de0b-4d0a-bb62-58573f6d1e50 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.146192 May 24 15:41:33.793625 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1270/2546] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:33 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:41:34.539634 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c050e9be-7502-4dbf-ab25-8484723e4f25 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:34.540244 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-c050e9be-7502-4dbf-ab25-8484723e4f25 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:34.546940 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c050e9be-7502-4dbf-ab25-8484723e4f25 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:34.547375 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c050e9be-7502-4dbf-ab25-8484723e4f25 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:34.548119 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c050e9be-7502-4dbf-ab25-8484723e4f25 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:34.548570 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c050e9be-7502-4dbf-ab25-8484723e4f25 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:34.574438 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-4c865198-8898-42af-bb47-1185401685c2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:34.575132 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-4c865198-8898-42af-bb47-1185401685c2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:34.581637 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4c865198-8898-42af-bb47-1185401685c2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:34.582080 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4c865198-8898-42af-bb47-1185401685c2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:34.582836 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4c865198-8898-42af-bb47-1185401685c2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:34.583270 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4c865198-8898-42af-bb47-1185401685c2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:34.587254 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:41:34.678160 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-c050e9be-7502-4dbf-ab25-8484723e4f25 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:34.686558 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-c050e9be-7502-4dbf-ab25-8484723e4f25 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.150728 May 24 15:41:34.687328 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1277/2547] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:34 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:34.701525 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-846d5847-e752-4d2a-997a-4239eb24dfe4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:34.702162 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-846d5847-e752-4d2a-997a-4239eb24dfe4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:34.708134 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-846d5847-e752-4d2a-997a-4239eb24dfe4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:34.708619 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-846d5847-e752-4d2a-997a-4239eb24dfe4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:34.709445 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-846d5847-e752-4d2a-997a-4239eb24dfe4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:34.709804 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-846d5847-e752-4d2a-997a-4239eb24dfe4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:34.711993 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-4c865198-8898-42af-bb47-1185401685c2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:34.720031 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-4c865198-8898-42af-bb47-1185401685c2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.150061 May 24 15:41:34.720630 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1271/2548] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:34 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:41:34.770564 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-846d5847-e752-4d2a-997a-4239eb24dfe4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:34.778840 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-846d5847-e752-4d2a-997a-4239eb24dfe4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:34.780355 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-846d5847-e752-4d2a-997a-4239eb24dfe4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:34.781479 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-846d5847-e752-4d2a-997a-4239eb24dfe4 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.083769 May 24 15:41:34.782037 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1278/2549] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:41:34 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:41:34.810271 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-aaf15f77-3a34-4e5b-8243-bcbe9680cfe8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:34.810835 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-aaf15f77-3a34-4e5b-8243-bcbe9680cfe8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:34.816816 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-aaf15f77-3a34-4e5b-8243-bcbe9680cfe8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:34.817268 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-aaf15f77-3a34-4e5b-8243-bcbe9680cfe8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:34.818029 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-aaf15f77-3a34-4e5b-8243-bcbe9680cfe8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:34.818467 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-aaf15f77-3a34-4e5b-8243-bcbe9680cfe8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:34.945615 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-aaf15f77-3a34-4e5b-8243-bcbe9680cfe8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:34.953903 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-aaf15f77-3a34-4e5b-8243-bcbe9680cfe8 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.148085 May 24 15:41:34.954488 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1272/2550] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:34 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:35.705025 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-770a0dc2-dc34-4376-895c-ec3eae0d374a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:35.706034 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-770a0dc2-dc34-4376-895c-ec3eae0d374a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:35.713250 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-770a0dc2-dc34-4376-895c-ec3eae0d374a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:35.713689 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-770a0dc2-dc34-4376-895c-ec3eae0d374a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:35.714439 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-770a0dc2-dc34-4376-895c-ec3eae0d374a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:35.714866 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-770a0dc2-dc34-4376-895c-ec3eae0d374a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:35.718718 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:41:35.737712 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-ef3e6e23-a844-4baf-ab5e-a448c127d156 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:35.738322 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-ef3e6e23-a844-4baf-ab5e-a448c127d156 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:35.745156 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ef3e6e23-a844-4baf-ab5e-a448c127d156 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:35.745603 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ef3e6e23-a844-4baf-ab5e-a448c127d156 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:35.746366 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ef3e6e23-a844-4baf-ab5e-a448c127d156 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:35.746798 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ef3e6e23-a844-4baf-ab5e-a448c127d156 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:35.842034 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-770a0dc2-dc34-4376-895c-ec3eae0d374a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:35.850004 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-770a0dc2-dc34-4376-895c-ec3eae0d374a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.150187 May 24 15:41:35.850568 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1279/2551] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:35 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:35.854946 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-7337dd12-3b95-4692-88a7-d15da7755df8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:35.855529 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-7337dd12-3b95-4692-88a7-d15da7755df8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:35.861371 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7337dd12-3b95-4692-88a7-d15da7755df8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:35.861809 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7337dd12-3b95-4692-88a7-d15da7755df8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:35.862559 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7337dd12-3b95-4692-88a7-d15da7755df8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:35.862983 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7337dd12-3b95-4692-88a7-d15da7755df8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:35.877827 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-ef3e6e23-a844-4baf-ab5e-a448c127d156 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:35.886472 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-ef3e6e23-a844-4baf-ab5e-a448c127d156 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.152645 May 24 15:41:35.887037 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1273/2552] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:35 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:41:35.926632 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-7337dd12-3b95-4692-88a7-d15da7755df8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:35.935399 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-7337dd12-3b95-4692-88a7-d15da7755df8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:35.936913 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-7337dd12-3b95-4692-88a7-d15da7755df8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:35.938029 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-7337dd12-3b95-4692-88a7-d15da7755df8 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.086569 May 24 15:41:35.938583 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1280/2553] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:41:35 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:35.970775 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-1d47613b-6d28-4e12-8c71-9ca2609889c9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:35.971393 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-1d47613b-6d28-4e12-8c71-9ca2609889c9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:35.977490 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1d47613b-6d28-4e12-8c71-9ca2609889c9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:35.977940 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1d47613b-6d28-4e12-8c71-9ca2609889c9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:35.978701 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1d47613b-6d28-4e12-8c71-9ca2609889c9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:35.979138 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1d47613b-6d28-4e12-8c71-9ca2609889c9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:36.113206 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-1d47613b-6d28-4e12-8c71-9ca2609889c9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:36.122109 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-1d47613b-6d28-4e12-8c71-9ca2609889c9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.155200 May 24 15:41:36.122677 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1274/2554] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:35 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:36.867076 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-4be51749-7947-49fe-bc6c-82c1670feb94 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:36.867680 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-4be51749-7947-49fe-bc6c-82c1670feb94 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:36.874195 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4be51749-7947-49fe-bc6c-82c1670feb94 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:36.874634 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4be51749-7947-49fe-bc6c-82c1670feb94 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:36.875380 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4be51749-7947-49fe-bc6c-82c1670feb94 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:36.875805 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4be51749-7947-49fe-bc6c-82c1670feb94 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:36.903645 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-ba944829-1a86-480f-b4f8-632ede916c41 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:36.904497 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-ba944829-1a86-480f-b4f8-632ede916c41 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:36.911350 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ba944829-1a86-480f-b4f8-632ede916c41 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:36.911892 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ba944829-1a86-480f-b4f8-632ede916c41 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:36.912712 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ba944829-1a86-480f-b4f8-632ede916c41 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:36.913142 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ba944829-1a86-480f-b4f8-632ede916c41 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:37.002756 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-4be51749-7947-49fe-bc6c-82c1670feb94 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:37.011348 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-4be51749-7947-49fe-bc6c-82c1670feb94 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.148279 May 24 15:41:37.012158 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1281/2555] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:36 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:37.016599 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-2c2da802-096b-4478-9ddc-adbc5035c2ba tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:37.017205 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-2c2da802-096b-4478-9ddc-adbc5035c2ba tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:37.022909 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2c2da802-096b-4478-9ddc-adbc5035c2ba tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:37.023626 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2c2da802-096b-4478-9ddc-adbc5035c2ba tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:37.024091 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2c2da802-096b-4478-9ddc-adbc5035c2ba tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:37.025348 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2c2da802-096b-4478-9ddc-adbc5035c2ba tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:37.045122 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-ba944829-1a86-480f-b4f8-632ede916c41 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:37.053263 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-ba944829-1a86-480f-b4f8-632ede916c41 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.153945 May 24 15:41:37.053847 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1275/2556] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:36 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:41:37.089460 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-2c2da802-096b-4478-9ddc-adbc5035c2ba tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:37.097775 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-2c2da802-096b-4478-9ddc-adbc5035c2ba tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:37.099281 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-2c2da802-096b-4478-9ddc-adbc5035c2ba tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:37.100435 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-2c2da802-096b-4478-9ddc-adbc5035c2ba tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.087560 May 24 15:41:37.100988 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1282/2557] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:41:37 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:37.139449 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-3f382428-7328-401f-8e54-c978b1bfeb04 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:37.139997 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-3f382428-7328-401f-8e54-c978b1bfeb04 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:37.146217 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3f382428-7328-401f-8e54-c978b1bfeb04 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:37.146657 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3f382428-7328-401f-8e54-c978b1bfeb04 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:37.147407 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3f382428-7328-401f-8e54-c978b1bfeb04 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:37.147858 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3f382428-7328-401f-8e54-c978b1bfeb04 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:37.275700 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-3f382428-7328-401f-8e54-c978b1bfeb04 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:37.283547 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-3f382428-7328-401f-8e54-c978b1bfeb04 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.148075 May 24 15:41:37.284143 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1276/2558] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:37 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:38.028548 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-b6f38651-bd54-438a-83db-7ddd5bed80ab tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:38.029149 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-b6f38651-bd54-438a-83db-7ddd5bed80ab tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:38.035750 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b6f38651-bd54-438a-83db-7ddd5bed80ab tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:38.036204 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b6f38651-bd54-438a-83db-7ddd5bed80ab tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:38.036991 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b6f38651-bd54-438a-83db-7ddd5bed80ab tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:38.037429 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b6f38651-bd54-438a-83db-7ddd5bed80ab tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:38.070164 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-414b32de-3024-438d-9ec4-d44efdef2c3a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:38.070943 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-414b32de-3024-438d-9ec4-d44efdef2c3a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:38.077679 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-414b32de-3024-438d-9ec4-d44efdef2c3a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:38.078213 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-414b32de-3024-438d-9ec4-d44efdef2c3a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:38.079079 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-414b32de-3024-438d-9ec4-d44efdef2c3a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:38.079591 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-414b32de-3024-438d-9ec4-d44efdef2c3a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:38.171739 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-b6f38651-bd54-438a-83db-7ddd5bed80ab tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:38.180073 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-b6f38651-bd54-438a-83db-7ddd5bed80ab tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.155572 May 24 15:41:38.180683 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1283/2559] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:38 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:38.185447 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-47533002-2f03-4ce7-a47e-a2a7747a542c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:38.185447 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-47533002-2f03-4ce7-a47e-a2a7747a542c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:38.192188 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-47533002-2f03-4ce7-a47e-a2a7747a542c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:38.192663 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-47533002-2f03-4ce7-a47e-a2a7747a542c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:38.193430 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-47533002-2f03-4ce7-a47e-a2a7747a542c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:38.193860 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-47533002-2f03-4ce7-a47e-a2a7747a542c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:38.257845 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-47533002-2f03-4ce7-a47e-a2a7747a542c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:38.266916 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-47533002-2f03-4ce7-a47e-a2a7747a542c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:38.268446 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-47533002-2f03-4ce7-a47e-a2a7747a542c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:38.269615 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-47533002-2f03-4ce7-a47e-a2a7747a542c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.088014 May 24 15:41:38.270189 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1284/2560] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:41:38 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:38.300853 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-2d1c5fa7-8f4a-4f07-919d-7d3176a24093 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:38.301382 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-2d1c5fa7-8f4a-4f07-919d-7d3176a24093 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:38.307566 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2d1c5fa7-8f4a-4f07-919d-7d3176a24093 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:38.308011 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2d1c5fa7-8f4a-4f07-919d-7d3176a24093 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:38.308902 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2d1c5fa7-8f4a-4f07-919d-7d3176a24093 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:38.309335 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2d1c5fa7-8f4a-4f07-919d-7d3176a24093 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:38.429782 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-414b32de-3024-438d-9ec4-d44efdef2c3a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:38.438948 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-414b32de-3024-438d-9ec4-d44efdef2c3a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.372264 May 24 15:41:38.440350 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1277/2561] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:38 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:41:38.451920 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-2d1c5fa7-8f4a-4f07-919d-7d3176a24093 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:38.460102 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-2d1c5fa7-8f4a-4f07-919d-7d3176a24093 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.163011 May 24 15:41:38.460701 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1285/2562] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:38 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:41:39.198684 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-ba4bc119-6e99-4f64-b680-f030fd521244 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:39.199296 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-ba4bc119-6e99-4f64-b680-f030fd521244 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:39.205926 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ba4bc119-6e99-4f64-b680-f030fd521244 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:39.206374 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ba4bc119-6e99-4f64-b680-f030fd521244 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:39.207132 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ba4bc119-6e99-4f64-b680-f030fd521244 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:39.207567 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ba4bc119-6e99-4f64-b680-f030fd521244 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:39.288483 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-61a1bcdf-5c4e-4708-938d-cf2e82e797e5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:39.289086 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-61a1bcdf-5c4e-4708-938d-cf2e82e797e5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:39.295631 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-61a1bcdf-5c4e-4708-938d-cf2e82e797e5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:39.296846 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-61a1bcdf-5c4e-4708-938d-cf2e82e797e5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:39.297633 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-61a1bcdf-5c4e-4708-938d-cf2e82e797e5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:39.298071 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-61a1bcdf-5c4e-4708-938d-cf2e82e797e5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:39.333251 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-ba4bc119-6e99-4f64-b680-f030fd521244 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:39.341962 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-ba4bc119-6e99-4f64-b680-f030fd521244 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.147564 May 24 15:41:39.342532 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1278/2563] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:39 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:39.361693 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-61a1bcdf-5c4e-4708-938d-cf2e82e797e5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:39.370390 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-61a1bcdf-5c4e-4708-938d-cf2e82e797e5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:39.371902 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-61a1bcdf-5c4e-4708-938d-cf2e82e797e5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:39.373087 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-61a1bcdf-5c4e-4708-938d-cf2e82e797e5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.088490 May 24 15:41:39.373624 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1286/2564] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:41:39 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:39.455843 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a9904777-9cc0-4355-9c13-bd9ba77eb7ca tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:39.456491 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a9904777-9cc0-4355-9c13-bd9ba77eb7ca tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:39.463118 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a9904777-9cc0-4355-9c13-bd9ba77eb7ca tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:39.463558 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a9904777-9cc0-4355-9c13-bd9ba77eb7ca tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:39.464326 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a9904777-9cc0-4355-9c13-bd9ba77eb7ca tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:39.464748 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a9904777-9cc0-4355-9c13-bd9ba77eb7ca tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:39.477352 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-52edaf33-500b-44ae-be12-595c181e91af tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:39.477972 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-52edaf33-500b-44ae-be12-595c181e91af tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:39.483964 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-52edaf33-500b-44ae-be12-595c181e91af tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:39.484460 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-52edaf33-500b-44ae-be12-595c181e91af tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:39.485242 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-52edaf33-500b-44ae-be12-595c181e91af tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:39.485679 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-52edaf33-500b-44ae-be12-595c181e91af tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:39.593994 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-a9904777-9cc0-4355-9c13-bd9ba77eb7ca tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:39.601961 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a9904777-9cc0-4355-9c13-bd9ba77eb7ca tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.149889 May 24 15:41:39.602530 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1279/2565] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:39 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:39.613417 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-52edaf33-500b-44ae-be12-595c181e91af tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:39.622227 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-52edaf33-500b-44ae-be12-595c181e91af tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.148627 May 24 15:41:39.622792 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1287/2566] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:39 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:41:40.359522 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-82bcc45a-f3bf-4c24-b002-c25d26ff2582 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:40.360167 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-82bcc45a-f3bf-4c24-b002-c25d26ff2582 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:40.366511 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-82bcc45a-f3bf-4c24-b002-c25d26ff2582 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:40.367242 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-82bcc45a-f3bf-4c24-b002-c25d26ff2582 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:40.367802 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-82bcc45a-f3bf-4c24-b002-c25d26ff2582 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:40.368136 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-82bcc45a-f3bf-4c24-b002-c25d26ff2582 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:40.391318 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-27741505-4ed9-4843-a838-b3c9aa6f9870 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:40.391920 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-27741505-4ed9-4843-a838-b3c9aa6f9870 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:40.397931 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-27741505-4ed9-4843-a838-b3c9aa6f9870 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:40.398372 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-27741505-4ed9-4843-a838-b3c9aa6f9870 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:40.399123 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-27741505-4ed9-4843-a838-b3c9aa6f9870 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:40.400060 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-27741505-4ed9-4843-a838-b3c9aa6f9870 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:40.460084 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-27741505-4ed9-4843-a838-b3c9aa6f9870 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:40.469092 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-27741505-4ed9-4843-a838-b3c9aa6f9870 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:40.470613 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-27741505-4ed9-4843-a838-b3c9aa6f9870 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:40.471765 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-27741505-4ed9-4843-a838-b3c9aa6f9870 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084467 May 24 15:41:40.472340 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1288/2567] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:41:40 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:40.498013 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-82bcc45a-f3bf-4c24-b002-c25d26ff2582 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:40.506051 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-82bcc45a-f3bf-4c24-b002-c25d26ff2582 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.150519 May 24 15:41:40.506617 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1280/2568] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:40 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:40.619076 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e3394d6f-c2df-4051-a4eb-5a1ab73735cd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:40.619627 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e3394d6f-c2df-4051-a4eb-5a1ab73735cd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:40.625573 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e3394d6f-c2df-4051-a4eb-5a1ab73735cd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:40.626020 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e3394d6f-c2df-4051-a4eb-5a1ab73735cd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:40.626774 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e3394d6f-c2df-4051-a4eb-5a1ab73735cd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:40.627214 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e3394d6f-c2df-4051-a4eb-5a1ab73735cd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:40.638695 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a29c638a-18f7-42b4-8e4a-be0361d6efed tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:40.639303 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a29c638a-18f7-42b4-8e4a-be0361d6efed tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:40.650616 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a29c638a-18f7-42b4-8e4a-be0361d6efed tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:40.651060 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a29c638a-18f7-42b4-8e4a-be0361d6efed tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:40.651829 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a29c638a-18f7-42b4-8e4a-be0361d6efed tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:40.652259 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a29c638a-18f7-42b4-8e4a-be0361d6efed tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:40.762311 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e3394d6f-c2df-4051-a4eb-5a1ab73735cd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:40.770190 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e3394d6f-c2df-4051-a4eb-5a1ab73735cd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.155249 May 24 15:41:40.770756 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1289/2569] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:40 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:40.786014 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-a29c638a-18f7-42b4-8e4a-be0361d6efed tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:40.793845 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a29c638a-18f7-42b4-8e4a-be0361d6efed tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.158985 May 24 15:41:40.794406 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1281/2570] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:40 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:41:41.489968 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-fe0dd2e7-c9eb-43fc-b87d-ee73b7e9f6a7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:41.490579 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-fe0dd2e7-c9eb-43fc-b87d-ee73b7e9f6a7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:41.498016 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fe0dd2e7-c9eb-43fc-b87d-ee73b7e9f6a7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:41.498464 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fe0dd2e7-c9eb-43fc-b87d-ee73b7e9f6a7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:41.499218 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fe0dd2e7-c9eb-43fc-b87d-ee73b7e9f6a7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:41.499651 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fe0dd2e7-c9eb-43fc-b87d-ee73b7e9f6a7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:41.522770 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e21f41df-2ea8-4375-b185-ce5300fd3966 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:41.523552 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-e21f41df-2ea8-4375-b185-ce5300fd3966 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:41.529894 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e21f41df-2ea8-4375-b185-ce5300fd3966 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:41.530352 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e21f41df-2ea8-4375-b185-ce5300fd3966 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:41.531125 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e21f41df-2ea8-4375-b185-ce5300fd3966 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:41.531564 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e21f41df-2ea8-4375-b185-ce5300fd3966 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:41.559117 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-fe0dd2e7-c9eb-43fc-b87d-ee73b7e9f6a7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:41.567634 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-fe0dd2e7-c9eb-43fc-b87d-ee73b7e9f6a7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:41.569153 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-fe0dd2e7-c9eb-43fc-b87d-ee73b7e9f6a7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:41.570285 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-fe0dd2e7-c9eb-43fc-b87d-ee73b7e9f6a7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084205 May 24 15:41:41.570843 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1290/2571] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:41:41 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:41.659299 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-e21f41df-2ea8-4375-b185-ce5300fd3966 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:41.667740 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-e21f41df-2ea8-4375-b185-ce5300fd3966 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.148730 May 24 15:41:41.668325 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1282/2572] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:41 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:41:41.786978 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-2f0585a6-9499-4749-aeb2-9c6a6998ca1d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:41.787519 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-2f0585a6-9499-4749-aeb2-9c6a6998ca1d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:41.793479 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2f0585a6-9499-4749-aeb2-9c6a6998ca1d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:41.793921 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2f0585a6-9499-4749-aeb2-9c6a6998ca1d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:41.794664 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2f0585a6-9499-4749-aeb2-9c6a6998ca1d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:41.795094 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2f0585a6-9499-4749-aeb2-9c6a6998ca1d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:41.810858 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d0022619-abc5-45ee-b5cb-6dd2ba2aeb3b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:41.811472 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d0022619-abc5-45ee-b5cb-6dd2ba2aeb3b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:41.817434 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d0022619-abc5-45ee-b5cb-6dd2ba2aeb3b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:41.817883 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d0022619-abc5-45ee-b5cb-6dd2ba2aeb3b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:41.818650 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d0022619-abc5-45ee-b5cb-6dd2ba2aeb3b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:41.819090 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d0022619-abc5-45ee-b5cb-6dd2ba2aeb3b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:41.922094 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-2f0585a6-9499-4749-aeb2-9c6a6998ca1d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:41.930004 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-2f0585a6-9499-4749-aeb2-9c6a6998ca1d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.146983 May 24 15:41:41.931159 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1291/2573] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:41 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:41.951153 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-d0022619-abc5-45ee-b5cb-6dd2ba2aeb3b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:41.959071 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d0022619-abc5-45ee-b5cb-6dd2ba2aeb3b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.151994 May 24 15:41:41.959672 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1283/2574] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:41 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:42.588495 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-a9c68be7-cc68-4c8a-a8a1-09181a743c08 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:42.589112 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-a9c68be7-cc68-4c8a-a8a1-09181a743c08 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:42.595620 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a9c68be7-cc68-4c8a-a8a1-09181a743c08 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:42.596074 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a9c68be7-cc68-4c8a-a8a1-09181a743c08 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:42.596866 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a9c68be7-cc68-4c8a-a8a1-09181a743c08 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:42.597303 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a9c68be7-cc68-4c8a-a8a1-09181a743c08 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:42.666063 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-a9c68be7-cc68-4c8a-a8a1-09181a743c08 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:42.674950 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-a9c68be7-cc68-4c8a-a8a1-09181a743c08 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:42.676570 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-a9c68be7-cc68-4c8a-a8a1-09181a743c08 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:42.677995 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-a9c68be7-cc68-4c8a-a8a1-09181a743c08 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.093819 May 24 15:41:42.678593 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1292/2575] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:41:42 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:42.684957 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-245dba77-1cef-42e6-9944-78996440ac1b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:42.685573 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-245dba77-1cef-42e6-9944-78996440ac1b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:42.692072 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-245dba77-1cef-42e6-9944-78996440ac1b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:42.692561 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-245dba77-1cef-42e6-9944-78996440ac1b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:42.693318 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-245dba77-1cef-42e6-9944-78996440ac1b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:42.693751 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-245dba77-1cef-42e6-9944-78996440ac1b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:42.819457 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-245dba77-1cef-42e6-9944-78996440ac1b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:42.827442 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-245dba77-1cef-42e6-9944-78996440ac1b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.146587 May 24 15:41:42.828006 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1284/2576] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:42 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:42.947925 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-4ce85c75-7cf3-4f80-88ee-692ef4729291 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:42.948500 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-4ce85c75-7cf3-4f80-88ee-692ef4729291 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:42.954676 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4ce85c75-7cf3-4f80-88ee-692ef4729291 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:42.955124 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4ce85c75-7cf3-4f80-88ee-692ef4729291 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:42.955880 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4ce85c75-7cf3-4f80-88ee-692ef4729291 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:42.956333 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4ce85c75-7cf3-4f80-88ee-692ef4729291 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:42.975121 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-2ccf06b0-7c43-4942-a04a-e67c73224126 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:42.975731 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-2ccf06b0-7c43-4942-a04a-e67c73224126 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:42.981723 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2ccf06b0-7c43-4942-a04a-e67c73224126 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:42.982168 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2ccf06b0-7c43-4942-a04a-e67c73224126 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:42.982930 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2ccf06b0-7c43-4942-a04a-e67c73224126 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:42.983363 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2ccf06b0-7c43-4942-a04a-e67c73224126 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:43.084063 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-4ce85c75-7cf3-4f80-88ee-692ef4729291 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:43.092776 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-4ce85c75-7cf3-4f80-88ee-692ef4729291 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.149291 May 24 15:41:43.093340 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1293/2577] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:42 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:43.115906 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-2ccf06b0-7c43-4942-a04a-e67c73224126 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:43.124076 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-2ccf06b0-7c43-4942-a04a-e67c73224126 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.152754 May 24 15:41:43.124683 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1285/2578] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:42 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:41:43.695694 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d3575ab9-d474-477f-a7d6-a4f88f5635dc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:43.696952 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d3575ab9-d474-477f-a7d6-a4f88f5635dc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:43.703967 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d3575ab9-d474-477f-a7d6-a4f88f5635dc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:43.704427 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d3575ab9-d474-477f-a7d6-a4f88f5635dc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:43.706095 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d3575ab9-d474-477f-a7d6-a4f88f5635dc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:43.706536 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d3575ab9-d474-477f-a7d6-a4f88f5635dc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:43.766231 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-d3575ab9-d474-477f-a7d6-a4f88f5635dc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:43.774481 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-d3575ab9-d474-477f-a7d6-a4f88f5635dc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:43.775961 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-d3575ab9-d474-477f-a7d6-a4f88f5635dc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:43.777197 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d3575ab9-d474-477f-a7d6-a4f88f5635dc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.085657 May 24 15:41:43.777751 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1294/2579] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:41:43 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:43.844145 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-ea51ab82-4cb0-4971-b8fc-c05a03c22912 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:43.844788 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-ea51ab82-4cb0-4971-b8fc-c05a03c22912 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:43.851396 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ea51ab82-4cb0-4971-b8fc-c05a03c22912 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:43.851841 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ea51ab82-4cb0-4971-b8fc-c05a03c22912 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:43.853121 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ea51ab82-4cb0-4971-b8fc-c05a03c22912 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:43.853548 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ea51ab82-4cb0-4971-b8fc-c05a03c22912 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:43.988359 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-ea51ab82-4cb0-4971-b8fc-c05a03c22912 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:43.997268 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-ea51ab82-4cb0-4971-b8fc-c05a03c22912 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.156949 May 24 15:41:43.997843 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1286/2580] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:43 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:44.110062 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-577582d8-0343-4fc8-a9a7-76703d587537 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:44.110666 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-577582d8-0343-4fc8-a9a7-76703d587537 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:44.116836 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-577582d8-0343-4fc8-a9a7-76703d587537 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:44.117272 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-577582d8-0343-4fc8-a9a7-76703d587537 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:44.118014 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-577582d8-0343-4fc8-a9a7-76703d587537 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:44.118438 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-577582d8-0343-4fc8-a9a7-76703d587537 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:44.140609 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-1abb6514-7e94-48f5-84a9-66978413cbb4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:44.141211 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-1abb6514-7e94-48f5-84a9-66978413cbb4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:44.147150 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1abb6514-7e94-48f5-84a9-66978413cbb4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:44.147589 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1abb6514-7e94-48f5-84a9-66978413cbb4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:44.148363 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1abb6514-7e94-48f5-84a9-66978413cbb4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:44.148792 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1abb6514-7e94-48f5-84a9-66978413cbb4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:44.250517 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-577582d8-0343-4fc8-a9a7-76703d587537 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:44.253987 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:41:44.259614 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-577582d8-0343-4fc8-a9a7-76703d587537 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.153530 May 24 15:41:44.272761 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1295/2581] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:44 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:44.279410 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-1abb6514-7e94-48f5-84a9-66978413cbb4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:44.283109 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:41:44.289175 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-1abb6514-7e94-48f5-84a9-66978413cbb4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.152003 May 24 15:41:44.290892 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1287/2582] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:44 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:41:44.794856 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c357d354-bb3a-4c16-9d64-1deb82dcb8cc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:44.795718 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-c357d354-bb3a-4c16-9d64-1deb82dcb8cc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:44.802283 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c357d354-bb3a-4c16-9d64-1deb82dcb8cc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:44.802726 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c357d354-bb3a-4c16-9d64-1deb82dcb8cc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:44.803466 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c357d354-bb3a-4c16-9d64-1deb82dcb8cc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:44.803891 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c357d354-bb3a-4c16-9d64-1deb82dcb8cc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:44.863925 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-c357d354-bb3a-4c16-9d64-1deb82dcb8cc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:44.872387 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-c357d354-bb3a-4c16-9d64-1deb82dcb8cc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:44.873874 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-c357d354-bb3a-4c16-9d64-1deb82dcb8cc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:44.874992 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-c357d354-bb3a-4c16-9d64-1deb82dcb8cc tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084726 May 24 15:41:44.875537 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1296/2583] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:41:44 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:45.014155 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-6c0ca1f9-9893-47b2-ae9a-7066469e5e8c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:45.014772 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-6c0ca1f9-9893-47b2-ae9a-7066469e5e8c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:45.021303 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6c0ca1f9-9893-47b2-ae9a-7066469e5e8c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:45.021758 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6c0ca1f9-9893-47b2-ae9a-7066469e5e8c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:45.022520 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6c0ca1f9-9893-47b2-ae9a-7066469e5e8c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:45.022961 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6c0ca1f9-9893-47b2-ae9a-7066469e5e8c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:45.152494 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-6c0ca1f9-9893-47b2-ae9a-7066469e5e8c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:45.160593 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-6c0ca1f9-9893-47b2-ae9a-7066469e5e8c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.150434 May 24 15:41:45.161175 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1288/2584] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:45 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:45.280724 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-13fc7b66-df35-40c8-8f89-39e90a98bd49 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:45.281326 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-13fc7b66-df35-40c8-8f89-39e90a98bd49 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:45.287360 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-13fc7b66-df35-40c8-8f89-39e90a98bd49 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:45.287796 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-13fc7b66-df35-40c8-8f89-39e90a98bd49 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:45.288569 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-13fc7b66-df35-40c8-8f89-39e90a98bd49 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:45.288998 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-13fc7b66-df35-40c8-8f89-39e90a98bd49 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:45.310950 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-52f673f3-3a03-4e9c-b950-39a9a97e304a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:45.311568 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-52f673f3-3a03-4e9c-b950-39a9a97e304a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:45.318249 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-52f673f3-3a03-4e9c-b950-39a9a97e304a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:45.318689 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-52f673f3-3a03-4e9c-b950-39a9a97e304a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:45.319470 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-52f673f3-3a03-4e9c-b950-39a9a97e304a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:45.319910 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-52f673f3-3a03-4e9c-b950-39a9a97e304a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:45.427088 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-13fc7b66-df35-40c8-8f89-39e90a98bd49 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:45.435146 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-13fc7b66-df35-40c8-8f89-39e90a98bd49 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.158143 May 24 15:41:45.436019 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1297/2585] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:45 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:45.457777 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-52f673f3-3a03-4e9c-b950-39a9a97e304a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:45.466363 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-52f673f3-3a03-4e9c-b950-39a9a97e304a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.159365 May 24 15:41:45.466933 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1289/2586] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:45 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:41:45.892660 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-3f75f6fd-b924-40dc-97fb-fcb79672d465 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:45.893289 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-3f75f6fd-b924-40dc-97fb-fcb79672d465 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:45.899665 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3f75f6fd-b924-40dc-97fb-fcb79672d465 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:45.900108 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3f75f6fd-b924-40dc-97fb-fcb79672d465 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:45.900878 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3f75f6fd-b924-40dc-97fb-fcb79672d465 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:45.901302 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3f75f6fd-b924-40dc-97fb-fcb79672d465 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:45.964605 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-3f75f6fd-b924-40dc-97fb-fcb79672d465 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:45.972973 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-3f75f6fd-b924-40dc-97fb-fcb79672d465 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:45.974456 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-3f75f6fd-b924-40dc-97fb-fcb79672d465 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:45.975577 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-3f75f6fd-b924-40dc-97fb-fcb79672d465 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.086812 May 24 15:41:45.976133 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1298/2587] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:41:45 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:46.178492 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f9a2a6b9-149f-4d3b-b864-38fe16dc7810 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:46.179076 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f9a2a6b9-149f-4d3b-b864-38fe16dc7810 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:46.186219 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f9a2a6b9-149f-4d3b-b864-38fe16dc7810 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:46.186666 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f9a2a6b9-149f-4d3b-b864-38fe16dc7810 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:46.187426 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f9a2a6b9-149f-4d3b-b864-38fe16dc7810 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:46.187864 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f9a2a6b9-149f-4d3b-b864-38fe16dc7810 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:46.314285 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-f9a2a6b9-149f-4d3b-b864-38fe16dc7810 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:46.322599 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f9a2a6b9-149f-4d3b-b864-38fe16dc7810 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.148142 May 24 15:41:46.323167 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1290/2588] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:46 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:46.450885 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-376708fc-b9a1-4bd1-9a88-6e4f84a5cc76 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:46.451425 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-376708fc-b9a1-4bd1-9a88-6e4f84a5cc76 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:46.457391 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-376708fc-b9a1-4bd1-9a88-6e4f84a5cc76 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:46.457836 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-376708fc-b9a1-4bd1-9a88-6e4f84a5cc76 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:46.458592 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-376708fc-b9a1-4bd1-9a88-6e4f84a5cc76 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:46.459023 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-376708fc-b9a1-4bd1-9a88-6e4f84a5cc76 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:46.483319 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-c115c14c-8c77-4ac2-82cf-d59ef52625fd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:46.484015 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-c115c14c-8c77-4ac2-82cf-d59ef52625fd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:46.489947 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c115c14c-8c77-4ac2-82cf-d59ef52625fd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:46.490386 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c115c14c-8c77-4ac2-82cf-d59ef52625fd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:46.491394 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c115c14c-8c77-4ac2-82cf-d59ef52625fd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:46.491822 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c115c14c-8c77-4ac2-82cf-d59ef52625fd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:46.584837 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-376708fc-b9a1-4bd1-9a88-6e4f84a5cc76 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:46.593152 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-376708fc-b9a1-4bd1-9a88-6e4f84a5cc76 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.146204 May 24 15:41:46.593718 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1299/2589] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:46 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:46.621913 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-c115c14c-8c77-4ac2-82cf-d59ef52625fd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:46.629719 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-c115c14c-8c77-4ac2-82cf-d59ef52625fd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.150079 May 24 15:41:46.630271 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1291/2590] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:46 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:41:46.994606 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-3a470d28-a335-4c1b-ba6f-0d32df56d49b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:46.995231 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-3a470d28-a335-4c1b-ba6f-0d32df56d49b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:47.001728 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3a470d28-a335-4c1b-ba6f-0d32df56d49b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:47.002176 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3a470d28-a335-4c1b-ba6f-0d32df56d49b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:47.002958 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3a470d28-a335-4c1b-ba6f-0d32df56d49b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:47.003392 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3a470d28-a335-4c1b-ba6f-0d32df56d49b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:47.063406 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-3a470d28-a335-4c1b-ba6f-0d32df56d49b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:47.071944 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-3a470d28-a335-4c1b-ba6f-0d32df56d49b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:47.073464 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-3a470d28-a335-4c1b-ba6f-0d32df56d49b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:47.074599 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-3a470d28-a335-4c1b-ba6f-0d32df56d49b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084771 May 24 15:41:47.075160 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1300/2591] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:41:46 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:47.339542 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d3fab072-022c-42ec-aacc-c825432572e2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:47.340069 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d3fab072-022c-42ec-aacc-c825432572e2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:47.347026 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d3fab072-022c-42ec-aacc-c825432572e2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:47.347472 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d3fab072-022c-42ec-aacc-c825432572e2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:47.348233 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d3fab072-022c-42ec-aacc-c825432572e2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:47.348688 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d3fab072-022c-42ec-aacc-c825432572e2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:47.479135 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-d3fab072-022c-42ec-aacc-c825432572e2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:47.487057 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d3fab072-022c-42ec-aacc-c825432572e2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.152014 May 24 15:41:47.487625 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1292/2592] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:47 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:47.609795 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-23a34a52-58a2-4d14-9d82-a5b1ea675341 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:47.610366 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-23a34a52-58a2-4d14-9d82-a5b1ea675341 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:47.616595 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-23a34a52-58a2-4d14-9d82-a5b1ea675341 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:47.617045 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-23a34a52-58a2-4d14-9d82-a5b1ea675341 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:47.617801 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-23a34a52-58a2-4d14-9d82-a5b1ea675341 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:47.618244 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-23a34a52-58a2-4d14-9d82-a5b1ea675341 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:47.646511 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-b2bcb716-f51d-4d2f-8165-b95d6f6b6fc0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:47.647182 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-b2bcb716-f51d-4d2f-8165-b95d6f6b6fc0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:47.653946 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b2bcb716-f51d-4d2f-8165-b95d6f6b6fc0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:47.654389 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b2bcb716-f51d-4d2f-8165-b95d6f6b6fc0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:47.655148 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b2bcb716-f51d-4d2f-8165-b95d6f6b6fc0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:47.655585 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b2bcb716-f51d-4d2f-8165-b95d6f6b6fc0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:47.748032 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-23a34a52-58a2-4d14-9d82-a5b1ea675341 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:47.756018 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-23a34a52-58a2-4d14-9d82-a5b1ea675341 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.150119 May 24 15:41:47.756801 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1301/2593] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:47 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:47.786793 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-b2bcb716-f51d-4d2f-8165-b95d6f6b6fc0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:47.794714 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-b2bcb716-f51d-4d2f-8165-b95d6f6b6fc0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.152048 May 24 15:41:47.795275 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1293/2594] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:47 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:41:48.092366 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-fcb7bc89-4c79-4578-9fe2-ccdd17b63877 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:48.092978 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-fcb7bc89-4c79-4578-9fe2-ccdd17b63877 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:48.099493 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fcb7bc89-4c79-4578-9fe2-ccdd17b63877 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:48.099940 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fcb7bc89-4c79-4578-9fe2-ccdd17b63877 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:48.100755 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fcb7bc89-4c79-4578-9fe2-ccdd17b63877 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:48.101190 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fcb7bc89-4c79-4578-9fe2-ccdd17b63877 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:48.161262 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-fcb7bc89-4c79-4578-9fe2-ccdd17b63877 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:48.169621 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-fcb7bc89-4c79-4578-9fe2-ccdd17b63877 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:48.171118 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-fcb7bc89-4c79-4578-9fe2-ccdd17b63877 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:48.172247 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-fcb7bc89-4c79-4578-9fe2-ccdd17b63877 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.083853 May 24 15:41:48.172827 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1302/2595] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:41:48 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:48.504244 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-8128e986-12f9-49e8-9e3f-27b208edfd4e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:48.504872 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-8128e986-12f9-49e8-9e3f-27b208edfd4e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:48.511776 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8128e986-12f9-49e8-9e3f-27b208edfd4e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:48.512212 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8128e986-12f9-49e8-9e3f-27b208edfd4e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:48.512982 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8128e986-12f9-49e8-9e3f-27b208edfd4e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:48.513412 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8128e986-12f9-49e8-9e3f-27b208edfd4e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:48.638509 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-8128e986-12f9-49e8-9e3f-27b208edfd4e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:48.646352 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-8128e986-12f9-49e8-9e3f-27b208edfd4e tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.145980 May 24 15:41:48.646919 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1294/2596] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:48 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:41:48.773162 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-13122d9a-ad46-4f6e-a60e-79512b8d4198 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:48.773785 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-13122d9a-ad46-4f6e-a60e-79512b8d4198 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:48.779803 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-13122d9a-ad46-4f6e-a60e-79512b8d4198 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:48.780253 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-13122d9a-ad46-4f6e-a60e-79512b8d4198 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:48.781039 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-13122d9a-ad46-4f6e-a60e-79512b8d4198 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:48.781475 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-13122d9a-ad46-4f6e-a60e-79512b8d4198 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:48.811213 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-cc005eea-458b-4756-89c7-3d8a84c79f25 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:48.811820 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-cc005eea-458b-4756-89c7-3d8a84c79f25 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:48.817853 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cc005eea-458b-4756-89c7-3d8a84c79f25 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:48.818295 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cc005eea-458b-4756-89c7-3d8a84c79f25 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:48.819054 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cc005eea-458b-4756-89c7-3d8a84c79f25 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:48.819482 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cc005eea-458b-4756-89c7-3d8a84c79f25 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:48.909319 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-13122d9a-ad46-4f6e-a60e-79512b8d4198 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:48.917172 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-13122d9a-ad46-4f6e-a60e-79512b8d4198 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.147810 May 24 15:41:48.917979 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1303/2597] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:48 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:48.956163 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-cc005eea-458b-4756-89c7-3d8a84c79f25 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:48.964082 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-cc005eea-458b-4756-89c7-3d8a84c79f25 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.156649 May 24 15:41:48.964781 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1295/2598] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:48 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:49.190672 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-4a3188a0-521e-48bb-be86-96401cf175f9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:49.191323 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-4a3188a0-521e-48bb-be86-96401cf175f9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:49.197822 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4a3188a0-521e-48bb-be86-96401cf175f9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:49.198263 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4a3188a0-521e-48bb-be86-96401cf175f9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:49.199012 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4a3188a0-521e-48bb-be86-96401cf175f9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:49.199440 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4a3188a0-521e-48bb-be86-96401cf175f9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:49.263151 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-4a3188a0-521e-48bb-be86-96401cf175f9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:49.271417 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-4a3188a0-521e-48bb-be86-96401cf175f9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:49.272939 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-4a3188a0-521e-48bb-be86-96401cf175f9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:49.274063 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-4a3188a0-521e-48bb-be86-96401cf175f9 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.087405 May 24 15:41:49.274645 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1304/2599] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:41:49 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:49.663277 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-eb94b0b7-f8d2-44af-930f-abf862f21ea1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:49.663888 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-eb94b0b7-f8d2-44af-930f-abf862f21ea1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:49.671160 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-eb94b0b7-f8d2-44af-930f-abf862f21ea1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:49.671607 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-eb94b0b7-f8d2-44af-930f-abf862f21ea1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:49.672393 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-eb94b0b7-f8d2-44af-930f-abf862f21ea1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:49.672829 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-eb94b0b7-f8d2-44af-930f-abf862f21ea1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:49.796789 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-eb94b0b7-f8d2-44af-930f-abf862f21ea1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:49.804609 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-eb94b0b7-f8d2-44af-930f-abf862f21ea1 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.145217 May 24 15:41:49.805177 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1296/2600] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:49 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:49.933828 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-b7f46f14-3293-4d68-925f-d2752133f044 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:49.934380 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-b7f46f14-3293-4d68-925f-d2752133f044 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:49.940451 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b7f46f14-3293-4d68-925f-d2752133f044 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:49.940903 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b7f46f14-3293-4d68-925f-d2752133f044 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:49.941668 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b7f46f14-3293-4d68-925f-d2752133f044 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:49.942107 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b7f46f14-3293-4d68-925f-d2752133f044 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:49.980683 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-fc8bae74-2280-4451-ac34-e304a293f79f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:49.981412 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-fc8bae74-2280-4451-ac34-e304a293f79f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:49.987690 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fc8bae74-2280-4451-ac34-e304a293f79f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:49.988219 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fc8bae74-2280-4451-ac34-e304a293f79f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:49.989073 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fc8bae74-2280-4451-ac34-e304a293f79f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:49.989575 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fc8bae74-2280-4451-ac34-e304a293f79f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:50.069609 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-b7f46f14-3293-4d68-925f-d2752133f044 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:50.078277 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-b7f46f14-3293-4d68-925f-d2752133f044 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.148226 May 24 15:41:50.079260 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1305/2601] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:49 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:50.116493 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-fc8bae74-2280-4451-ac34-e304a293f79f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:50.124913 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-fc8bae74-2280-4451-ac34-e304a293f79f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.148005 May 24 15:41:50.125480 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1297/2602] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:49 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:41:50.291540 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-9f156e82-2995-45d2-ae27-0e176c2d882d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:50.292151 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-9f156e82-2995-45d2-ae27-0e176c2d882d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:50.298634 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9f156e82-2995-45d2-ae27-0e176c2d882d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:50.299081 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9f156e82-2995-45d2-ae27-0e176c2d882d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:50.299833 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9f156e82-2995-45d2-ae27-0e176c2d882d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:50.300268 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9f156e82-2995-45d2-ae27-0e176c2d882d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:50.363084 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-9f156e82-2995-45d2-ae27-0e176c2d882d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:50.372111 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-9f156e82-2995-45d2-ae27-0e176c2d882d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:50.373628 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-9f156e82-2995-45d2-ae27-0e176c2d882d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:50.374754 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-9f156e82-2995-45d2-ae27-0e176c2d882d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.087092 May 24 15:41:50.375314 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1306/2603] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:41:50 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:41:50.821553 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-37cf5ada-8662-48b6-b972-7571ab63a322 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:50.822175 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-37cf5ada-8662-48b6-b972-7571ab63a322 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:50.828880 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-37cf5ada-8662-48b6-b972-7571ab63a322 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:50.829333 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-37cf5ada-8662-48b6-b972-7571ab63a322 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:50.830096 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-37cf5ada-8662-48b6-b972-7571ab63a322 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:50.830543 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-37cf5ada-8662-48b6-b972-7571ab63a322 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:50.957397 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-37cf5ada-8662-48b6-b972-7571ab63a322 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:50.965878 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-37cf5ada-8662-48b6-b972-7571ab63a322 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.148211 May 24 15:41:50.966451 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1298/2604] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:50 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:51.094987 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-93430f8c-46cc-4c1d-8eda-ee2e54d7d1ec tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:51.095541 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-93430f8c-46cc-4c1d-8eda-ee2e54d7d1ec tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:51.101676 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-93430f8c-46cc-4c1d-8eda-ee2e54d7d1ec tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:51.102126 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-93430f8c-46cc-4c1d-8eda-ee2e54d7d1ec tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:51.103501 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-93430f8c-46cc-4c1d-8eda-ee2e54d7d1ec tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:51.103934 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-93430f8c-46cc-4c1d-8eda-ee2e54d7d1ec tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:51.142844 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-0b56aa43-b033-4a59-9a36-f483268a3fba tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:51.143605 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-0b56aa43-b033-4a59-9a36-f483268a3fba tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:51.150651 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0b56aa43-b033-4a59-9a36-f483268a3fba tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:51.151102 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0b56aa43-b033-4a59-9a36-f483268a3fba tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:51.151873 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0b56aa43-b033-4a59-9a36-f483268a3fba tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:51.152329 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0b56aa43-b033-4a59-9a36-f483268a3fba tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:51.237398 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-93430f8c-46cc-4c1d-8eda-ee2e54d7d1ec tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:51.245752 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-93430f8c-46cc-4c1d-8eda-ee2e54d7d1ec tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.154664 May 24 15:41:51.246331 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1307/2605] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:51 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:51.281871 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-0b56aa43-b033-4a59-9a36-f483268a3fba tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:51.289775 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-0b56aa43-b033-4a59-9a36-f483268a3fba tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.151203 May 24 15:41:51.290339 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1299/2606] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:51 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:41:51.392565 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-5d54687b-4d75-437d-a9df-1ce3b1fc72b2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:51.393105 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-5d54687b-4d75-437d-a9df-1ce3b1fc72b2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:51.400025 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5d54687b-4d75-437d-a9df-1ce3b1fc72b2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:51.400514 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5d54687b-4d75-437d-a9df-1ce3b1fc72b2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:51.401265 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5d54687b-4d75-437d-a9df-1ce3b1fc72b2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:51.401691 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5d54687b-4d75-437d-a9df-1ce3b1fc72b2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:51.460838 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-5d54687b-4d75-437d-a9df-1ce3b1fc72b2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:51.469796 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-5d54687b-4d75-437d-a9df-1ce3b1fc72b2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:51.471279 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-5d54687b-4d75-437d-a9df-1ce3b1fc72b2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:51.472430 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-5d54687b-4d75-437d-a9df-1ce3b1fc72b2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.083817 May 24 15:41:51.472970 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1308/2607] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:41:51 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:51.983236 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-1ef7a984-cf2a-4f31-9adc-7d54614da063 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:51.983849 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-1ef7a984-cf2a-4f31-9adc-7d54614da063 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:51.990435 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1ef7a984-cf2a-4f31-9adc-7d54614da063 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:51.990883 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1ef7a984-cf2a-4f31-9adc-7d54614da063 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:51.991906 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1ef7a984-cf2a-4f31-9adc-7d54614da063 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:51.992369 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1ef7a984-cf2a-4f31-9adc-7d54614da063 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:52.124776 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-1ef7a984-cf2a-4f31-9adc-7d54614da063 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:52.132790 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-1ef7a984-cf2a-4f31-9adc-7d54614da063 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.153408 May 24 15:41:52.133360 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1300/2608] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:51 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:52.262415 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-22a7e653-4519-403a-af90-f12dc25563d9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:52.262950 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-22a7e653-4519-403a-af90-f12dc25563d9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:52.268983 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-22a7e653-4519-403a-af90-f12dc25563d9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:52.269423 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-22a7e653-4519-403a-af90-f12dc25563d9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:52.270166 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-22a7e653-4519-403a-af90-f12dc25563d9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:52.270591 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-22a7e653-4519-403a-af90-f12dc25563d9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:52.307091 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-67bea1bd-ff94-4e3c-800b-7f72ff54cad9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:52.307871 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-67bea1bd-ff94-4e3c-800b-7f72ff54cad9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:52.314127 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-67bea1bd-ff94-4e3c-800b-7f72ff54cad9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:52.314583 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-67bea1bd-ff94-4e3c-800b-7f72ff54cad9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:52.315357 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-67bea1bd-ff94-4e3c-800b-7f72ff54cad9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:52.315793 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-67bea1bd-ff94-4e3c-800b-7f72ff54cad9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:52.405567 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-22a7e653-4519-403a-af90-f12dc25563d9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:52.413715 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-22a7e653-4519-403a-af90-f12dc25563d9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.155156 May 24 15:41:52.414421 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1309/2609] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:52 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:52.447780 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-67bea1bd-ff94-4e3c-800b-7f72ff54cad9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:52.455715 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-67bea1bd-ff94-4e3c-800b-7f72ff54cad9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.153285 May 24 15:41:52.456280 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1301/2610] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:52 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:41:52.489792 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-626babac-7039-410b-bd09-2b975b450c3d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:52.490388 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-626babac-7039-410b-bd09-2b975b450c3d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:52.496557 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-626babac-7039-410b-bd09-2b975b450c3d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:52.496999 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-626babac-7039-410b-bd09-2b975b450c3d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:52.497737 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-626babac-7039-410b-bd09-2b975b450c3d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:52.498164 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-626babac-7039-410b-bd09-2b975b450c3d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:52.559899 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-626babac-7039-410b-bd09-2b975b450c3d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:52.568129 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-626babac-7039-410b-bd09-2b975b450c3d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:52.569627 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-626babac-7039-410b-bd09-2b975b450c3d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:52.570743 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-626babac-7039-410b-bd09-2b975b450c3d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084745 May 24 15:41:52.571289 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1310/2611] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:41:52 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:41:53.150422 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-3f227033-c3ea-4919-9310-9ac5c062a298 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:53.151039 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-3f227033-c3ea-4919-9310-9ac5c062a298 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:53.157635 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3f227033-c3ea-4919-9310-9ac5c062a298 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:53.158086 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3f227033-c3ea-4919-9310-9ac5c062a298 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:53.158843 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3f227033-c3ea-4919-9310-9ac5c062a298 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:53.159277 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3f227033-c3ea-4919-9310-9ac5c062a298 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:53.285550 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-3f227033-c3ea-4919-9310-9ac5c062a298 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:53.293410 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-3f227033-c3ea-4919-9310-9ac5c062a298 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.147347 May 24 15:41:53.293974 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1302/2612] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:53 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:53.432013 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-3087f27a-e3d0-441c-8c77-63e6869ebd75 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:53.432647 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-3087f27a-e3d0-441c-8c77-63e6869ebd75 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:53.439179 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3087f27a-e3d0-441c-8c77-63e6869ebd75 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:53.439623 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3087f27a-e3d0-441c-8c77-63e6869ebd75 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:53.440412 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3087f27a-e3d0-441c-8c77-63e6869ebd75 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:53.440846 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3087f27a-e3d0-441c-8c77-63e6869ebd75 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:53.473028 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-54742972-e394-4bcd-a5f8-f039d8e6d83c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:53.473636 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-54742972-e394-4bcd-a5f8-f039d8e6d83c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:53.480233 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-54742972-e394-4bcd-a5f8-f039d8e6d83c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:53.480709 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-54742972-e394-4bcd-a5f8-f039d8e6d83c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:53.481485 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-54742972-e394-4bcd-a5f8-f039d8e6d83c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:53.481911 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-54742972-e394-4bcd-a5f8-f039d8e6d83c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:53.567449 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-3087f27a-e3d0-441c-8c77-63e6869ebd75 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:53.575484 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-3087f27a-e3d0-441c-8c77-63e6869ebd75 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.147820 May 24 15:41:53.576150 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1311/2613] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:53 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:53.588222 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-b92eb4cf-19e5-47e0-88a5-e041cf55cdb5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:53.588969 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-b92eb4cf-19e5-47e0-88a5-e041cf55cdb5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:53.594930 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b92eb4cf-19e5-47e0-88a5-e041cf55cdb5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:53.595380 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b92eb4cf-19e5-47e0-88a5-e041cf55cdb5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:53.596139 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b92eb4cf-19e5-47e0-88a5-e041cf55cdb5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:53.596607 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b92eb4cf-19e5-47e0-88a5-e041cf55cdb5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:53.613881 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-54742972-e394-4bcd-a5f8-f039d8e6d83c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:53.614739 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:41:53.622592 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-54742972-e394-4bcd-a5f8-f039d8e6d83c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.153361 May 24 15:41:53.623158 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1303/2614] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:53 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:41:53.657647 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-b92eb4cf-19e5-47e0-88a5-e041cf55cdb5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:53.666521 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-b92eb4cf-19e5-47e0-88a5-e041cf55cdb5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:53.668012 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-b92eb4cf-19e5-47e0-88a5-e041cf55cdb5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:53.669170 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-b92eb4cf-19e5-47e0-88a5-e041cf55cdb5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084739 May 24 15:41:53.669730 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1312/2615] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:41:53 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:54.310418 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-7ff96fbd-5867-4218-80c8-2971e2d94bca tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:54.311057 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-7ff96fbd-5867-4218-80c8-2971e2d94bca tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:54.317588 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7ff96fbd-5867-4218-80c8-2971e2d94bca tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:54.318022 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7ff96fbd-5867-4218-80c8-2971e2d94bca tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:54.318767 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7ff96fbd-5867-4218-80c8-2971e2d94bca tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:54.319193 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7ff96fbd-5867-4218-80c8-2971e2d94bca tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:54.337924 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:41:54.447600 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-7ff96fbd-5867-4218-80c8-2971e2d94bca tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:54.455433 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-7ff96fbd-5867-4218-80c8-2971e2d94bca tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.148912 May 24 15:41:54.455993 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1304/2616] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:54 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:54.592444 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-146bae97-132d-4e01-a2ec-25f61a9b2c9b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:54.592990 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-146bae97-132d-4e01-a2ec-25f61a9b2c9b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:54.599818 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-146bae97-132d-4e01-a2ec-25f61a9b2c9b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:54.600274 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-146bae97-132d-4e01-a2ec-25f61a9b2c9b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:54.601061 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-146bae97-132d-4e01-a2ec-25f61a9b2c9b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:54.601498 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-146bae97-132d-4e01-a2ec-25f61a9b2c9b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:54.640322 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-cc38d6b1-5b0b-47f7-9ea9-1c8847bd32bc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:54.640972 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-cc38d6b1-5b0b-47f7-9ea9-1c8847bd32bc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:54.647005 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cc38d6b1-5b0b-47f7-9ea9-1c8847bd32bc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:54.647451 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cc38d6b1-5b0b-47f7-9ea9-1c8847bd32bc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:54.648217 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cc38d6b1-5b0b-47f7-9ea9-1c8847bd32bc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:54.648685 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cc38d6b1-5b0b-47f7-9ea9-1c8847bd32bc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:54.731639 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-146bae97-132d-4e01-a2ec-25f61a9b2c9b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:54.739799 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-146bae97-132d-4e01-a2ec-25f61a9b2c9b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.151288 May 24 15:41:54.740500 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1313/2617] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:54 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:54.745701 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-1cace259-1895-422e-82a1-91ef55d26349 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:54.746297 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-1cace259-1895-422e-82a1-91ef55d26349 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:54.752587 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1cace259-1895-422e-82a1-91ef55d26349 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:54.753022 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1cace259-1895-422e-82a1-91ef55d26349 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:54.753801 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1cace259-1895-422e-82a1-91ef55d26349 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:54.754238 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1cace259-1895-422e-82a1-91ef55d26349 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:54.780401 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-cc38d6b1-5b0b-47f7-9ea9-1c8847bd32bc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:54.788461 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-cc38d6b1-5b0b-47f7-9ea9-1c8847bd32bc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.151915 May 24 15:41:54.789042 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1305/2618] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:54 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:41:54.814349 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-1cace259-1895-422e-82a1-91ef55d26349 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:54.823385 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-1cace259-1895-422e-82a1-91ef55d26349 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:54.824919 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-1cace259-1895-422e-82a1-91ef55d26349 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:54.826057 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-1cace259-1895-422e-82a1-91ef55d26349 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084773 May 24 15:41:54.826617 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1314/2619] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:41:54 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:55.472675 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-12e1618e-3731-4f09-be8f-e32db7eb46a7 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:55.473289 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-12e1618e-3731-4f09-be8f-e32db7eb46a7 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:55.480619 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-12e1618e-3731-4f09-be8f-e32db7eb46a7 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:55.481071 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-12e1618e-3731-4f09-be8f-e32db7eb46a7 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:55.481827 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-12e1618e-3731-4f09-be8f-e32db7eb46a7 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:55.482263 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-12e1618e-3731-4f09-be8f-e32db7eb46a7 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:55.610855 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-12e1618e-3731-4f09-be8f-e32db7eb46a7 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:55.619073 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-12e1618e-3731-4f09-be8f-e32db7eb46a7 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.150285 May 24 15:41:55.619635 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1306/2620] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:55 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:55.757339 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-7d1a0b3d-4b37-44f8-8f9e-9911808cf930 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:55.757894 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-7d1a0b3d-4b37-44f8-8f9e-9911808cf930 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:55.764893 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7d1a0b3d-4b37-44f8-8f9e-9911808cf930 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:55.765336 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7d1a0b3d-4b37-44f8-8f9e-9911808cf930 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:55.766077 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7d1a0b3d-4b37-44f8-8f9e-9911808cf930 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:55.766500 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7d1a0b3d-4b37-44f8-8f9e-9911808cf930 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:55.805273 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-4925304f-038d-4cb8-956d-fa89e6cc3b19 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:55.805886 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-4925304f-038d-4cb8-956d-fa89e6cc3b19 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:55.807793 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_api:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:41:55.813314 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4925304f-038d-4cb8-956d-fa89e6cc3b19 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:55.813765 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4925304f-038d-4cb8-956d-fa89e6cc3b19 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:55.814530 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4925304f-038d-4cb8-956d-fa89e6cc3b19 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:55.814966 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4925304f-038d-4cb8-956d-fa89e6cc3b19 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:55.894468 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-7d1a0b3d-4b37-44f8-8f9e-9911808cf930 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:55.903195 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-7d1a0b3d-4b37-44f8-8f9e-9911808cf930 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.149703 May 24 15:41:55.903767 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1315/2621] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:55 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:55.908183 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-0f7333bd-19f0-4bbf-85c5-96bbcc43e208 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:55.908811 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-0f7333bd-19f0-4bbf-85c5-96bbcc43e208 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:55.914651 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0f7333bd-19f0-4bbf-85c5-96bbcc43e208 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:55.915098 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0f7333bd-19f0-4bbf-85c5-96bbcc43e208 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:55.915856 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0f7333bd-19f0-4bbf-85c5-96bbcc43e208 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:55.916290 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0f7333bd-19f0-4bbf-85c5-96bbcc43e208 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:55.946517 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-4925304f-038d-4cb8-956d-fa89e6cc3b19 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:55.954595 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-4925304f-038d-4cb8-956d-fa89e6cc3b19 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.153306 May 24 15:41:55.955161 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1307/2622] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:55 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:41:55.980057 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-0f7333bd-19f0-4bbf-85c5-96bbcc43e208 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:55.988584 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-0f7333bd-19f0-4bbf-85c5-96bbcc43e208 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:55.990118 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-0f7333bd-19f0-4bbf-85c5-96bbcc43e208 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:55.991534 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-0f7333bd-19f0-4bbf-85c5-96bbcc43e208 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.086597 May 24 15:41:55.992102 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1316/2623] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:41:55 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:56.636750 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-0683e95c-dda2-428e-8191-327b073ac1d2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:56.637357 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-0683e95c-dda2-428e-8191-327b073ac1d2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:56.643962 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0683e95c-dda2-428e-8191-327b073ac1d2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:56.644442 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0683e95c-dda2-428e-8191-327b073ac1d2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:56.645191 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0683e95c-dda2-428e-8191-327b073ac1d2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:56.645625 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0683e95c-dda2-428e-8191-327b073ac1d2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:56.771953 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-0683e95c-dda2-428e-8191-327b073ac1d2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:56.779800 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-0683e95c-dda2-428e-8191-327b073ac1d2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.147828 May 24 15:41:56.780388 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1308/2624] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:56 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:56.920377 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-29f338cd-b831-4137-8ec6-bb10a416427c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:56.920926 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-29f338cd-b831-4137-8ec6-bb10a416427c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:56.927357 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-29f338cd-b831-4137-8ec6-bb10a416427c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:56.927806 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-29f338cd-b831-4137-8ec6-bb10a416427c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:56.928602 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-29f338cd-b831-4137-8ec6-bb10a416427c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:56.929040 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-29f338cd-b831-4137-8ec6-bb10a416427c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:56.972025 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d1a8d1a0-78af-4254-8fb5-7b26e5d8c392 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:56.972731 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d1a8d1a0-78af-4254-8fb5-7b26e5d8c392 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:56.979452 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d1a8d1a0-78af-4254-8fb5-7b26e5d8c392 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:56.979901 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d1a8d1a0-78af-4254-8fb5-7b26e5d8c392 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:56.980690 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d1a8d1a0-78af-4254-8fb5-7b26e5d8c392 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:56.981123 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d1a8d1a0-78af-4254-8fb5-7b26e5d8c392 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:57.057440 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-29f338cd-b831-4137-8ec6-bb10a416427c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:57.065448 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-29f338cd-b831-4137-8ec6-bb10a416427c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.148958 May 24 15:41:57.066395 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1317/2625] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:56 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:57.071398 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-7546195a-c149-412f-beaf-05b95e5e76ec tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:57.071950 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-7546195a-c149-412f-beaf-05b95e5e76ec tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:57.077830 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7546195a-c149-412f-beaf-05b95e5e76ec tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:57.078277 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7546195a-c149-412f-beaf-05b95e5e76ec tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:57.079039 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7546195a-c149-412f-beaf-05b95e5e76ec tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:57.079463 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7546195a-c149-412f-beaf-05b95e5e76ec tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:57.111737 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-d1a8d1a0-78af-4254-8fb5-7b26e5d8c392 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:57.121993 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d1a8d1a0-78af-4254-8fb5-7b26e5d8c392 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.153755 May 24 15:41:57.122570 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1309/2626] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:56 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:41:57.142317 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-7546195a-c149-412f-beaf-05b95e5e76ec tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:57.151300 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-7546195a-c149-412f-beaf-05b95e5e76ec tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:57.152817 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-7546195a-c149-412f-beaf-05b95e5e76ec tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:57.153948 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-7546195a-c149-412f-beaf-05b95e5e76ec tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.086561 May 24 15:41:57.154508 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1318/2627] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:41:57 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:57.796722 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-549a5459-d423-41a4-b59b-af768921a53a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:57.797334 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-549a5459-d423-41a4-b59b-af768921a53a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:57.803897 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-549a5459-d423-41a4-b59b-af768921a53a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:57.804368 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-549a5459-d423-41a4-b59b-af768921a53a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:57.805125 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-549a5459-d423-41a4-b59b-af768921a53a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:57.806082 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-549a5459-d423-41a4-b59b-af768921a53a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:57.934427 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-549a5459-d423-41a4-b59b-af768921a53a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:57.942301 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-549a5459-d423-41a4-b59b-af768921a53a tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.149462 May 24 15:41:57.942926 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1310/2628] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:57 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:58.081414 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-11e7ffa8-cc85-46ee-b29b-da76873b6f4a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:58.082025 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-11e7ffa8-cc85-46ee-b29b-da76873b6f4a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:58.088591 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-11e7ffa8-cc85-46ee-b29b-da76873b6f4a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:58.089036 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-11e7ffa8-cc85-46ee-b29b-da76873b6f4a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:58.089791 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-11e7ffa8-cc85-46ee-b29b-da76873b6f4a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:58.090222 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-11e7ffa8-cc85-46ee-b29b-da76873b6f4a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:58.137711 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-bfc4ee1b-9d97-4b98-ba29-f6e8a70d376c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:58.138322 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-bfc4ee1b-9d97-4b98-ba29-f6e8a70d376c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:58.144557 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bfc4ee1b-9d97-4b98-ba29-f6e8a70d376c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:58.145002 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bfc4ee1b-9d97-4b98-ba29-f6e8a70d376c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:58.145750 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bfc4ee1b-9d97-4b98-ba29-f6e8a70d376c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:58.146184 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bfc4ee1b-9d97-4b98-ba29-f6e8a70d376c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:58.219550 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-11e7ffa8-cc85-46ee-b29b-da76873b6f4a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:58.228240 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-11e7ffa8-cc85-46ee-b29b-da76873b6f4a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.150668 May 24 15:41:58.228827 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1319/2629] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:58 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:58.233339 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-8832090a-7bf4-4caf-bda5-66dae7e428c2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:58.233939 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-8832090a-7bf4-4caf-bda5-66dae7e428c2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:58.235706 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_api:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:41:58.240854 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8832090a-7bf4-4caf-bda5-66dae7e428c2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:58.241557 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8832090a-7bf4-4caf-bda5-66dae7e428c2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:58.242314 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8832090a-7bf4-4caf-bda5-66dae7e428c2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:58.242748 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8832090a-7bf4-4caf-bda5-66dae7e428c2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:58.273350 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-bfc4ee1b-9d97-4b98-ba29-f6e8a70d376c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:58.281410 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-bfc4ee1b-9d97-4b98-ba29-f6e8a70d376c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.147504 May 24 15:41:58.281983 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1311/2630] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:58 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:41:58.303328 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-8832090a-7bf4-4caf-bda5-66dae7e428c2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:58.312238 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-8832090a-7bf4-4caf-bda5-66dae7e428c2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:58.313743 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-8832090a-7bf4-4caf-bda5-66dae7e428c2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:58.314862 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-8832090a-7bf4-4caf-bda5-66dae7e428c2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.085140 May 24 15:41:58.315410 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1320/2631] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:41:58 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:58.959874 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d5177bcf-b89e-49e4-8e6c-797a1d53e5b6 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:58.960506 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d5177bcf-b89e-49e4-8e6c-797a1d53e5b6 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:58.967583 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d5177bcf-b89e-49e4-8e6c-797a1d53e5b6 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:58.968021 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d5177bcf-b89e-49e4-8e6c-797a1d53e5b6 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:58.968796 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d5177bcf-b89e-49e4-8e6c-797a1d53e5b6 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:58.969230 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d5177bcf-b89e-49e4-8e6c-797a1d53e5b6 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:59.099081 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-d5177bcf-b89e-49e4-8e6c-797a1d53e5b6 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:59.106960 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d5177bcf-b89e-49e4-8e6c-797a1d53e5b6 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.150965 May 24 15:41:59.107538 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1312/2632] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:58 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:59.245105 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-4947da4e-6986-425e-b943-003837bc985b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:59.245750 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-4947da4e-6986-425e-b943-003837bc985b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:59.252205 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4947da4e-6986-425e-b943-003837bc985b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:59.252704 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4947da4e-6986-425e-b943-003837bc985b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:59.253451 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4947da4e-6986-425e-b943-003837bc985b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:59.253884 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4947da4e-6986-425e-b943-003837bc985b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:59.298838 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-3e8b58af-d562-479d-a1fc-b844e9bc5101 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:59.299443 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-3e8b58af-d562-479d-a1fc-b844e9bc5101 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:59.305436 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3e8b58af-d562-479d-a1fc-b844e9bc5101 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:59.305876 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3e8b58af-d562-479d-a1fc-b844e9bc5101 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:59.307119 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3e8b58af-d562-479d-a1fc-b844e9bc5101 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:59.307547 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3e8b58af-d562-479d-a1fc-b844e9bc5101 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:59.382150 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-4947da4e-6986-425e-b943-003837bc985b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:59.390745 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-4947da4e-6986-425e-b943-003837bc985b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.150178 May 24 15:41:59.391347 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1321/2633] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:59 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:59.395792 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-144e5275-3b04-4ea1-be70-5841812e70a6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:59.396446 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-144e5275-3b04-4ea1-be70-5841812e70a6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:59.402190 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-144e5275-3b04-4ea1-be70-5841812e70a6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:59.402634 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-144e5275-3b04-4ea1-be70-5841812e70a6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:59.403389 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-144e5275-3b04-4ea1-be70-5841812e70a6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:59.403817 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-144e5275-3b04-4ea1-be70-5841812e70a6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:59.439294 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-3e8b58af-d562-479d-a1fc-b844e9bc5101 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:59.447359 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-3e8b58af-d562-479d-a1fc-b844e9bc5101 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.152339 May 24 15:41:59.447931 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1313/2634] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:41:59 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:41:59.467871 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-144e5275-3b04-4ea1-be70-5841812e70a6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:59.476182 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-144e5275-3b04-4ea1-be70-5841812e70a6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:59.477686 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-144e5275-3b04-4ea1-be70-5841812e70a6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:59.479305 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-144e5275-3b04-4ea1-be70-5841812e70a6 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.086565 May 24 15:41:59.479902 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1322/2635] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:41:59 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:42:00.124778 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-6bb5fb94-252c-4890-93bf-f683f350046d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:00.125413 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-6bb5fb94-252c-4890-93bf-f683f350046d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:00.131942 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6bb5fb94-252c-4890-93bf-f683f350046d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:00.132561 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6bb5fb94-252c-4890-93bf-f683f350046d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:00.133350 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6bb5fb94-252c-4890-93bf-f683f350046d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:00.133777 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6bb5fb94-252c-4890-93bf-f683f350046d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:00.259030 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-6bb5fb94-252c-4890-93bf-f683f350046d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:00.266842 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-6bb5fb94-252c-4890-93bf-f683f350046d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.145957 May 24 15:42:00.267408 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1314/2636] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:00 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:00.407594 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-b63585a7-56e1-4174-844f-6638dd34844d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:00.408208 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-b63585a7-56e1-4174-844f-6638dd34844d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:00.414716 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b63585a7-56e1-4174-844f-6638dd34844d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:00.415167 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b63585a7-56e1-4174-844f-6638dd34844d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:00.415922 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b63585a7-56e1-4174-844f-6638dd34844d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:00.416382 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b63585a7-56e1-4174-844f-6638dd34844d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:00.464024 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-64aa0f14-1371-4f9f-88bb-1ea4f3978055 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:00.464674 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-64aa0f14-1371-4f9f-88bb-1ea4f3978055 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:00.470662 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-64aa0f14-1371-4f9f-88bb-1ea4f3978055 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:00.471108 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-64aa0f14-1371-4f9f-88bb-1ea4f3978055 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:00.471864 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-64aa0f14-1371-4f9f-88bb-1ea4f3978055 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:00.472324 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-64aa0f14-1371-4f9f-88bb-1ea4f3978055 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:00.544393 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-b63585a7-56e1-4174-844f-6638dd34844d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:00.552634 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-b63585a7-56e1-4174-844f-6638dd34844d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.148852 May 24 15:42:00.553208 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1323/2637] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:00 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:00.558408 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-f2ef5c51-144b-443c-a0f5-a9bcf17b8adb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:00.559112 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-f2ef5c51-144b-443c-a0f5-a9bcf17b8adb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:00.565098 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f2ef5c51-144b-443c-a0f5-a9bcf17b8adb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:00.565933 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f2ef5c51-144b-443c-a0f5-a9bcf17b8adb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:00.566694 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f2ef5c51-144b-443c-a0f5-a9bcf17b8adb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:00.567123 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f2ef5c51-144b-443c-a0f5-a9bcf17b8adb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:00.602535 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-64aa0f14-1371-4f9f-88bb-1ea4f3978055 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:00.611424 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-64aa0f14-1371-4f9f-88bb-1ea4f3978055 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.151190 May 24 15:42:00.612261 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1315/2638] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:00 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:42:00.632138 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-f2ef5c51-144b-443c-a0f5-a9bcf17b8adb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:00.640562 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-f2ef5c51-144b-443c-a0f5-a9bcf17b8adb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:00.642049 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-f2ef5c51-144b-443c-a0f5-a9bcf17b8adb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:00.643169 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-f2ef5c51-144b-443c-a0f5-a9bcf17b8adb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.088353 May 24 15:42:00.643721 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1324/2639] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:42:00 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:42:01.284440 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-41a10b5d-9779-4288-92db-110fd12466f8 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:01.285053 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-41a10b5d-9779-4288-92db-110fd12466f8 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:01.291541 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-41a10b5d-9779-4288-92db-110fd12466f8 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:01.291925 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-41a10b5d-9779-4288-92db-110fd12466f8 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:01.292706 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-41a10b5d-9779-4288-92db-110fd12466f8 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:01.293157 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-41a10b5d-9779-4288-92db-110fd12466f8 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:01.418290 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-41a10b5d-9779-4288-92db-110fd12466f8 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:01.426108 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-41a10b5d-9779-4288-92db-110fd12466f8 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.146372 May 24 15:42:01.426671 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1316/2640] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:01 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:01.569297 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-4c4268d9-a4c7-4a09-ae48-bd30ef9af9c8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:01.569833 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-4c4268d9-a4c7-4a09-ae48-bd30ef9af9c8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:01.577466 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4c4268d9-a4c7-4a09-ae48-bd30ef9af9c8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:01.577909 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4c4268d9-a4c7-4a09-ae48-bd30ef9af9c8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:01.578675 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4c4268d9-a4c7-4a09-ae48-bd30ef9af9c8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:01.579085 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4c4268d9-a4c7-4a09-ae48-bd30ef9af9c8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:01.628521 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-aace2eb5-502f-48fd-b37e-de2b1eeb5264 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:01.629133 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-aace2eb5-502f-48fd-b37e-de2b1eeb5264 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:01.635070 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-aace2eb5-502f-48fd-b37e-de2b1eeb5264 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:01.635512 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-aace2eb5-502f-48fd-b37e-de2b1eeb5264 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:01.636949 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-aace2eb5-502f-48fd-b37e-de2b1eeb5264 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:01.637384 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-aace2eb5-502f-48fd-b37e-de2b1eeb5264 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:01.709268 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-4c4268d9-a4c7-4a09-ae48-bd30ef9af9c8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:01.717107 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-4c4268d9-a4c7-4a09-ae48-bd30ef9af9c8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.151649 May 24 15:42:01.717670 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1325/2641] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:01 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:01.722065 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-ca2c7c79-4e39-4973-9bd9-f7d7f4fdd69e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:01.722659 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-ca2c7c79-4e39-4973-9bd9-f7d7f4fdd69e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:01.728543 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ca2c7c79-4e39-4973-9bd9-f7d7f4fdd69e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:01.728986 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ca2c7c79-4e39-4973-9bd9-f7d7f4fdd69e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:01.730243 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ca2c7c79-4e39-4973-9bd9-f7d7f4fdd69e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:01.730711 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ca2c7c79-4e39-4973-9bd9-f7d7f4fdd69e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:01.772617 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-aace2eb5-502f-48fd-b37e-de2b1eeb5264 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:01.780615 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-aace2eb5-502f-48fd-b37e-de2b1eeb5264 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.155939 May 24 15:42:01.781390 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1317/2642] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:01 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:42:01.791426 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ca2c7c79-4e39-4973-9bd9-f7d7f4fdd69e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:01.800384 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ca2c7c79-4e39-4973-9bd9-f7d7f4fdd69e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:01.801878 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ca2c7c79-4e39-4973-9bd9-f7d7f4fdd69e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:01.803015 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-ca2c7c79-4e39-4973-9bd9-f7d7f4fdd69e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084447 May 24 15:42:01.803567 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1326/2643] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:42:01 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:42:02.443505 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-5322ccbd-4ccd-44e9-a12c-cd9e12344788 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:02.444064 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-5322ccbd-4ccd-44e9-a12c-cd9e12344788 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:02.451157 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5322ccbd-4ccd-44e9-a12c-cd9e12344788 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:02.451595 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5322ccbd-4ccd-44e9-a12c-cd9e12344788 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:02.452369 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5322ccbd-4ccd-44e9-a12c-cd9e12344788 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:02.452802 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5322ccbd-4ccd-44e9-a12c-cd9e12344788 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:02.580174 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-5322ccbd-4ccd-44e9-a12c-cd9e12344788 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:02.588069 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-5322ccbd-4ccd-44e9-a12c-cd9e12344788 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.148550 May 24 15:42:02.588661 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1318/2644] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:02 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:02.733289 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-7b80db02-19a2-488f-9127-17190baa414c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:02.734010 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-7b80db02-19a2-488f-9127-17190baa414c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:02.740250 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7b80db02-19a2-488f-9127-17190baa414c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:02.740735 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7b80db02-19a2-488f-9127-17190baa414c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:02.741751 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7b80db02-19a2-488f-9127-17190baa414c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:02.742188 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7b80db02-19a2-488f-9127-17190baa414c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:02.797528 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-642f6450-29f3-43e4-838a-45df11c275f3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:02.798117 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-642f6450-29f3-43e4-838a-45df11c275f3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:02.804211 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-642f6450-29f3-43e4-838a-45df11c275f3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:02.804681 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-642f6450-29f3-43e4-838a-45df11c275f3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:02.805440 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-642f6450-29f3-43e4-838a-45df11c275f3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:02.805875 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-642f6450-29f3-43e4-838a-45df11c275f3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:02.875253 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-7b80db02-19a2-488f-9127-17190baa414c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:02.883293 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-7b80db02-19a2-488f-9127-17190baa414c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.153705 May 24 15:42:02.883866 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1327/2645] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:02 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:02.889089 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-702923c7-34e8-4e47-bd2a-c642271776a3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:02.889698 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-702923c7-34e8-4e47-bd2a-c642271776a3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:02.895699 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-702923c7-34e8-4e47-bd2a-c642271776a3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:02.896145 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-702923c7-34e8-4e47-bd2a-c642271776a3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:02.896988 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-702923c7-34e8-4e47-bd2a-c642271776a3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:02.897417 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-702923c7-34e8-4e47-bd2a-c642271776a3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:02.942636 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-642f6450-29f3-43e4-838a-45df11c275f3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:02.951359 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-642f6450-29f3-43e4-838a-45df11c275f3 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.157717 May 24 15:42:02.951933 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1319/2646] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:02 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:42:02.960959 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-702923c7-34e8-4e47-bd2a-c642271776a3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:02.969331 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-702923c7-34e8-4e47-bd2a-c642271776a3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:02.970813 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-702923c7-34e8-4e47-bd2a-c642271776a3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:02.971933 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-702923c7-34e8-4e47-bd2a-c642271776a3 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.087127 May 24 15:42:02.972515 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1328/2647] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:42:02 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:42:03.606083 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e39c5662-5a79-45d9-95f8-eefb66168855 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:03.606692 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-e39c5662-5a79-45d9-95f8-eefb66168855 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:03.613254 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e39c5662-5a79-45d9-95f8-eefb66168855 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:03.613694 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e39c5662-5a79-45d9-95f8-eefb66168855 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:03.614437 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e39c5662-5a79-45d9-95f8-eefb66168855 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:03.614865 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e39c5662-5a79-45d9-95f8-eefb66168855 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:03.744886 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-e39c5662-5a79-45d9-95f8-eefb66168855 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:03.752956 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-e39c5662-5a79-45d9-95f8-eefb66168855 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.151315 May 24 15:42:03.753524 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1320/2648] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:03 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:03.900702 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-105fe0dd-086a-4250-a220-85ee300cdea3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:03.901230 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-105fe0dd-086a-4250-a220-85ee300cdea3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:03.908425 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-105fe0dd-086a-4250-a220-85ee300cdea3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:03.908872 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-105fe0dd-086a-4250-a220-85ee300cdea3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:03.909634 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-105fe0dd-086a-4250-a220-85ee300cdea3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:03.910068 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-105fe0dd-086a-4250-a220-85ee300cdea3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:03.914022 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:42:03.968244 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-93fbce4b-b661-4481-b278-da8c3791d611 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:03.968904 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-93fbce4b-b661-4481-b278-da8c3791d611 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:03.974924 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-93fbce4b-b661-4481-b278-da8c3791d611 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:03.975373 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-93fbce4b-b661-4481-b278-da8c3791d611 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:03.976135 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-93fbce4b-b661-4481-b278-da8c3791d611 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:03.976590 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-93fbce4b-b661-4481-b278-da8c3791d611 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:03.980477 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:42:04.034314 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 15:42:04.035712 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Tue May 24 15:42:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 (ip 10.222.0.45) !!! May 24 15:42:04.037183 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-105fe0dd-086a-4250-a220-85ee300cdea3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:04.046216 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-105fe0dd-086a-4250-a220-85ee300cdea3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.149422 May 24 15:42:04.046816 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1329/2649] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:03 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:04.051384 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-5139c778-18fe-43be-a371-d6336915e70b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:04.052091 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-5139c778-18fe-43be-a371-d6336915e70b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:04.058029 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5139c778-18fe-43be-a371-d6336915e70b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:04.058491 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5139c778-18fe-43be-a371-d6336915e70b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:04.059609 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5139c778-18fe-43be-a371-d6336915e70b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:04.059609 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5139c778-18fe-43be-a371-d6336915e70b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:04.112708 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-93fbce4b-b661-4481-b278-da8c3791d611 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:04.120939 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-5139c778-18fe-43be-a371-d6336915e70b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:04.121116 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-93fbce4b-b661-4481-b278-da8c3791d611 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.157219 May 24 15:42:04.121602 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1321/2650] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:03 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:42:04.129363 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-5139c778-18fe-43be-a371-d6336915e70b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:04.130846 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-5139c778-18fe-43be-a371-d6336915e70b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:04.131963 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-5139c778-18fe-43be-a371-d6336915e70b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084254 May 24 15:42:04.132539 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1330/2651] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:42:04 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:42:04.770149 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-dea050fb-aee3-47a3-bc6f-8734eb96f524 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:04.770783 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-dea050fb-aee3-47a3-bc6f-8734eb96f524 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:04.777260 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dea050fb-aee3-47a3-bc6f-8734eb96f524 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:04.777701 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dea050fb-aee3-47a3-bc6f-8734eb96f524 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:04.778446 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dea050fb-aee3-47a3-bc6f-8734eb96f524 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:04.778872 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dea050fb-aee3-47a3-bc6f-8734eb96f524 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:04.906209 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-dea050fb-aee3-47a3-bc6f-8734eb96f524 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:04.914073 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-dea050fb-aee3-47a3-bc6f-8734eb96f524 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.147815 May 24 15:42:04.914636 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1322/2652] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:04 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:05.062802 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-50a6e3e8-0fbf-4dba-b059-a0632a0a907d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:05.063447 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-50a6e3e8-0fbf-4dba-b059-a0632a0a907d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:05.070142 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-50a6e3e8-0fbf-4dba-b059-a0632a0a907d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:05.070591 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-50a6e3e8-0fbf-4dba-b059-a0632a0a907d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:05.071340 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-50a6e3e8-0fbf-4dba-b059-a0632a0a907d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:05.071773 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-50a6e3e8-0fbf-4dba-b059-a0632a0a907d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:05.137753 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-aef97ae3-5c94-4f89-b5a4-db4d0ecdc4ba tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:05.138368 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-aef97ae3-5c94-4f89-b5a4-db4d0ecdc4ba tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:05.144393 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-aef97ae3-5c94-4f89-b5a4-db4d0ecdc4ba tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:05.144848 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-aef97ae3-5c94-4f89-b5a4-db4d0ecdc4ba tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:05.145616 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-aef97ae3-5c94-4f89-b5a4-db4d0ecdc4ba tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:05.146051 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-aef97ae3-5c94-4f89-b5a4-db4d0ecdc4ba tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:05.201875 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-50a6e3e8-0fbf-4dba-b059-a0632a0a907d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:05.209875 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-50a6e3e8-0fbf-4dba-b059-a0632a0a907d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.150896 May 24 15:42:05.210443 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1331/2653] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:05 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:42:05.215283 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-9c10eab1-be76-4172-bbb2-397f667a599e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:05.215906 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-9c10eab1-be76-4172-bbb2-397f667a599e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:05.221876 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9c10eab1-be76-4172-bbb2-397f667a599e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:05.222671 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9c10eab1-be76-4172-bbb2-397f667a599e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:05.223100 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9c10eab1-be76-4172-bbb2-397f667a599e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:05.223535 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9c10eab1-be76-4172-bbb2-397f667a599e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:05.274184 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-aef97ae3-5c94-4f89-b5a4-db4d0ecdc4ba tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:05.282677 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-aef97ae3-5c94-4f89-b5a4-db4d0ecdc4ba tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.148735 May 24 15:42:05.283247 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1323/2654] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:05 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:42:05.284560 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-9c10eab1-be76-4172-bbb2-397f667a599e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:05.293723 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-9c10eab1-be76-4172-bbb2-397f667a599e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:05.295296 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-9c10eab1-be76-4172-bbb2-397f667a599e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:05.297087 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-9c10eab1-be76-4172-bbb2-397f667a599e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.085535 May 24 15:42:05.297889 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1332/2655] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:42:05 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:42:05.931482 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d9269911-8a04-407e-b19e-7088ed74b18b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:05.932095 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d9269911-8a04-407e-b19e-7088ed74b18b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:05.938713 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d9269911-8a04-407e-b19e-7088ed74b18b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:05.939161 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d9269911-8a04-407e-b19e-7088ed74b18b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:05.939932 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d9269911-8a04-407e-b19e-7088ed74b18b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:05.940393 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d9269911-8a04-407e-b19e-7088ed74b18b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:06.067930 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-d9269911-8a04-407e-b19e-7088ed74b18b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:06.076842 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d9269911-8a04-407e-b19e-7088ed74b18b tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.149259 May 24 15:42:06.077404 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1324/2656] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:05 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:06.226967 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-0a9c70f3-34c4-4fea-8e24-7438efefce1d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:06.227591 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-0a9c70f3-34c4-4fea-8e24-7438efefce1d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:06.234007 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0a9c70f3-34c4-4fea-8e24-7438efefce1d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:06.234443 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0a9c70f3-34c4-4fea-8e24-7438efefce1d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:06.235193 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0a9c70f3-34c4-4fea-8e24-7438efefce1d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:06.235619 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0a9c70f3-34c4-4fea-8e24-7438efefce1d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:06.276644 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 15:42:06.277400 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Tue May 24 15:42:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f (ip 10.222.0.45) !!! May 24 15:42:06.299065 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-cda28d9c-5ed8-4149-a8bc-425ac6c70309 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:06.299673 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-cda28d9c-5ed8-4149-a8bc-425ac6c70309 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:06.306293 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cda28d9c-5ed8-4149-a8bc-425ac6c70309 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:06.306734 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cda28d9c-5ed8-4149-a8bc-425ac6c70309 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:06.307495 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cda28d9c-5ed8-4149-a8bc-425ac6c70309 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:06.307928 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cda28d9c-5ed8-4149-a8bc-425ac6c70309 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:06.365378 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-0a9c70f3-34c4-4fea-8e24-7438efefce1d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:06.374336 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-0a9c70f3-34c4-4fea-8e24-7438efefce1d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.151187 May 24 15:42:06.374927 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1333/2657] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:06 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:06.379600 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-64032c36-ef76-45af-90d8-d45efadb773d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:06.380206 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-64032c36-ef76-45af-90d8-d45efadb773d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:06.386655 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-64032c36-ef76-45af-90d8-d45efadb773d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:06.387096 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-64032c36-ef76-45af-90d8-d45efadb773d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:06.387845 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-64032c36-ef76-45af-90d8-d45efadb773d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:06.388271 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-64032c36-ef76-45af-90d8-d45efadb773d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:06.437780 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-cda28d9c-5ed8-4149-a8bc-425ac6c70309 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:06.446293 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-cda28d9c-5ed8-4149-a8bc-425ac6c70309 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.151042 May 24 15:42:06.447073 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1325/2658] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:06 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:42:06.453304 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-64032c36-ef76-45af-90d8-d45efadb773d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:06.461791 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-64032c36-ef76-45af-90d8-d45efadb773d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:06.463277 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-64032c36-ef76-45af-90d8-d45efadb773d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:06.465040 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-64032c36-ef76-45af-90d8-d45efadb773d tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.088529 May 24 15:42:06.465584 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1334/2659] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:42:06 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:42:07.093066 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-78053487-ccb1-4938-8d09-0b608f6bcea8 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:07.093701 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-78053487-ccb1-4938-8d09-0b608f6bcea8 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:07.100188 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-78053487-ccb1-4938-8d09-0b608f6bcea8 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:07.100660 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-78053487-ccb1-4938-8d09-0b608f6bcea8 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:07.101407 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-78053487-ccb1-4938-8d09-0b608f6bcea8 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:07.101838 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-78053487-ccb1-4938-8d09-0b608f6bcea8 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:07.227136 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-78053487-ccb1-4938-8d09-0b608f6bcea8 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:07.235408 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-78053487-ccb1-4938-8d09-0b608f6bcea8 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.146212 May 24 15:42:07.235966 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1326/2660] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:07 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:07.390349 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-08980489-e2f4-431a-bfda-aa38f8c5b352 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:07.390952 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-08980489-e2f4-431a-bfda-aa38f8c5b352 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:07.397562 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-08980489-e2f4-431a-bfda-aa38f8c5b352 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:07.398011 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-08980489-e2f4-431a-bfda-aa38f8c5b352 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:07.398805 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-08980489-e2f4-431a-bfda-aa38f8c5b352 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:07.399242 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-08980489-e2f4-431a-bfda-aa38f8c5b352 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:07.462942 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-509e9530-6e93-4173-85b0-79366fbf2758 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:07.463473 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-509e9530-6e93-4173-85b0-79366fbf2758 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:07.469975 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-509e9530-6e93-4173-85b0-79366fbf2758 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:07.470427 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-509e9530-6e93-4173-85b0-79366fbf2758 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:07.471192 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-509e9530-6e93-4173-85b0-79366fbf2758 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:07.471630 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-509e9530-6e93-4173-85b0-79366fbf2758 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:07.525470 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-08980489-e2f4-431a-bfda-aa38f8c5b352 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:07.533942 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-08980489-e2f4-431a-bfda-aa38f8c5b352 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.147398 May 24 15:42:07.534506 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1335/2661] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:07 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:07.538876 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-ba4ba0be-a76b-41df-b555-538d430b2112 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:07.539754 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-ba4ba0be-a76b-41df-b555-538d430b2112 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:07.546008 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ba4ba0be-a76b-41df-b555-538d430b2112 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:07.546448 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ba4ba0be-a76b-41df-b555-538d430b2112 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:07.547192 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ba4ba0be-a76b-41df-b555-538d430b2112 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:07.547620 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ba4ba0be-a76b-41df-b555-538d430b2112 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:07.604052 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-509e9530-6e93-4173-85b0-79366fbf2758 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:07.608607 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ba4ba0be-a76b-41df-b555-538d430b2112 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:07.612767 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-509e9530-6e93-4173-85b0-79366fbf2758 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.153773 May 24 15:42:07.613344 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1327/2662] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:07 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:42:07.617219 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ba4ba0be-a76b-41df-b555-538d430b2112 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:07.618706 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ba4ba0be-a76b-41df-b555-538d430b2112 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:07.619825 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-ba4ba0be-a76b-41df-b555-538d430b2112 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.084423 May 24 15:42:07.620418 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1336/2663] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:42:07 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:42:08.252677 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-7c3161e9-bb83-44cc-ae6f-434b67bd20e3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:08.253283 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-7c3161e9-bb83-44cc-ae6f-434b67bd20e3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:08.259851 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7c3161e9-bb83-44cc-ae6f-434b67bd20e3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:08.260481 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7c3161e9-bb83-44cc-ae6f-434b67bd20e3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:08.261236 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7c3161e9-bb83-44cc-ae6f-434b67bd20e3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:08.261661 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7c3161e9-bb83-44cc-ae6f-434b67bd20e3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:08.386416 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-7c3161e9-bb83-44cc-ae6f-434b67bd20e3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:08.394405 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-7c3161e9-bb83-44cc-ae6f-434b67bd20e3 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.145587 May 24 15:42:08.394976 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1328/2664] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:08 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:08.551514 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-64c8ae67-da33-47cb-ab02-7d31c9538218 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:08.552132 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-64c8ae67-da33-47cb-ab02-7d31c9538218 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:08.558672 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-64c8ae67-da33-47cb-ab02-7d31c9538218 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:08.559112 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-64c8ae67-da33-47cb-ab02-7d31c9538218 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:08.559900 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-64c8ae67-da33-47cb-ab02-7d31c9538218 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:08.560362 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-64c8ae67-da33-47cb-ab02-7d31c9538218 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:08.630023 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-1a7bb819-2ce0-46ce-922d-27d3a5b2cea7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:08.630546 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-1a7bb819-2ce0-46ce-922d-27d3a5b2cea7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:08.636980 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1a7bb819-2ce0-46ce-922d-27d3a5b2cea7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:08.637422 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1a7bb819-2ce0-46ce-922d-27d3a5b2cea7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:08.638176 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1a7bb819-2ce0-46ce-922d-27d3a5b2cea7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:08.638609 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1a7bb819-2ce0-46ce-922d-27d3a5b2cea7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:08.688355 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-64c8ae67-da33-47cb-ab02-7d31c9538218 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:08.696484 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-64c8ae67-da33-47cb-ab02-7d31c9538218 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.148811 May 24 15:42:08.697055 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1337/2665] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:08 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:42:08.702083 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-7aafee58-7bf0-4262-b1c4-9aebb6a43e01 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:08.702677 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-7aafee58-7bf0-4262-b1c4-9aebb6a43e01 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:08.708855 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7aafee58-7bf0-4262-b1c4-9aebb6a43e01 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:08.709296 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7aafee58-7bf0-4262-b1c4-9aebb6a43e01 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:08.710083 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7aafee58-7bf0-4262-b1c4-9aebb6a43e01 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:08.710506 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7aafee58-7bf0-4262-b1c4-9aebb6a43e01 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:08.772291 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-7aafee58-7bf0-4262-b1c4-9aebb6a43e01 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:08.779395 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-1a7bb819-2ce0-46ce-922d-27d3a5b2cea7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:08.780707 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-7aafee58-7bf0-4262-b1c4-9aebb6a43e01 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:08.782191 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-7aafee58-7bf0-4262-b1c4-9aebb6a43e01 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:08.783324 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-7aafee58-7bf0-4262-b1c4-9aebb6a43e01 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 200 len: 1444 microversion: 2.20 time: 0.085365 May 24 15:42:08.783882 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1338/2666] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:42:08 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:42:08.787440 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-1a7bb819-2ce0-46ce-922d-27d3a5b2cea7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.161384 May 24 15:42:08.788002 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1329/2667] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:08 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:42:08.800773 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-5c9838bd-cf10-4543-a24a-f07e6e649a21 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '.version_select at 0x7f2dd269b280>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:08.820950 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-5c9838bd-cf10-4543-a24a-f07e6e649a21 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1810429186" status: 204 len: 0 microversion: 2.20 time: 0.023823 May 24 15:42:08.821498 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1339/2668] 10.222.0.45 () {60 vars in 1261 bytes} [Tue May 24 15:42:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1810429186 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 24 15:42:09.411023 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-0c4f114a-7487-40db-a6cf-ed927583553c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:09.411673 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-0c4f114a-7487-40db-a6cf-ed927583553c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:09.418749 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0c4f114a-7487-40db-a6cf-ed927583553c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:09.419188 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0c4f114a-7487-40db-a6cf-ed927583553c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:09.419956 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0c4f114a-7487-40db-a6cf-ed927583553c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:09.420486 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0c4f114a-7487-40db-a6cf-ed927583553c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:09.560148 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-0c4f114a-7487-40db-a6cf-ed927583553c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:09.568245 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-0c4f114a-7487-40db-a6cf-ed927583553c tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.161103 May 24 15:42:09.568844 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1330/2669] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:09 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:09.642989 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-cb8d009f-7b5b-42b6-a3fd-8b0dfeb69d90 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Action: 'create', calling method: .version_select at 0x7f2dd263e550>, body: {"keypair": {"name": "tempest-keypair-853202945", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfyiQW7WGxMTelQnboEZ/hbfjv954DmDGnWxx+sokULIpwvw7m56C1hO+jR6FROEF/b0S7Zx1E6Vs2eZlS2Z36nE6A5fqCGwaOuH+9x+DTnh0J++zWEG4GiKs4dyBKSuw=="}} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:42:09.657257 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.quota [None req-cb8d009f-7b5b-42b6-a3fd-8b0dfeb69d90 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Getting quotas for project 0fe1d758c40542e9b237f9d7bcfa5755. Resources: {'key_pairs'} {{(pid=117698) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 15:42:09.661422 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.quota [None req-cb8d009f-7b5b-42b6-a3fd-8b0dfeb69d90 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Getting quotas for user 40db5795ce7e4c5bbf06fb81ce404e78 and project 0fe1d758c40542e9b237f9d7bcfa5755. Resources: {'key_pairs'} {{(pid=117698) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 15:42:09.684284 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-cb8d009f-7b5b-42b6-a3fd-8b0dfeb69d90 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.045731 May 24 15:42:09.684896 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1340/2670] 10.222.0.45 () {62 vars in 1199 bytes} [Tue May 24 15:42:09 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 47 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 24 15:42:09.714505 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-6ef1efc9-eb4e-450e-b53e-4a8d82f87bc6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:09.715181 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-6ef1efc9-eb4e-450e-b53e-4a8d82f87bc6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:09.721296 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6ef1efc9-eb4e-450e-b53e-4a8d82f87bc6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:09.721753 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6ef1efc9-eb4e-450e-b53e-4a8d82f87bc6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:09.722520 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6ef1efc9-eb4e-450e-b53e-4a8d82f87bc6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:09.722955 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6ef1efc9-eb4e-450e-b53e-4a8d82f87bc6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:09.804834 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c39a06c1-f15f-4e84-8968-4b6b26f5179c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:09.805681 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-c39a06c1-f15f-4e84-8968-4b6b26f5179c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:09.813206 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c39a06c1-f15f-4e84-8968-4b6b26f5179c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:09.813917 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c39a06c1-f15f-4e84-8968-4b6b26f5179c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:09.814875 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c39a06c1-f15f-4e84-8968-4b6b26f5179c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:09.815310 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c39a06c1-f15f-4e84-8968-4b6b26f5179c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:09.869354 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-6ef1efc9-eb4e-450e-b53e-4a8d82f87bc6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:09.877440 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-6ef1efc9-eb4e-450e-b53e-4a8d82f87bc6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.167487 May 24 15:42:09.878028 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1331/2671] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:09 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:10.001822 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-c39a06c1-f15f-4e84-8968-4b6b26f5179c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:10.013142 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-c39a06c1-f15f-4e84-8968-4b6b26f5179c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.212167 May 24 15:42:10.013712 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1341/2672] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:09 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:10.584905 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-8441e86b-f9f5-4b42-8f09-9657597f2fc9 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:10.586229 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-8441e86b-f9f5-4b42-8f09-9657597f2fc9 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:10.593242 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8441e86b-f9f5-4b42-8f09-9657597f2fc9 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:10.593810 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8441e86b-f9f5-4b42-8f09-9657597f2fc9 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:10.594522 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8441e86b-f9f5-4b42-8f09-9657597f2fc9 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:10.594948 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8441e86b-f9f5-4b42-8f09-9657597f2fc9 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:10.827339 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-8441e86b-f9f5-4b42-8f09-9657597f2fc9 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:10.835826 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-8441e86b-f9f5-4b42-8f09-9657597f2fc9 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.254566 May 24 15:42:10.836419 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1332/2673] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:10 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:10.895117 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-499a714c-72df-4546-8057-98eb4378cb70 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:10.896048 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-499a714c-72df-4546-8057-98eb4378cb70 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:10.903582 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-499a714c-72df-4546-8057-98eb4378cb70 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:10.904178 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-499a714c-72df-4546-8057-98eb4378cb70 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:10.905097 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-499a714c-72df-4546-8057-98eb4378cb70 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:10.905534 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-499a714c-72df-4546-8057-98eb4378cb70 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:11.034534 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-10da287d-3805-4555-8d2b-17dc0498a68a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:11.035151 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-10da287d-3805-4555-8d2b-17dc0498a68a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:11.041785 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-10da287d-3805-4555-8d2b-17dc0498a68a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:11.042907 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-10da287d-3805-4555-8d2b-17dc0498a68a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:11.043777 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-499a714c-72df-4546-8057-98eb4378cb70 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:11.043935 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-10da287d-3805-4555-8d2b-17dc0498a68a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:11.044581 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-10da287d-3805-4555-8d2b-17dc0498a68a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:11.051855 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-499a714c-72df-4546-8057-98eb4378cb70 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.160805 May 24 15:42:11.053619 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1342/2674] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:10 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:11.061534 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-abf01ad5-da19-40e6-ac1f-1818f516ecbb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-880456366", "imageRef": "f921f75e-bbd1-4d99-ab1e-5cce2d895148", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "03d59a96-71b6-4a30-bfcb-f7c0dbc4ebce"}], "security_groups": [{"name": "tempest-securitygroup--1831405496"}], "key_name": "tempest-keypair-853202945", "user_data": "}} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:42:11.172059 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.network.neutron [None req-abf01ad5-da19-40e6-ac1f-1818f516ecbb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] validate_networks() for [('03d59a96-71b6-4a30-bfcb-f7c0dbc4ebce', None, None, None, None, None)] {{(pid=117698) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 15:42:11.196752 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-10da287d-3805-4555-8d2b-17dc0498a68a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:11.204958 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-10da287d-3805-4555-8d2b-17dc0498a68a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.174228 May 24 15:42:11.205574 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1333/2675] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:11 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:42:11.586349 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.virt.hardware [None req-abf01ad5-da19-40e6-ac1f-1818f516ecbb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Flavor limits 0:0:0 {{(pid=117698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 15:42:11.586778 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.virt.hardware [None req-abf01ad5-da19-40e6-ac1f-1818f516ecbb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Image limits 0:0:0 {{(pid=117698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 15:42:11.587258 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.virt.hardware [None req-abf01ad5-da19-40e6-ac1f-1818f516ecbb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Flavor pref 0:0:0 {{(pid=117698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 15:42:11.587670 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.virt.hardware [None req-abf01ad5-da19-40e6-ac1f-1818f516ecbb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Image pref 0:0:0 {{(pid=117698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 15:42:11.588084 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.virt.hardware [None req-abf01ad5-da19-40e6-ac1f-1818f516ecbb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 15:42:11.597431 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-abf01ad5-da19-40e6-ac1f-1818f516ecbb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:11.597877 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-abf01ad5-da19-40e6-ac1f-1818f516ecbb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:11.598678 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-abf01ad5-da19-40e6-ac1f-1818f516ecbb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:11.599114 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-abf01ad5-da19-40e6-ac1f-1818f516ecbb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:11.615427 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.quota [None req-abf01ad5-da19-40e6-ac1f-1818f516ecbb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Getting quotas for project 0fe1d758c40542e9b237f9d7bcfa5755. Resources: {'instances', 'ram', 'cores'} {{(pid=117698) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 15:42:11.619611 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.quota [None req-abf01ad5-da19-40e6-ac1f-1818f516ecbb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Getting quotas for user 40db5795ce7e4c5bbf06fb81ce404e78 and project 0fe1d758c40542e9b237f9d7bcfa5755. Resources: {'instances', 'ram', 'cores'} {{(pid=117698) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 15:42:11.630426 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-abf01ad5-da19-40e6-ac1f-1818f516ecbb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Going to run 1 instances... {{(pid=117698) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 15:42:11.632676 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-abf01ad5-da19-40e6-ac1f-1818f516ecbb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: d8d131e6-a9cf-46ca-bd20-8fba3e295618] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f921f75e-bbd1-4d99-ab1e-5cce2d895148',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 15:42:11.681272 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-abf01ad5-da19-40e6-ac1f-1818f516ecbb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.625289 May 24 15:42:11.681958 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1343/2676] 10.222.0.45 () {62 vars in 1187 bytes} [Tue May 24 15:42:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 24 15:42:11.691968 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-edca6634-834a-47d0-9cde-a3ac82d59f2a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:11.692751 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-edca6634-834a-47d0-9cde-a3ac82d59f2a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: d8d131e6-a9cf-46ca-bd20-8fba3e295618] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:11.747667 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-edca6634-834a-47d0-9cde-a3ac82d59f2a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:11.754760 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-edca6634-834a-47d0-9cde-a3ac82d59f2a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:11.756253 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-edca6634-834a-47d0-9cde-a3ac82d59f2a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:11.757371 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-edca6634-834a-47d0-9cde-a3ac82d59f2a tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/d8d131e6-a9cf-46ca-bd20-8fba3e295618" status: 200 len: 1280 microversion: 2.20 time: 0.069364 May 24 15:42:11.757919 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1334/2677] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:42:11 2022] GET /compute/v2.1/servers/d8d131e6-a9cf-46ca-bd20-8fba3e295618 => generated 1280 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:42:11.853759 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-838b160d-5ec2-4bd0-b1a1-a95d144b4bb2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:11.854483 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-838b160d-5ec2-4bd0-b1a1-a95d144b4bb2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:11.860539 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-838b160d-5ec2-4bd0-b1a1-a95d144b4bb2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:11.861004 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-838b160d-5ec2-4bd0-b1a1-a95d144b4bb2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:11.861670 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-838b160d-5ec2-4bd0-b1a1-a95d144b4bb2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:11.862097 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-838b160d-5ec2-4bd0-b1a1-a95d144b4bb2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:11.997147 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-838b160d-5ec2-4bd0-b1a1-a95d144b4bb2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:12.005482 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-838b160d-5ec2-4bd0-b1a1-a95d144b4bb2 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.155770 May 24 15:42:12.006164 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1344/2678] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:11 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:12.069465 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e1d71db1-798e-405a-95ea-8158fd7a39e6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:12.070076 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-e1d71db1-798e-405a-95ea-8158fd7a39e6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:12.076910 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e1d71db1-798e-405a-95ea-8158fd7a39e6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:12.077313 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e1d71db1-798e-405a-95ea-8158fd7a39e6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:12.078073 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e1d71db1-798e-405a-95ea-8158fd7a39e6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:12.078502 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e1d71db1-798e-405a-95ea-8158fd7a39e6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:12.212358 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-e1d71db1-798e-405a-95ea-8158fd7a39e6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:12.221172 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-e1d71db1-798e-405a-95ea-8158fd7a39e6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.155638 May 24 15:42:12.221745 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1335/2679] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:12 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:12.222870 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e9b814ac-46e4-4b0b-ac7e-c41c30be3eac tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:12.223476 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e9b814ac-46e4-4b0b-ac7e-c41c30be3eac tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:12.230133 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e9b814ac-46e4-4b0b-ac7e-c41c30be3eac tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:12.230573 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e9b814ac-46e4-4b0b-ac7e-c41c30be3eac tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:12.231320 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e9b814ac-46e4-4b0b-ac7e-c41c30be3eac tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:12.231743 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e9b814ac-46e4-4b0b-ac7e-c41c30be3eac tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:12.364692 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e9b814ac-46e4-4b0b-ac7e-c41c30be3eac tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:12.373716 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e9b814ac-46e4-4b0b-ac7e-c41c30be3eac tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.154690 May 24 15:42:12.374301 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1345/2680] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:12 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:12.774912 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-c9a555b4-d83b-40a0-b0bb-5ac5f8e704da tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:12.775559 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-c9a555b4-d83b-40a0-b0bb-5ac5f8e704da tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: d8d131e6-a9cf-46ca-bd20-8fba3e295618] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:12.782780 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c9a555b4-d83b-40a0-b0bb-5ac5f8e704da tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:12.783226 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c9a555b4-d83b-40a0-b0bb-5ac5f8e704da tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:12.783995 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c9a555b4-d83b-40a0-b0bb-5ac5f8e704da tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:12.784452 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c9a555b4-d83b-40a0-b0bb-5ac5f8e704da tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:12.853749 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-c9a555b4-d83b-40a0-b0bb-5ac5f8e704da tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:12.862948 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-c9a555b4-d83b-40a0-b0bb-5ac5f8e704da tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:12.864596 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-c9a555b4-d83b-40a0-b0bb-5ac5f8e704da tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:12.866079 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-c9a555b4-d83b-40a0-b0bb-5ac5f8e704da tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/d8d131e6-a9cf-46ca-bd20-8fba3e295618" status: 200 len: 1340 microversion: 2.20 time: 0.095047 May 24 15:42:12.867090 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1336/2681] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:42:12 2022] GET /compute/v2.1/servers/d8d131e6-a9cf-46ca-bd20-8fba3e295618 => generated 1340 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:42:13.023004 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-3e5badb6-84c2-44e4-8152-27a35afef398 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:13.023708 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-3e5badb6-84c2-44e4-8152-27a35afef398 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:13.031035 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3e5badb6-84c2-44e4-8152-27a35afef398 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:13.031452 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3e5badb6-84c2-44e4-8152-27a35afef398 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:13.032197 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3e5badb6-84c2-44e4-8152-27a35afef398 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:13.032656 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3e5badb6-84c2-44e4-8152-27a35afef398 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:13.237709 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-3e5badb6-84c2-44e4-8152-27a35afef398 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:13.241791 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-aad1634e-49a8-48b8-9722-7954599fe780 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:13.242831 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-aad1634e-49a8-48b8-9722-7954599fe780 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:13.251589 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-3e5badb6-84c2-44e4-8152-27a35afef398 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.232086 May 24 15:42:13.252886 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1346/2682] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:13 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:13.253618 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-aad1634e-49a8-48b8-9722-7954599fe780 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:13.254381 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-aad1634e-49a8-48b8-9722-7954599fe780 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:13.255369 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-aad1634e-49a8-48b8-9722-7954599fe780 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:13.256025 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-aad1634e-49a8-48b8-9722-7954599fe780 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:13.383449 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-aad1634e-49a8-48b8-9722-7954599fe780 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:13.391237 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-659b2680-9d95-4e0a-9a43-c941f393f530 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:13.391838 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-659b2680-9d95-4e0a-9a43-c941f393f530 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:13.392484 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-aad1634e-49a8-48b8-9722-7954599fe780 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.157685 May 24 15:42:13.393213 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1337/2683] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:13 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:13.398628 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-659b2680-9d95-4e0a-9a43-c941f393f530 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:13.399183 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-659b2680-9d95-4e0a-9a43-c941f393f530 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:13.400135 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-659b2680-9d95-4e0a-9a43-c941f393f530 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:13.400614 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-659b2680-9d95-4e0a-9a43-c941f393f530 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:13.594537 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-659b2680-9d95-4e0a-9a43-c941f393f530 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:13.602762 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-659b2680-9d95-4e0a-9a43-c941f393f530 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.215272 May 24 15:42:13.603332 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1347/2684] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:13 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:42:13.888012 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-199b5f85-5756-44cc-839b-b4405b6c9763 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:13.888692 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-199b5f85-5756-44cc-839b-b4405b6c9763 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: d8d131e6-a9cf-46ca-bd20-8fba3e295618] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:13.895253 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-199b5f85-5756-44cc-839b-b4405b6c9763 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:13.895698 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-199b5f85-5756-44cc-839b-b4405b6c9763 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:13.896486 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-199b5f85-5756-44cc-839b-b4405b6c9763 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:13.896912 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-199b5f85-5756-44cc-839b-b4405b6c9763 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:14.027901 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-199b5f85-5756-44cc-839b-b4405b6c9763 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:14.031459 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:42:14.037081 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-199b5f85-5756-44cc-839b-b4405b6c9763 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:14.038565 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-199b5f85-5756-44cc-839b-b4405b6c9763 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:14.039746 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-199b5f85-5756-44cc-839b-b4405b6c9763 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/d8d131e6-a9cf-46ca-bd20-8fba3e295618" status: 200 len: 1406 microversion: 2.20 time: 0.159081 May 24 15:42:14.040335 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1338/2685] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:42:13 2022] GET /compute/v2.1/servers/d8d131e6-a9cf-46ca-bd20-8fba3e295618 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:42:14.270327 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-34aa7517-d51f-4718-8596-8b015063952d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:14.271108 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-34aa7517-d51f-4718-8596-8b015063952d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:14.278566 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-34aa7517-d51f-4718-8596-8b015063952d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:14.279005 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-34aa7517-d51f-4718-8596-8b015063952d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:14.280030 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-34aa7517-d51f-4718-8596-8b015063952d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:14.280184 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-34aa7517-d51f-4718-8596-8b015063952d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:14.301130 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:42:14.486291 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [req-de02af55-216f-414e-aab8-75da5c602da8 req-42bb3b11-0157-42f1-9bb5-acd06d8f49ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8d131e6-a9cf-46ca-bd20-8fba3e295618", "tag": "ab5bccec-476f-4ab7-97df-9a2b9fc9bf17"}]} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:42:14.495769 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-de02af55-216f-414e-aab8-75da5c602da8 req-42bb3b11-0157-42f1-9bb5-acd06d8f49ac service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:14.496218 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-de02af55-216f-414e-aab8-75da5c602da8 req-42bb3b11-0157-42f1-9bb5-acd06d8f49ac service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:14.508043 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.compute.server_external_events [req-de02af55-216f-414e-aab8-75da5c602da8 req-42bb3b11-0157-42f1-9bb5-acd06d8f49ac service nova] Creating event network-changed:ab5bccec-476f-4ab7-97df-9a2b9fc9bf17 for instance d8d131e6-a9cf-46ca-bd20-8fba3e295618 on hv-cinder-84315 May 24 15:42:14.514678 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [req-de02af55-216f-414e-aab8-75da5c602da8 req-42bb3b11-0157-42f1-9bb5-acd06d8f49ac service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133391 May 24 15:42:14.515597 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1339/2686] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:42:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:42:14.521404 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-06f18c98-6b81-4bd4-8d1b-6e710e7a156b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:14.522370 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-06f18c98-6b81-4bd4-8d1b-6e710e7a156b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:14.527008 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-34aa7517-d51f-4718-8596-8b015063952d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:14.529713 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-06f18c98-6b81-4bd4-8d1b-6e710e7a156b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:14.530275 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-06f18c98-6b81-4bd4-8d1b-6e710e7a156b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:14.531996 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-06f18c98-6b81-4bd4-8d1b-6e710e7a156b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:14.532803 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-06f18c98-6b81-4bd4-8d1b-6e710e7a156b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:14.535321 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-34aa7517-d51f-4718-8596-8b015063952d tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.269012 May 24 15:42:14.535902 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1348/2687] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:14 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:14.620366 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-dbb0ebeb-2415-4ef4-a11b-27140fb7b766 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:14.621311 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-dbb0ebeb-2415-4ef4-a11b-27140fb7b766 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:14.631567 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dbb0ebeb-2415-4ef4-a11b-27140fb7b766 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:14.632055 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dbb0ebeb-2415-4ef4-a11b-27140fb7b766 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:14.632868 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dbb0ebeb-2415-4ef4-a11b-27140fb7b766 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:14.633905 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dbb0ebeb-2415-4ef4-a11b-27140fb7b766 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:14.676310 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-06f18c98-6b81-4bd4-8d1b-6e710e7a156b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:14.684482 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-06f18c98-6b81-4bd4-8d1b-6e710e7a156b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.167692 May 24 15:42:14.685055 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1340/2688] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:14 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:15.059168 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-03d7d773-ac67-45f3-b155-141058866858 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:15.059794 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-03d7d773-ac67-45f3-b155-141058866858 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: d8d131e6-a9cf-46ca-bd20-8fba3e295618] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:15.069841 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-03d7d773-ac67-45f3-b155-141058866858 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:15.069841 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-03d7d773-ac67-45f3-b155-141058866858 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:15.069841 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-03d7d773-ac67-45f3-b155-141058866858 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:15.069841 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-03d7d773-ac67-45f3-b155-141058866858 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:15.070496 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-dbb0ebeb-2415-4ef4-a11b-27140fb7b766 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:15.082769 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-dbb0ebeb-2415-4ef4-a11b-27140fb7b766 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.467430 May 24 15:42:15.083610 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1349/2689] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:14 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:42:15.222673 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-03d7d773-ac67-45f3-b155-141058866858 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:15.231116 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-03d7d773-ac67-45f3-b155-141058866858 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:15.232685 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-03d7d773-ac67-45f3-b155-141058866858 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:15.233785 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-03d7d773-ac67-45f3-b155-141058866858 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/d8d131e6-a9cf-46ca-bd20-8fba3e295618" status: 200 len: 1406 microversion: 2.20 time: 0.179107 May 24 15:42:15.234349 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1341/2690] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:42:15 2022] GET /compute/v2.1/servers/d8d131e6-a9cf-46ca-bd20-8fba3e295618 => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:42:15.552527 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-37b20736-0936-45fe-a9a9-80a59ac6d3a6 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:15.553144 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-37b20736-0936-45fe-a9a9-80a59ac6d3a6 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] [instance: 916e547e-8501-44fe-8429-5f9086c85992] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:15.560248 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-37b20736-0936-45fe-a9a9-80a59ac6d3a6 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:15.560726 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-37b20736-0936-45fe-a9a9-80a59ac6d3a6 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:15.561485 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-37b20736-0936-45fe-a9a9-80a59ac6d3a6 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:15.561924 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-37b20736-0936-45fe-a9a9-80a59ac6d3a6 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:15.693019 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-37b20736-0936-45fe-a9a9-80a59ac6d3a6 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e754dd9099b54fa4ac8debfbc4a645b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44674730e48240da874cc5fb9662455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:15.700951 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-37b20736-0936-45fe-a9a9-80a59ac6d3a6 tempest-VolumesSnapshotTestJSON-207823241 tempest-VolumesSnapshotTestJSON-207823241-project] 10.222.0.45 "GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992" status: 200 len: 1559 microversion: 2.1 time: 0.152306 May 24 15:42:15.701259 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-8522e27d-414e-40e0-ad54-a98f92105358 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:15.701600 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1350/2691] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:15 2022] GET /compute/v2.1/servers/916e547e-8501-44fe-8429-5f9086c85992 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:15.702506 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-8522e27d-414e-40e0-ad54-a98f92105358 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:15.708632 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8522e27d-414e-40e0-ad54-a98f92105358 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:15.709089 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8522e27d-414e-40e0-ad54-a98f92105358 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:15.709842 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8522e27d-414e-40e0-ad54-a98f92105358 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:15.710270 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8522e27d-414e-40e0-ad54-a98f92105358 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:15.839924 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-8522e27d-414e-40e0-ad54-a98f92105358 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:15.847854 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-8522e27d-414e-40e0-ad54-a98f92105358 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.150440 May 24 15:42:15.848435 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1342/2692] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:15 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:42:16.098844 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-09530ab7-38cf-4aae-b4d7-6076cc279a4f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:16.099390 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-09530ab7-38cf-4aae-b4d7-6076cc279a4f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:16.105952 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-09530ab7-38cf-4aae-b4d7-6076cc279a4f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:16.106398 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-09530ab7-38cf-4aae-b4d7-6076cc279a4f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:16.107144 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-09530ab7-38cf-4aae-b4d7-6076cc279a4f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:16.107575 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-09530ab7-38cf-4aae-b4d7-6076cc279a4f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:16.231159 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-09530ab7-38cf-4aae-b4d7-6076cc279a4f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:16.239371 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-09530ab7-38cf-4aae-b4d7-6076cc279a4f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.144377 May 24 15:42:16.239932 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1351/2693] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:16 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:16.251817 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-57ff5ae9-f038-40f1-9f35-571f68207ac1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:16.252448 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-57ff5ae9-f038-40f1-9f35-571f68207ac1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: d8d131e6-a9cf-46ca-bd20-8fba3e295618] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:16.258929 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-57ff5ae9-f038-40f1-9f35-571f68207ac1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:16.259367 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-57ff5ae9-f038-40f1-9f35-571f68207ac1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:16.260142 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-57ff5ae9-f038-40f1-9f35-571f68207ac1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:16.260673 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-57ff5ae9-f038-40f1-9f35-571f68207ac1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:16.386912 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-57ff5ae9-f038-40f1-9f35-571f68207ac1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:16.394880 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-57ff5ae9-f038-40f1-9f35-571f68207ac1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:16.396404 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-57ff5ae9-f038-40f1-9f35-571f68207ac1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:16.397513 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-57ff5ae9-f038-40f1-9f35-571f68207ac1 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/d8d131e6-a9cf-46ca-bd20-8fba3e295618" status: 200 len: 1406 microversion: 2.20 time: 0.149502 May 24 15:42:16.398076 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1343/2694] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:42:16 2022] GET /compute/v2.1/servers/d8d131e6-a9cf-46ca-bd20-8fba3e295618 => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:42:16.864843 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-37e8b887-e3e2-4ef7-9fe9-9f1f801a2624 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:16.865454 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-37e8b887-e3e2-4ef7-9fe9-9f1f801a2624 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:16.872432 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-37e8b887-e3e2-4ef7-9fe9-9f1f801a2624 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:16.872884 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-37e8b887-e3e2-4ef7-9fe9-9f1f801a2624 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:16.873644 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-37e8b887-e3e2-4ef7-9fe9-9f1f801a2624 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:16.874086 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-37e8b887-e3e2-4ef7-9fe9-9f1f801a2624 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:17.000170 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-37e8b887-e3e2-4ef7-9fe9-9f1f801a2624 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:17.008149 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-37e8b887-e3e2-4ef7-9fe9-9f1f801a2624 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.147117 May 24 15:42:17.008932 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1352/2695] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:16 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:17.257141 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-1ae6770d-c0a7-4bf4-b3f1-1f40d775e87d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:17.257754 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-1ae6770d-c0a7-4bf4-b3f1-1f40d775e87d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:17.264881 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1ae6770d-c0a7-4bf4-b3f1-1f40d775e87d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:17.265331 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1ae6770d-c0a7-4bf4-b3f1-1f40d775e87d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:17.266098 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1ae6770d-c0a7-4bf4-b3f1-1f40d775e87d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:17.266534 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1ae6770d-c0a7-4bf4-b3f1-1f40d775e87d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:17.392601 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-1ae6770d-c0a7-4bf4-b3f1-1f40d775e87d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:17.400357 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-1ae6770d-c0a7-4bf4-b3f1-1f40d775e87d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.147037 May 24 15:42:17.400930 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1344/2696] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:17 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:17.415164 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-3b1ab85c-8ac9-4133-98af-fde53ca3b498 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:17.415883 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-3b1ab85c-8ac9-4133-98af-fde53ca3b498 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: d8d131e6-a9cf-46ca-bd20-8fba3e295618] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:17.422619 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3b1ab85c-8ac9-4133-98af-fde53ca3b498 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:17.423072 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3b1ab85c-8ac9-4133-98af-fde53ca3b498 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:17.423833 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3b1ab85c-8ac9-4133-98af-fde53ca3b498 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:17.424345 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3b1ab85c-8ac9-4133-98af-fde53ca3b498 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:17.552248 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-3b1ab85c-8ac9-4133-98af-fde53ca3b498 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:17.560793 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-3b1ab85c-8ac9-4133-98af-fde53ca3b498 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:17.562289 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-3b1ab85c-8ac9-4133-98af-fde53ca3b498 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:17.563396 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-3b1ab85c-8ac9-4133-98af-fde53ca3b498 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/d8d131e6-a9cf-46ca-bd20-8fba3e295618" status: 200 len: 1406 microversion: 2.20 time: 0.152431 May 24 15:42:17.563962 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1353/2697] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:42:17 2022] GET /compute/v2.1/servers/d8d131e6-a9cf-46ca-bd20-8fba3e295618 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:42:18.024587 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-b435b5c9-7432-42ec-85d6-13c4d454f26c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:18.025197 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-b435b5c9-7432-42ec-85d6-13c4d454f26c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:18.031795 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b435b5c9-7432-42ec-85d6-13c4d454f26c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:18.032235 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b435b5c9-7432-42ec-85d6-13c4d454f26c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:18.033015 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b435b5c9-7432-42ec-85d6-13c4d454f26c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:18.033448 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b435b5c9-7432-42ec-85d6-13c4d454f26c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:18.165721 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-b435b5c9-7432-42ec-85d6-13c4d454f26c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:18.173848 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-b435b5c9-7432-42ec-85d6-13c4d454f26c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.153105 May 24 15:42:18.174633 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1345/2698] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:18 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:18.417217 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-fb48d15d-2fc8-4c86-a184-45f549c75cf1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:18.417780 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-fb48d15d-2fc8-4c86-a184-45f549c75cf1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:18.424412 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fb48d15d-2fc8-4c86-a184-45f549c75cf1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:18.424858 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fb48d15d-2fc8-4c86-a184-45f549c75cf1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:18.425623 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fb48d15d-2fc8-4c86-a184-45f549c75cf1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:18.426062 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fb48d15d-2fc8-4c86-a184-45f549c75cf1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:18.556731 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-fb48d15d-2fc8-4c86-a184-45f549c75cf1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:18.565302 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-fb48d15d-2fc8-4c86-a184-45f549c75cf1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.151926 May 24 15:42:18.565875 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1354/2699] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:18 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:18.580928 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-8e1d39da-dc0a-4036-b6d1-d1dc601be2a5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:18.581541 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-8e1d39da-dc0a-4036-b6d1-d1dc601be2a5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: d8d131e6-a9cf-46ca-bd20-8fba3e295618] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:18.589790 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8e1d39da-dc0a-4036-b6d1-d1dc601be2a5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:18.590229 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8e1d39da-dc0a-4036-b6d1-d1dc601be2a5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:18.591801 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8e1d39da-dc0a-4036-b6d1-d1dc601be2a5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:18.592363 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8e1d39da-dc0a-4036-b6d1-d1dc601be2a5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:18.718750 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-8e1d39da-dc0a-4036-b6d1-d1dc601be2a5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:18.726580 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-8e1d39da-dc0a-4036-b6d1-d1dc601be2a5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:18.728111 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-8e1d39da-dc0a-4036-b6d1-d1dc601be2a5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:18.729278 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-8e1d39da-dc0a-4036-b6d1-d1dc601be2a5 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/d8d131e6-a9cf-46ca-bd20-8fba3e295618" status: 200 len: 1406 microversion: 2.20 time: 0.152176 May 24 15:42:18.729836 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1346/2700] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:42:18 2022] GET /compute/v2.1/servers/d8d131e6-a9cf-46ca-bd20-8fba3e295618 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:42:19.190387 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-ac0728e3-12a5-4651-a74f-f6858e86df0f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:19.190994 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-ac0728e3-12a5-4651-a74f-f6858e86df0f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:19.197061 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ac0728e3-12a5-4651-a74f-f6858e86df0f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:19.197503 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ac0728e3-12a5-4651-a74f-f6858e86df0f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:19.198247 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ac0728e3-12a5-4651-a74f-f6858e86df0f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:19.198678 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ac0728e3-12a5-4651-a74f-f6858e86df0f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:19.322704 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ac0728e3-12a5-4651-a74f-f6858e86df0f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:19.330569 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-ac0728e3-12a5-4651-a74f-f6858e86df0f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.144012 May 24 15:42:19.331121 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1355/2701] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:19 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:19.582383 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-638ddbbf-fdb3-457a-bd54-e8870582b2ba tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:19.583071 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-638ddbbf-fdb3-457a-bd54-e8870582b2ba tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:19.585432 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:42:19.592525 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-638ddbbf-fdb3-457a-bd54-e8870582b2ba tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:19.593206 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-638ddbbf-fdb3-457a-bd54-e8870582b2ba tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:19.593977 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-638ddbbf-fdb3-457a-bd54-e8870582b2ba tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:19.594861 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-638ddbbf-fdb3-457a-bd54-e8870582b2ba tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:19.601440 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [req-734add15-9741-41f8-961e-2233a9ad850c req-ffa553ce-00b8-40ad-b786-cce775b2df95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8d131e6-a9cf-46ca-bd20-8fba3e295618", "name": "network-vif-plugged", "status": "completed", "tag": "ab5bccec-476f-4ab7-97df-9a2b9fc9bf17"}]} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:42:19.610430 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-734add15-9741-41f8-961e-2233a9ad850c req-ffa553ce-00b8-40ad-b786-cce775b2df95 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:19.610862 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-734add15-9741-41f8-961e-2233a9ad850c req-ffa553ce-00b8-40ad-b786-cce775b2df95 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:19.623128 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.compute.server_external_events [req-734add15-9741-41f8-961e-2233a9ad850c req-ffa553ce-00b8-40ad-b786-cce775b2df95 service nova] Creating event network-vif-plugged:ab5bccec-476f-4ab7-97df-9a2b9fc9bf17 for instance d8d131e6-a9cf-46ca-bd20-8fba3e295618 on hv-cinder-84315 May 24 15:42:19.628162 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [req-734add15-9741-41f8-961e-2233a9ad850c req-ffa553ce-00b8-40ad-b786-cce775b2df95 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086320 May 24 15:42:19.628793 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1347/2702] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:42:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:42:19.730255 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-638ddbbf-fdb3-457a-bd54-e8870582b2ba tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:19.739244 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-638ddbbf-fdb3-457a-bd54-e8870582b2ba tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.160482 May 24 15:42:19.739818 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1356/2703] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:19 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:42:19.747722 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-477089a9-a598-494c-99b6-c78bd0e3e302 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:19.748474 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-477089a9-a598-494c-99b6-c78bd0e3e302 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: d8d131e6-a9cf-46ca-bd20-8fba3e295618] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:19.754878 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-477089a9-a598-494c-99b6-c78bd0e3e302 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:19.755318 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-477089a9-a598-494c-99b6-c78bd0e3e302 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:19.756079 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-477089a9-a598-494c-99b6-c78bd0e3e302 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:19.756534 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-477089a9-a598-494c-99b6-c78bd0e3e302 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:19.892935 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-477089a9-a598-494c-99b6-c78bd0e3e302 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:19.900769 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-477089a9-a598-494c-99b6-c78bd0e3e302 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:19.902262 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-477089a9-a598-494c-99b6-c78bd0e3e302 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:19.903934 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-477089a9-a598-494c-99b6-c78bd0e3e302 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/d8d131e6-a9cf-46ca-bd20-8fba3e295618" status: 200 len: 1406 microversion: 2.20 time: 0.160761 May 24 15:42:19.904555 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1348/2704] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:42:19 2022] GET /compute/v2.1/servers/d8d131e6-a9cf-46ca-bd20-8fba3e295618 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:42:20.346862 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-58179816-848f-4921-b739-0dba1a0c56c4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:20.347453 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-58179816-848f-4921-b739-0dba1a0c56c4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:20.353504 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-58179816-848f-4921-b739-0dba1a0c56c4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:20.353945 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-58179816-848f-4921-b739-0dba1a0c56c4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:20.354690 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-58179816-848f-4921-b739-0dba1a0c56c4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:20.355116 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-58179816-848f-4921-b739-0dba1a0c56c4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:20.487313 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-58179816-848f-4921-b739-0dba1a0c56c4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:20.495534 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-58179816-848f-4921-b739-0dba1a0c56c4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.152490 May 24 15:42:20.496094 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1357/2705] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:20 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:20.757962 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-8da6dde0-95d8-480a-8dd8-4a5c28241900 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:20.758621 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-8da6dde0-95d8-480a-8dd8-4a5c28241900 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:20.765445 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8da6dde0-95d8-480a-8dd8-4a5c28241900 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:20.765889 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8da6dde0-95d8-480a-8dd8-4a5c28241900 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:20.766640 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8da6dde0-95d8-480a-8dd8-4a5c28241900 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:20.767076 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8da6dde0-95d8-480a-8dd8-4a5c28241900 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:20.892121 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-8da6dde0-95d8-480a-8dd8-4a5c28241900 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:20.900022 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-8da6dde0-95d8-480a-8dd8-4a5c28241900 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.145955 May 24 15:42:20.900609 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1349/2706] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:20 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:20.921993 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-1e45b7e3-730c-4c62-9a77-7dfd53fce65c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:20.922660 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-1e45b7e3-730c-4c62-9a77-7dfd53fce65c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: d8d131e6-a9cf-46ca-bd20-8fba3e295618] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:20.929021 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1e45b7e3-730c-4c62-9a77-7dfd53fce65c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:20.929467 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1e45b7e3-730c-4c62-9a77-7dfd53fce65c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:20.930211 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1e45b7e3-730c-4c62-9a77-7dfd53fce65c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:20.930641 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1e45b7e3-730c-4c62-9a77-7dfd53fce65c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:21.055881 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-1e45b7e3-730c-4c62-9a77-7dfd53fce65c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:21.063762 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-1e45b7e3-730c-4c62-9a77-7dfd53fce65c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:21.065379 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-1e45b7e3-730c-4c62-9a77-7dfd53fce65c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:21.066468 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-1e45b7e3-730c-4c62-9a77-7dfd53fce65c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/d8d131e6-a9cf-46ca-bd20-8fba3e295618" status: 200 len: 1406 microversion: 2.20 time: 0.148945 May 24 15:42:21.067055 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1358/2707] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:42:20 2022] GET /compute/v2.1/servers/d8d131e6-a9cf-46ca-bd20-8fba3e295618 => generated 1406 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:42:21.513547 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-acbc628f-7de7-42cb-b5fd-fdb484456e9a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:21.514163 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-acbc628f-7de7-42cb-b5fd-fdb484456e9a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:21.520229 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-acbc628f-7de7-42cb-b5fd-fdb484456e9a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:21.520709 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-acbc628f-7de7-42cb-b5fd-fdb484456e9a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:21.521463 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-acbc628f-7de7-42cb-b5fd-fdb484456e9a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:21.521893 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-acbc628f-7de7-42cb-b5fd-fdb484456e9a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:21.652342 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-acbc628f-7de7-42cb-b5fd-fdb484456e9a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:21.660638 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-acbc628f-7de7-42cb-b5fd-fdb484456e9a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.151531 May 24 15:42:21.661248 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1350/2708] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:21 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:21.917353 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-41e8e64d-3dda-4971-b6d5-4cb5e4c5d238 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:21.918468 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-41e8e64d-3dda-4971-b6d5-4cb5e4c5d238 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:21.920325 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell0:SELECT=2 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:42:21.920974 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell0:SELECT=10 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:42:21.927007 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-41e8e64d-3dda-4971-b6d5-4cb5e4c5d238 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:21.927559 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-41e8e64d-3dda-4971-b6d5-4cb5e4c5d238 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:21.928176 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-41e8e64d-3dda-4971-b6d5-4cb5e4c5d238 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:21.928637 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-41e8e64d-3dda-4971-b6d5-4cb5e4c5d238 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:22.054355 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-41e8e64d-3dda-4971-b6d5-4cb5e4c5d238 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:22.062926 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-41e8e64d-3dda-4971-b6d5-4cb5e4c5d238 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.149486 May 24 15:42:22.063493 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1359/2709] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:21 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:22.085369 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-c1349b50-fda6-417d-8a1f-a8a0b53fa8f7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:22.085985 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-c1349b50-fda6-417d-8a1f-a8a0b53fa8f7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: d8d131e6-a9cf-46ca-bd20-8fba3e295618] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:22.088370 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell0:SELECT=2 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:42:22.094665 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c1349b50-fda6-417d-8a1f-a8a0b53fa8f7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:22.095114 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c1349b50-fda6-417d-8a1f-a8a0b53fa8f7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:22.095969 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c1349b50-fda6-417d-8a1f-a8a0b53fa8f7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:22.096437 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c1349b50-fda6-417d-8a1f-a8a0b53fa8f7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:22.222447 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-c1349b50-fda6-417d-8a1f-a8a0b53fa8f7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:22.230434 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-c1349b50-fda6-417d-8a1f-a8a0b53fa8f7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:22.232515 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-c1349b50-fda6-417d-8a1f-a8a0b53fa8f7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:22.233668 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-c1349b50-fda6-417d-8a1f-a8a0b53fa8f7 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/d8d131e6-a9cf-46ca-bd20-8fba3e295618" status: 200 len: 1599 microversion: 2.20 time: 0.152589 May 24 15:42:22.234230 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1351/2710] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:42:22 2022] GET /compute/v2.1/servers/d8d131e6-a9cf-46ca-bd20-8fba3e295618 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:42:22.250828 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e1824f95-c69f-45be-896c-302a40e15c48 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:22.251326 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e1824f95-c69f-45be-896c-302a40e15c48 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: d8d131e6-a9cf-46ca-bd20-8fba3e295618] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:22.257319 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e1824f95-c69f-45be-896c-302a40e15c48 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:22.257767 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e1824f95-c69f-45be-896c-302a40e15c48 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:22.258516 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e1824f95-c69f-45be-896c-302a40e15c48 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:22.258954 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e1824f95-c69f-45be-896c-302a40e15c48 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:22.335992 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e1824f95-c69f-45be-896c-302a40e15c48 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/d8d131e6-a9cf-46ca-bd20-8fba3e295618/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.089087 May 24 15:42:22.336628 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1360/2711] 10.222.0.45 () {60 vars in 1315 bytes} [Tue May 24 15:42:22 2022] GET /compute/v2.1/servers/d8d131e6-a9cf-46ca-bd20-8fba3e295618/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:42:22.677669 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-28f5eae5-a8c5-4985-9651-fd0ac83a454d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:22.678279 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-28f5eae5-a8c5-4985-9651-fd0ac83a454d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:22.684475 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-28f5eae5-a8c5-4985-9651-fd0ac83a454d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:22.684926 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-28f5eae5-a8c5-4985-9651-fd0ac83a454d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:22.685684 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-28f5eae5-a8c5-4985-9651-fd0ac83a454d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:22.686117 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-28f5eae5-a8c5-4985-9651-fd0ac83a454d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:22.817096 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-28f5eae5-a8c5-4985-9651-fd0ac83a454d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:22.827053 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-28f5eae5-a8c5-4985-9651-fd0ac83a454d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.153216 May 24 15:42:22.827645 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1352/2712] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:22 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:23.079935 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-9f8fed08-d2d3-441c-9df8-ee63c563a2f7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:23.080687 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-9f8fed08-d2d3-441c-9df8-ee63c563a2f7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:23.086855 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9f8fed08-d2d3-441c-9df8-ee63c563a2f7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:23.087391 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9f8fed08-d2d3-441c-9df8-ee63c563a2f7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:23.088153 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9f8fed08-d2d3-441c-9df8-ee63c563a2f7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:23.088740 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9f8fed08-d2d3-441c-9df8-ee63c563a2f7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:23.309578 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-9f8fed08-d2d3-441c-9df8-ee63c563a2f7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:23.317615 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-9f8fed08-d2d3-441c-9df8-ee63c563a2f7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.242038 May 24 15:42:23.318180 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1361/2713] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:23 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:23.458891 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [req-edabf1fd-e36f-423c-a99b-63c425e1a396 req-c63b723f-3406-487a-8136-686cc7763476 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8d131e6-a9cf-46ca-bd20-8fba3e295618", "tag": "ab5bccec-476f-4ab7-97df-9a2b9fc9bf17"}]} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:42:23.467530 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-edabf1fd-e36f-423c-a99b-63c425e1a396 req-c63b723f-3406-487a-8136-686cc7763476 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:23.467970 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-edabf1fd-e36f-423c-a99b-63c425e1a396 req-c63b723f-3406-487a-8136-686cc7763476 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:23.478961 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.compute.server_external_events [req-edabf1fd-e36f-423c-a99b-63c425e1a396 req-c63b723f-3406-487a-8136-686cc7763476 service nova] Creating event network-changed:ab5bccec-476f-4ab7-97df-9a2b9fc9bf17 for instance d8d131e6-a9cf-46ca-bd20-8fba3e295618 on hv-cinder-84315 May 24 15:42:23.484435 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [req-edabf1fd-e36f-423c-a99b-63c425e1a396 req-c63b723f-3406-487a-8136-686cc7763476 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029155 May 24 15:42:23.485018 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1353/2714] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:42:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:42:23.843446 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-cbac7e92-46f9-47b6-9406-5b6ea2c0320a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:23.844060 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-cbac7e92-46f9-47b6-9406-5b6ea2c0320a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:23.850312 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cbac7e92-46f9-47b6-9406-5b6ea2c0320a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:23.850763 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cbac7e92-46f9-47b6-9406-5b6ea2c0320a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:23.851527 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cbac7e92-46f9-47b6-9406-5b6ea2c0320a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:23.851962 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cbac7e92-46f9-47b6-9406-5b6ea2c0320a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:24.061335 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-cbac7e92-46f9-47b6-9406-5b6ea2c0320a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:24.073765 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-cbac7e92-46f9-47b6-9406-5b6ea2c0320a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.234562 May 24 15:42:24.075096 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1362/2715] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:23 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:24.335411 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-df7126f9-3413-4cf9-a254-7b39854ef982 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:24.336105 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-df7126f9-3413-4cf9-a254-7b39854ef982 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:24.342999 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-df7126f9-3413-4cf9-a254-7b39854ef982 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:24.343440 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-df7126f9-3413-4cf9-a254-7b39854ef982 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:24.344196 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-df7126f9-3413-4cf9-a254-7b39854ef982 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:24.344664 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-df7126f9-3413-4cf9-a254-7b39854ef982 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:24.485582 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-df7126f9-3413-4cf9-a254-7b39854ef982 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:24.494169 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-df7126f9-3413-4cf9-a254-7b39854ef982 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.162952 May 24 15:42:24.494918 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1354/2716] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:24 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:25.091060 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-b1006cac-8bd0-4e78-b4bf-23ed4ee553bd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:25.091664 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-b1006cac-8bd0-4e78-b4bf-23ed4ee553bd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:25.098352 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b1006cac-8bd0-4e78-b4bf-23ed4ee553bd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:25.098796 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b1006cac-8bd0-4e78-b4bf-23ed4ee553bd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:25.099540 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b1006cac-8bd0-4e78-b4bf-23ed4ee553bd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:25.099968 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b1006cac-8bd0-4e78-b4bf-23ed4ee553bd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:25.229217 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-b1006cac-8bd0-4e78-b4bf-23ed4ee553bd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:25.237767 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-b1006cac-8bd0-4e78-b4bf-23ed4ee553bd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.150627 May 24 15:42:25.238533 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1363/2717] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:25 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:25.511559 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-09fb9b0a-c21f-4a29-9591-2acc69372463 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:25.512200 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-09fb9b0a-c21f-4a29-9591-2acc69372463 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:25.520166 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-09fb9b0a-c21f-4a29-9591-2acc69372463 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:25.520645 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-09fb9b0a-c21f-4a29-9591-2acc69372463 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:25.521405 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-09fb9b0a-c21f-4a29-9591-2acc69372463 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:25.521837 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-09fb9b0a-c21f-4a29-9591-2acc69372463 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:25.650555 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-09fb9b0a-c21f-4a29-9591-2acc69372463 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:25.660707 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-09fb9b0a-c21f-4a29-9591-2acc69372463 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.152985 May 24 15:42:25.661280 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1355/2718] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:25 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:26.254995 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d1891581-1583-4873-8770-77b9165238df tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:26.255594 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d1891581-1583-4873-8770-77b9165238df tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:26.262752 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d1891581-1583-4873-8770-77b9165238df tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:26.263188 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d1891581-1583-4873-8770-77b9165238df tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:26.263934 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d1891581-1583-4873-8770-77b9165238df tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:26.264387 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d1891581-1583-4873-8770-77b9165238df tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:26.390313 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-d1891581-1583-4873-8770-77b9165238df tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:26.398219 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d1891581-1583-4873-8770-77b9165238df tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.147040 May 24 15:42:26.398806 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1364/2719] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:26 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:26.679115 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-1f6c287d-96ca-4c74-9d3b-55c5f94f5dc5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:26.679650 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-1f6c287d-96ca-4c74-9d3b-55c5f94f5dc5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:26.682165 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_api:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:42:26.688388 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1f6c287d-96ca-4c74-9d3b-55c5f94f5dc5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:26.688836 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1f6c287d-96ca-4c74-9d3b-55c5f94f5dc5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:26.689609 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1f6c287d-96ca-4c74-9d3b-55c5f94f5dc5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:26.690049 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1f6c287d-96ca-4c74-9d3b-55c5f94f5dc5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:26.833494 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-1f6c287d-96ca-4c74-9d3b-55c5f94f5dc5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:26.842550 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-1f6c287d-96ca-4c74-9d3b-55c5f94f5dc5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.168738 May 24 15:42:26.843146 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1356/2720] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:26 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:27.414933 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-a7aab076-bfb5-45ff-b364-c3ff7b4f5ace tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:27.415643 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-a7aab076-bfb5-45ff-b364-c3ff7b4f5ace tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:27.421919 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a7aab076-bfb5-45ff-b364-c3ff7b4f5ace tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:27.422369 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a7aab076-bfb5-45ff-b364-c3ff7b4f5ace tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:27.423131 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a7aab076-bfb5-45ff-b364-c3ff7b4f5ace tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:27.423562 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a7aab076-bfb5-45ff-b364-c3ff7b4f5ace tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:27.446355 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:42:27.562405 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-a7aab076-bfb5-45ff-b364-c3ff7b4f5ace tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:27.570305 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-a7aab076-bfb5-45ff-b364-c3ff7b4f5ace tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.159276 May 24 15:42:27.570868 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1365/2721] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:27 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:27.860607 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-1af2ed9e-1ad7-4683-8484-4a2f4958938b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:27.861225 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-1af2ed9e-1ad7-4683-8484-4a2f4958938b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:27.867975 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1af2ed9e-1ad7-4683-8484-4a2f4958938b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:27.868614 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1af2ed9e-1ad7-4683-8484-4a2f4958938b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:27.869384 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1af2ed9e-1ad7-4683-8484-4a2f4958938b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:27.869824 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1af2ed9e-1ad7-4683-8484-4a2f4958938b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:27.888683 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:42:27.996936 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-1af2ed9e-1ad7-4683-8484-4a2f4958938b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:28.004871 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-1af2ed9e-1ad7-4683-8484-4a2f4958938b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.149120 May 24 15:42:28.005440 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1357/2722] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:27 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:28.587590 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-732a645d-be6b-45e8-a629-abdb96d77f18 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:28.588196 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-732a645d-be6b-45e8-a629-abdb96d77f18 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:28.595204 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-732a645d-be6b-45e8-a629-abdb96d77f18 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:28.595651 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-732a645d-be6b-45e8-a629-abdb96d77f18 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:28.596433 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-732a645d-be6b-45e8-a629-abdb96d77f18 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:28.596888 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-732a645d-be6b-45e8-a629-abdb96d77f18 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:28.720383 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-732a645d-be6b-45e8-a629-abdb96d77f18 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:28.728180 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-732a645d-be6b-45e8-a629-abdb96d77f18 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.144437 May 24 15:42:28.728785 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1366/2723] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:28 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:29.021712 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-fc418306-6734-42c6-b5a3-1f3949630d33 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:29.022327 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-fc418306-6734-42c6-b5a3-1f3949630d33 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:29.028903 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fc418306-6734-42c6-b5a3-1f3949630d33 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:29.029347 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fc418306-6734-42c6-b5a3-1f3949630d33 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:29.030104 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fc418306-6734-42c6-b5a3-1f3949630d33 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:29.030537 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fc418306-6734-42c6-b5a3-1f3949630d33 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:29.154408 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-fc418306-6734-42c6-b5a3-1f3949630d33 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:29.162306 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-fc418306-6734-42c6-b5a3-1f3949630d33 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.144490 May 24 15:42:29.162883 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1358/2724] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:29 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:29.744733 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-168b04fd-fa4f-4955-8d51-b78f4740ada3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:29.745345 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-168b04fd-fa4f-4955-8d51-b78f4740ada3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:29.751828 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-168b04fd-fa4f-4955-8d51-b78f4740ada3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:29.752276 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-168b04fd-fa4f-4955-8d51-b78f4740ada3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:29.753053 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-168b04fd-fa4f-4955-8d51-b78f4740ada3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:29.753483 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-168b04fd-fa4f-4955-8d51-b78f4740ada3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:29.880062 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-168b04fd-fa4f-4955-8d51-b78f4740ada3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:29.887982 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-168b04fd-fa4f-4955-8d51-b78f4740ada3 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.147413 May 24 15:42:29.888584 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1367/2725] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:29 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:30.179804 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-868d4684-da3e-4055-a563-5bced32fa39d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:30.180437 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-868d4684-da3e-4055-a563-5bced32fa39d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:30.186966 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-868d4684-da3e-4055-a563-5bced32fa39d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:30.187407 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-868d4684-da3e-4055-a563-5bced32fa39d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:30.188157 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-868d4684-da3e-4055-a563-5bced32fa39d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:30.188615 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-868d4684-da3e-4055-a563-5bced32fa39d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:30.316197 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-868d4684-da3e-4055-a563-5bced32fa39d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:30.324729 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-868d4684-da3e-4055-a563-5bced32fa39d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.148259 May 24 15:42:30.325271 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1359/2726] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:30 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:30.905308 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-995c62bb-ca86-4c32-bb86-1078664f357c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:30.905918 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-995c62bb-ca86-4c32-bb86-1078664f357c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:30.912404 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-995c62bb-ca86-4c32-bb86-1078664f357c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:30.912851 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-995c62bb-ca86-4c32-bb86-1078664f357c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:30.913652 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-995c62bb-ca86-4c32-bb86-1078664f357c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:30.914085 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-995c62bb-ca86-4c32-bb86-1078664f357c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:31.038980 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-995c62bb-ca86-4c32-bb86-1078664f357c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:31.047479 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-995c62bb-ca86-4c32-bb86-1078664f357c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.146065 May 24 15:42:31.048041 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1368/2727] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:30 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:31.341858 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-b68ab33e-8d15-4021-ba53-bc310e3b1807 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:31.342498 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-b68ab33e-8d15-4021-ba53-bc310e3b1807 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:31.349079 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b68ab33e-8d15-4021-ba53-bc310e3b1807 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:31.349522 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b68ab33e-8d15-4021-ba53-bc310e3b1807 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:31.350276 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b68ab33e-8d15-4021-ba53-bc310e3b1807 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:31.350950 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b68ab33e-8d15-4021-ba53-bc310e3b1807 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:31.475373 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-b68ab33e-8d15-4021-ba53-bc310e3b1807 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:31.483937 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-b68ab33e-8d15-4021-ba53-bc310e3b1807 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.146487 May 24 15:42:31.484539 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1360/2728] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:31 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:32.064105 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-7ddd609f-184f-43a6-b065-cc06f6b04c0f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:32.064747 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-7ddd609f-184f-43a6-b065-cc06f6b04c0f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:32.071511 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7ddd609f-184f-43a6-b065-cc06f6b04c0f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:32.071958 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7ddd609f-184f-43a6-b065-cc06f6b04c0f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:32.072742 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7ddd609f-184f-43a6-b065-cc06f6b04c0f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:32.073175 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7ddd609f-184f-43a6-b065-cc06f6b04c0f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:32.197827 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-7ddd609f-184f-43a6-b065-cc06f6b04c0f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:32.206352 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-7ddd609f-184f-43a6-b065-cc06f6b04c0f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.146079 May 24 15:42:32.206931 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1369/2729] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:32 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:32.500838 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-49971cf2-cec4-4592-af67-2b601d319158 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:32.501422 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-49971cf2-cec4-4592-af67-2b601d319158 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:32.507947 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-49971cf2-cec4-4592-af67-2b601d319158 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:32.508423 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-49971cf2-cec4-4592-af67-2b601d319158 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:32.509170 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-49971cf2-cec4-4592-af67-2b601d319158 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:32.509598 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-49971cf2-cec4-4592-af67-2b601d319158 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:32.643140 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-49971cf2-cec4-4592-af67-2b601d319158 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:32.651061 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-49971cf2-cec4-4592-af67-2b601d319158 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.154772 May 24 15:42:32.651621 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1361/2730] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:32 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:33.222488 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-05226967-7ced-48c4-8b2f-c1a30acc635d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:33.223101 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-05226967-7ced-48c4-8b2f-c1a30acc635d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:33.229684 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-05226967-7ced-48c4-8b2f-c1a30acc635d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:33.230136 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-05226967-7ced-48c4-8b2f-c1a30acc635d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:33.230892 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-05226967-7ced-48c4-8b2f-c1a30acc635d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:33.231331 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-05226967-7ced-48c4-8b2f-c1a30acc635d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:33.360245 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-05226967-7ced-48c4-8b2f-c1a30acc635d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:33.368414 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-05226967-7ced-48c4-8b2f-c1a30acc635d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.149858 May 24 15:42:33.368971 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1370/2731] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:33 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:33.667893 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-6a824d79-7a2b-44f1-8e02-8263a9ee8af0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:33.668568 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-6a824d79-7a2b-44f1-8e02-8263a9ee8af0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:33.675033 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6a824d79-7a2b-44f1-8e02-8263a9ee8af0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:33.675482 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6a824d79-7a2b-44f1-8e02-8263a9ee8af0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:33.676236 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6a824d79-7a2b-44f1-8e02-8263a9ee8af0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:33.676695 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6a824d79-7a2b-44f1-8e02-8263a9ee8af0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:33.802827 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-6a824d79-7a2b-44f1-8e02-8263a9ee8af0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:33.811251 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-6a824d79-7a2b-44f1-8e02-8263a9ee8af0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.147298 May 24 15:42:33.811813 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1362/2732] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:33 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:34.385367 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e38f2618-ad43-422f-ac74-3e9ab54652b9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:34.385892 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e38f2618-ad43-422f-ac74-3e9ab54652b9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:34.392370 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e38f2618-ad43-422f-ac74-3e9ab54652b9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:34.392818 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e38f2618-ad43-422f-ac74-3e9ab54652b9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:34.393563 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e38f2618-ad43-422f-ac74-3e9ab54652b9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:34.393996 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e38f2618-ad43-422f-ac74-3e9ab54652b9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:34.525982 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e38f2618-ad43-422f-ac74-3e9ab54652b9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:34.534286 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e38f2618-ad43-422f-ac74-3e9ab54652b9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.152831 May 24 15:42:34.534844 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1371/2733] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:34 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:34.828398 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-4a591ec3-d0b9-4dd0-8902-8bfa5b3f9bec tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:34.829009 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-4a591ec3-d0b9-4dd0-8902-8bfa5b3f9bec tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:34.835386 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4a591ec3-d0b9-4dd0-8902-8bfa5b3f9bec tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:34.835821 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4a591ec3-d0b9-4dd0-8902-8bfa5b3f9bec tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:34.836596 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4a591ec3-d0b9-4dd0-8902-8bfa5b3f9bec tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:34.837025 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4a591ec3-d0b9-4dd0-8902-8bfa5b3f9bec tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:34.965896 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-4a591ec3-d0b9-4dd0-8902-8bfa5b3f9bec tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:34.973740 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-4a591ec3-d0b9-4dd0-8902-8bfa5b3f9bec tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.149738 May 24 15:42:34.974304 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1363/2734] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:34 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:35.551456 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e2866707-595f-4736-bcc2-5233a81b735e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:35.552059 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e2866707-595f-4736-bcc2-5233a81b735e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:35.559185 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e2866707-595f-4736-bcc2-5233a81b735e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:35.559630 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e2866707-595f-4736-bcc2-5233a81b735e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:35.560401 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e2866707-595f-4736-bcc2-5233a81b735e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:35.560831 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e2866707-595f-4736-bcc2-5233a81b735e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:35.688714 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e2866707-595f-4736-bcc2-5233a81b735e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:35.696529 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e2866707-595f-4736-bcc2-5233a81b735e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.148902 May 24 15:42:35.697086 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1372/2735] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:35 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:35.989782 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-6a580bec-aa90-4813-83eb-0988ca4693eb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:35.990394 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-6a580bec-aa90-4813-83eb-0988ca4693eb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:35.997317 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6a580bec-aa90-4813-83eb-0988ca4693eb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:35.997764 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6a580bec-aa90-4813-83eb-0988ca4693eb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:35.998521 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6a580bec-aa90-4813-83eb-0988ca4693eb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:35.998962 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6a580bec-aa90-4813-83eb-0988ca4693eb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:36.127199 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-6a580bec-aa90-4813-83eb-0988ca4693eb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:36.135301 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-6a580bec-aa90-4813-83eb-0988ca4693eb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.149326 May 24 15:42:36.135874 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1364/2736] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:35 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:36.713215 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-50a5c9b1-954e-46ff-9e50-d4c787ccf8c1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:36.713829 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-50a5c9b1-954e-46ff-9e50-d4c787ccf8c1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:36.720320 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-50a5c9b1-954e-46ff-9e50-d4c787ccf8c1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:36.720778 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-50a5c9b1-954e-46ff-9e50-d4c787ccf8c1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:36.721545 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-50a5c9b1-954e-46ff-9e50-d4c787ccf8c1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:36.721980 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-50a5c9b1-954e-46ff-9e50-d4c787ccf8c1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:36.846248 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-50a5c9b1-954e-46ff-9e50-d4c787ccf8c1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:36.854145 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-50a5c9b1-954e-46ff-9e50-d4c787ccf8c1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.144833 May 24 15:42:36.854712 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1373/2737] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:36 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:37.152624 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e4e8b292-30eb-4fb8-abf9-d96b4386b3b5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:37.153229 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-e4e8b292-30eb-4fb8-abf9-d96b4386b3b5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:37.159748 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e4e8b292-30eb-4fb8-abf9-d96b4386b3b5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:37.160187 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e4e8b292-30eb-4fb8-abf9-d96b4386b3b5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:37.160964 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e4e8b292-30eb-4fb8-abf9-d96b4386b3b5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:37.161399 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e4e8b292-30eb-4fb8-abf9-d96b4386b3b5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:37.285882 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-e4e8b292-30eb-4fb8-abf9-d96b4386b3b5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:37.294378 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-e4e8b292-30eb-4fb8-abf9-d96b4386b3b5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.145706 May 24 15:42:37.294937 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1365/2738] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:37 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:37.872167 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-93033983-3ba9-4516-8888-a329966a1908 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:37.872804 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-93033983-3ba9-4516-8888-a329966a1908 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:37.879215 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-93033983-3ba9-4516-8888-a329966a1908 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:37.879653 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-93033983-3ba9-4516-8888-a329966a1908 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:37.880427 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-93033983-3ba9-4516-8888-a329966a1908 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:37.880858 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-93033983-3ba9-4516-8888-a329966a1908 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:38.005080 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-93033983-3ba9-4516-8888-a329966a1908 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:38.012939 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-93033983-3ba9-4516-8888-a329966a1908 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.145186 May 24 15:42:38.013518 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1374/2739] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:37 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:38.310665 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-ebca394b-ef14-43f1-9bcc-c342fa07eb0d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:38.311280 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-ebca394b-ef14-43f1-9bcc-c342fa07eb0d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:38.317800 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ebca394b-ef14-43f1-9bcc-c342fa07eb0d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:38.318244 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ebca394b-ef14-43f1-9bcc-c342fa07eb0d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:38.318999 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ebca394b-ef14-43f1-9bcc-c342fa07eb0d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:38.319429 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ebca394b-ef14-43f1-9bcc-c342fa07eb0d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:38.447628 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-ebca394b-ef14-43f1-9bcc-c342fa07eb0d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:38.456224 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-ebca394b-ef14-43f1-9bcc-c342fa07eb0d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.149492 May 24 15:42:38.456818 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1366/2740] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:38 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:39.029719 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-f80cfecb-72cf-4f45-8eac-eeb828010115 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:39.030364 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-f80cfecb-72cf-4f45-8eac-eeb828010115 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:39.036892 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f80cfecb-72cf-4f45-8eac-eeb828010115 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:39.037343 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f80cfecb-72cf-4f45-8eac-eeb828010115 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:39.038095 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f80cfecb-72cf-4f45-8eac-eeb828010115 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:39.038530 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f80cfecb-72cf-4f45-8eac-eeb828010115 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:39.168148 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-f80cfecb-72cf-4f45-8eac-eeb828010115 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:39.176049 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-f80cfecb-72cf-4f45-8eac-eeb828010115 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.150236 May 24 15:42:39.176646 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1375/2741] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:39 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:39.473617 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-cf97dfe7-7e79-4ce0-b22a-5168a5d87015 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:39.474222 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-cf97dfe7-7e79-4ce0-b22a-5168a5d87015 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:39.481210 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cf97dfe7-7e79-4ce0-b22a-5168a5d87015 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:39.481649 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cf97dfe7-7e79-4ce0-b22a-5168a5d87015 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:39.482391 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cf97dfe7-7e79-4ce0-b22a-5168a5d87015 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:39.482818 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cf97dfe7-7e79-4ce0-b22a-5168a5d87015 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:39.607238 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-cf97dfe7-7e79-4ce0-b22a-5168a5d87015 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:39.615124 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-cf97dfe7-7e79-4ce0-b22a-5168a5d87015 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.145339 May 24 15:42:39.615697 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1367/2742] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:39 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:42:40.193614 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-3215b60f-46fd-4e0f-986c-2f339ea0afe6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:40.194237 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-3215b60f-46fd-4e0f-986c-2f339ea0afe6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:40.201208 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3215b60f-46fd-4e0f-986c-2f339ea0afe6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:40.201662 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3215b60f-46fd-4e0f-986c-2f339ea0afe6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:40.202426 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3215b60f-46fd-4e0f-986c-2f339ea0afe6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:40.202862 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3215b60f-46fd-4e0f-986c-2f339ea0afe6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:40.327016 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-3215b60f-46fd-4e0f-986c-2f339ea0afe6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:40.334961 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-3215b60f-46fd-4e0f-986c-2f339ea0afe6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.145254 May 24 15:42:40.335535 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1376/2743] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:40 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:40.632194 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-89d84ba1-29ed-493c-85cc-0314aefbbed9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:40.632889 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-89d84ba1-29ed-493c-85cc-0314aefbbed9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:40.639342 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-89d84ba1-29ed-493c-85cc-0314aefbbed9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:40.639791 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-89d84ba1-29ed-493c-85cc-0314aefbbed9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:40.640581 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-89d84ba1-29ed-493c-85cc-0314aefbbed9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:40.641017 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-89d84ba1-29ed-493c-85cc-0314aefbbed9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:40.979788 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-89d84ba1-29ed-493c-85cc-0314aefbbed9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:40.988308 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-89d84ba1-29ed-493c-85cc-0314aefbbed9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.360063 May 24 15:42:40.988898 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1368/2744] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:40 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:41.351616 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-24780b06-5bce-4fb7-9f26-e1f4aa3529a5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:41.352268 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-24780b06-5bce-4fb7-9f26-e1f4aa3529a5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:41.359475 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-24780b06-5bce-4fb7-9f26-e1f4aa3529a5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:41.359936 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-24780b06-5bce-4fb7-9f26-e1f4aa3529a5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:41.360727 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-24780b06-5bce-4fb7-9f26-e1f4aa3529a5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:41.361165 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-24780b06-5bce-4fb7-9f26-e1f4aa3529a5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:41.488879 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-24780b06-5bce-4fb7-9f26-e1f4aa3529a5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:41.497041 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-24780b06-5bce-4fb7-9f26-e1f4aa3529a5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.149319 May 24 15:42:41.497604 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1377/2745] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:41 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:42.005262 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-c72290b1-f5db-4e06-8ef7-ba958049cb1e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:42.005872 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-c72290b1-f5db-4e06-8ef7-ba958049cb1e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:42.013145 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c72290b1-f5db-4e06-8ef7-ba958049cb1e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:42.013592 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c72290b1-f5db-4e06-8ef7-ba958049cb1e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:42.014350 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c72290b1-f5db-4e06-8ef7-ba958049cb1e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:42.014788 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c72290b1-f5db-4e06-8ef7-ba958049cb1e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:42.145140 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-c72290b1-f5db-4e06-8ef7-ba958049cb1e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:42.153553 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-c72290b1-f5db-4e06-8ef7-ba958049cb1e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.152054 May 24 15:42:42.154140 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1369/2746] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:42 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:42.513855 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d425f672-cec2-4bab-a8f8-bf558689df4b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:42.514444 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d425f672-cec2-4bab-a8f8-bf558689df4b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:42.521389 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d425f672-cec2-4bab-a8f8-bf558689df4b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:42.521825 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d425f672-cec2-4bab-a8f8-bf558689df4b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:42.522577 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d425f672-cec2-4bab-a8f8-bf558689df4b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:42.523004 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d425f672-cec2-4bab-a8f8-bf558689df4b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:42.649588 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-d425f672-cec2-4bab-a8f8-bf558689df4b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:42.657986 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d425f672-cec2-4bab-a8f8-bf558689df4b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.147966 May 24 15:42:42.658542 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1378/2747] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:42 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:43.171312 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-52790183-3a37-4e66-8bd4-ee628e674a7f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:43.171918 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-52790183-3a37-4e66-8bd4-ee628e674a7f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:43.178473 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-52790183-3a37-4e66-8bd4-ee628e674a7f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:43.178912 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-52790183-3a37-4e66-8bd4-ee628e674a7f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:43.179657 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-52790183-3a37-4e66-8bd4-ee628e674a7f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:43.180084 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-52790183-3a37-4e66-8bd4-ee628e674a7f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:43.310418 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-52790183-3a37-4e66-8bd4-ee628e674a7f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:43.318299 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-52790183-3a37-4e66-8bd4-ee628e674a7f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.150878 May 24 15:42:43.318870 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1370/2748] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:43 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:43.674854 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-65500ee2-3172-40b5-b83c-6014086da466 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:43.675398 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-65500ee2-3172-40b5-b83c-6014086da466 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:43.681851 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-65500ee2-3172-40b5-b83c-6014086da466 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:43.682298 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-65500ee2-3172-40b5-b83c-6014086da466 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:43.683174 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-65500ee2-3172-40b5-b83c-6014086da466 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:43.684243 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-65500ee2-3172-40b5-b83c-6014086da466 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:43.816671 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-65500ee2-3172-40b5-b83c-6014086da466 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:43.824882 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-65500ee2-3172-40b5-b83c-6014086da466 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.153985 May 24 15:42:43.825437 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1379/2749] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:43 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:44.335684 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-db1f1231-2431-4ab4-96af-9348d52f3992 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:44.336230 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-db1f1231-2431-4ab4-96af-9348d52f3992 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:44.343260 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-db1f1231-2431-4ab4-96af-9348d52f3992 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:44.343708 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-db1f1231-2431-4ab4-96af-9348d52f3992 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:44.344495 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-db1f1231-2431-4ab4-96af-9348d52f3992 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:44.344931 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-db1f1231-2431-4ab4-96af-9348d52f3992 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:44.472426 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-db1f1231-2431-4ab4-96af-9348d52f3992 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:44.480381 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-db1f1231-2431-4ab4-96af-9348d52f3992 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.148623 May 24 15:42:44.480949 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1371/2750] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:44 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:44.841622 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-45396f1d-daec-4da0-ba08-61e329972514 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:44.842263 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-45396f1d-daec-4da0-ba08-61e329972514 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:44.848696 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-45396f1d-daec-4da0-ba08-61e329972514 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:44.849137 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-45396f1d-daec-4da0-ba08-61e329972514 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:44.849878 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-45396f1d-daec-4da0-ba08-61e329972514 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:44.850304 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-45396f1d-daec-4da0-ba08-61e329972514 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:44.974351 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-45396f1d-daec-4da0-ba08-61e329972514 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:44.982208 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-45396f1d-daec-4da0-ba08-61e329972514 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.144437 May 24 15:42:44.982764 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1380/2751] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:44 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:45.497471 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-2fe1f3f6-54a7-41f6-b42c-d68085c0e5ad tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:45.498064 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-2fe1f3f6-54a7-41f6-b42c-d68085c0e5ad tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:45.504678 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2fe1f3f6-54a7-41f6-b42c-d68085c0e5ad tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:45.505131 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2fe1f3f6-54a7-41f6-b42c-d68085c0e5ad tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:45.505896 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2fe1f3f6-54a7-41f6-b42c-d68085c0e5ad tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:45.506336 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2fe1f3f6-54a7-41f6-b42c-d68085c0e5ad tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:45.638635 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-2fe1f3f6-54a7-41f6-b42c-d68085c0e5ad tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:45.646861 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-2fe1f3f6-54a7-41f6-b42c-d68085c0e5ad tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.153262 May 24 15:42:45.647440 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1372/2752] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:45 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:45.999217 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-3d39d96a-d353-41b9-a92a-f7dd64c43061 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:45.999836 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-3d39d96a-d353-41b9-a92a-f7dd64c43061 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:46.006387 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3d39d96a-d353-41b9-a92a-f7dd64c43061 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:46.006839 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3d39d96a-d353-41b9-a92a-f7dd64c43061 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:46.007600 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3d39d96a-d353-41b9-a92a-f7dd64c43061 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:46.008038 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3d39d96a-d353-41b9-a92a-f7dd64c43061 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:46.134550 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-3d39d96a-d353-41b9-a92a-f7dd64c43061 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:46.142925 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-3d39d96a-d353-41b9-a92a-f7dd64c43061 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.147601 May 24 15:42:46.143489 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1381/2753] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:45 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:46.664212 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-ac27ebe3-8b38-4ede-8200-b4a7948b5899 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:46.664844 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-ac27ebe3-8b38-4ede-8200-b4a7948b5899 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:46.671814 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ac27ebe3-8b38-4ede-8200-b4a7948b5899 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:46.672249 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ac27ebe3-8b38-4ede-8200-b4a7948b5899 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:46.673021 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ac27ebe3-8b38-4ede-8200-b4a7948b5899 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:46.673447 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ac27ebe3-8b38-4ede-8200-b4a7948b5899 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:46.800993 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-ac27ebe3-8b38-4ede-8200-b4a7948b5899 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:46.809467 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-ac27ebe3-8b38-4ede-8200-b4a7948b5899 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.149126 May 24 15:42:46.810034 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1373/2754] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:46 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:47.160530 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-1e3ef00d-7b7d-45ad-8280-a6b4e6dc1d37 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:47.161145 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-1e3ef00d-7b7d-45ad-8280-a6b4e6dc1d37 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:47.168244 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1e3ef00d-7b7d-45ad-8280-a6b4e6dc1d37 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:47.168765 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1e3ef00d-7b7d-45ad-8280-a6b4e6dc1d37 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:47.169527 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1e3ef00d-7b7d-45ad-8280-a6b4e6dc1d37 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:47.169961 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1e3ef00d-7b7d-45ad-8280-a6b4e6dc1d37 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:47.173868 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:42:47.298006 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-1e3ef00d-7b7d-45ad-8280-a6b4e6dc1d37 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:47.305956 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-1e3ef00d-7b7d-45ad-8280-a6b4e6dc1d37 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.149371 May 24 15:42:47.306525 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1382/2755] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:47 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:47.827212 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-6fab026f-03f0-43cf-8e88-aa8ff2c4a90d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:47.827819 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-6fab026f-03f0-43cf-8e88-aa8ff2c4a90d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:47.834399 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6fab026f-03f0-43cf-8e88-aa8ff2c4a90d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:47.834846 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6fab026f-03f0-43cf-8e88-aa8ff2c4a90d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:47.835596 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6fab026f-03f0-43cf-8e88-aa8ff2c4a90d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:47.836027 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6fab026f-03f0-43cf-8e88-aa8ff2c4a90d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:47.839910 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:42:47.962153 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-6fab026f-03f0-43cf-8e88-aa8ff2c4a90d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:47.970067 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-6fab026f-03f0-43cf-8e88-aa8ff2c4a90d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.147279 May 24 15:42:47.970632 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1374/2756] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:47 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:48.322954 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-28f81ce3-9d84-476b-ad85-28938568f59c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:48.323622 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-28f81ce3-9d84-476b-ad85-28938568f59c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:48.330147 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-28f81ce3-9d84-476b-ad85-28938568f59c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:48.330589 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-28f81ce3-9d84-476b-ad85-28938568f59c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:48.331331 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-28f81ce3-9d84-476b-ad85-28938568f59c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:48.331759 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-28f81ce3-9d84-476b-ad85-28938568f59c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:48.458297 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-28f81ce3-9d84-476b-ad85-28938568f59c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:48.466696 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-28f81ce3-9d84-476b-ad85-28938568f59c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.147589 May 24 15:42:48.467256 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1383/2757] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:48 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:48.985849 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-8daa8b4e-a1ab-46f3-8630-5803d5d3d5cb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:48.986446 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-8daa8b4e-a1ab-46f3-8630-5803d5d3d5cb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:48.993266 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8daa8b4e-a1ab-46f3-8630-5803d5d3d5cb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:48.993719 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8daa8b4e-a1ab-46f3-8630-5803d5d3d5cb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:48.994480 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8daa8b4e-a1ab-46f3-8630-5803d5d3d5cb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:48.994947 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8daa8b4e-a1ab-46f3-8630-5803d5d3d5cb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:49.125642 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-8daa8b4e-a1ab-46f3-8630-5803d5d3d5cb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:49.133574 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-8daa8b4e-a1ab-46f3-8630-5803d5d3d5cb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.151574 May 24 15:42:49.134138 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1375/2758] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:48 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:49.483496 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-bdd54a1f-26b3-4b8d-9844-9f0fcbdaa6b9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:49.484104 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-bdd54a1f-26b3-4b8d-9844-9f0fcbdaa6b9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:49.490577 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bdd54a1f-26b3-4b8d-9844-9f0fcbdaa6b9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:49.491025 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bdd54a1f-26b3-4b8d-9844-9f0fcbdaa6b9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:49.492026 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bdd54a1f-26b3-4b8d-9844-9f0fcbdaa6b9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:49.492479 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bdd54a1f-26b3-4b8d-9844-9f0fcbdaa6b9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:49.619369 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-bdd54a1f-26b3-4b8d-9844-9f0fcbdaa6b9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:49.628004 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-bdd54a1f-26b3-4b8d-9844-9f0fcbdaa6b9 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.148323 May 24 15:42:49.628642 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1384/2759] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:49 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:50.150720 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-4e47aa5f-037e-4b9e-b4df-1f7c441fb683 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:50.151334 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-4e47aa5f-037e-4b9e-b4df-1f7c441fb683 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:50.158391 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4e47aa5f-037e-4b9e-b4df-1f7c441fb683 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:50.158838 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4e47aa5f-037e-4b9e-b4df-1f7c441fb683 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:50.159595 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4e47aa5f-037e-4b9e-b4df-1f7c441fb683 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:50.160057 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4e47aa5f-037e-4b9e-b4df-1f7c441fb683 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:50.284777 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-4e47aa5f-037e-4b9e-b4df-1f7c441fb683 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:50.293280 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-4e47aa5f-037e-4b9e-b4df-1f7c441fb683 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.145745 May 24 15:42:50.293852 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1376/2760] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:50 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:50.644923 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-9de4773e-1bc7-4fb8-8afd-40d7d9155b11 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:50.645517 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-9de4773e-1bc7-4fb8-8afd-40d7d9155b11 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:50.647848 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_api:SELECT=58 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:42:50.653860 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9de4773e-1bc7-4fb8-8afd-40d7d9155b11 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:50.654305 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9de4773e-1bc7-4fb8-8afd-40d7d9155b11 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:50.655054 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9de4773e-1bc7-4fb8-8afd-40d7d9155b11 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:50.655482 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9de4773e-1bc7-4fb8-8afd-40d7d9155b11 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:50.779217 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-9de4773e-1bc7-4fb8-8afd-40d7d9155b11 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:50.787107 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-9de4773e-1bc7-4fb8-8afd-40d7d9155b11 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.146077 May 24 15:42:50.787677 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1385/2761] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:50 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:51.310867 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-fe2f8e6a-6642-4a62-b929-8cd608f44163 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:51.311438 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-fe2f8e6a-6642-4a62-b929-8cd608f44163 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:51.318167 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fe2f8e6a-6642-4a62-b929-8cd608f44163 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:51.318606 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fe2f8e6a-6642-4a62-b929-8cd608f44163 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:51.319354 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fe2f8e6a-6642-4a62-b929-8cd608f44163 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:51.319783 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fe2f8e6a-6642-4a62-b929-8cd608f44163 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:51.445039 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-fe2f8e6a-6642-4a62-b929-8cd608f44163 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:51.453022 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-fe2f8e6a-6642-4a62-b929-8cd608f44163 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.146689 May 24 15:42:51.453587 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1377/2762] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:51 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:51.803753 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-acba558e-2b88-4d4e-b03f-75f0b3a77b61 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:51.804396 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-acba558e-2b88-4d4e-b03f-75f0b3a77b61 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:51.810922 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-acba558e-2b88-4d4e-b03f-75f0b3a77b61 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:51.811368 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-acba558e-2b88-4d4e-b03f-75f0b3a77b61 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:51.812117 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-acba558e-2b88-4d4e-b03f-75f0b3a77b61 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:51.812589 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-acba558e-2b88-4d4e-b03f-75f0b3a77b61 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:51.936660 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-acba558e-2b88-4d4e-b03f-75f0b3a77b61 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:51.944567 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-acba558e-2b88-4d4e-b03f-75f0b3a77b61 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.144588 May 24 15:42:51.945133 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1386/2763] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:51 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:52.469267 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-173e76a1-876d-4e29-bf2d-f4dbef3cfe18 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:52.469874 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-173e76a1-876d-4e29-bf2d-f4dbef3cfe18 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:52.476711 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-173e76a1-876d-4e29-bf2d-f4dbef3cfe18 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:52.477152 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-173e76a1-876d-4e29-bf2d-f4dbef3cfe18 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:52.477896 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-173e76a1-876d-4e29-bf2d-f4dbef3cfe18 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:52.478326 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-173e76a1-876d-4e29-bf2d-f4dbef3cfe18 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:52.607278 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-173e76a1-876d-4e29-bf2d-f4dbef3cfe18 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:52.615760 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-173e76a1-876d-4e29-bf2d-f4dbef3cfe18 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.150236 May 24 15:42:52.616800 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1378/2764] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:52 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:52.962098 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-2caa0e06-b010-4d25-b676-0fd768f2c23b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:52.962623 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-2caa0e06-b010-4d25-b676-0fd768f2c23b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:52.969635 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2caa0e06-b010-4d25-b676-0fd768f2c23b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:52.970074 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2caa0e06-b010-4d25-b676-0fd768f2c23b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:52.970852 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2caa0e06-b010-4d25-b676-0fd768f2c23b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:52.971282 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2caa0e06-b010-4d25-b676-0fd768f2c23b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:53.098937 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-2caa0e06-b010-4d25-b676-0fd768f2c23b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:53.107481 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-2caa0e06-b010-4d25-b676-0fd768f2c23b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.149323 May 24 15:42:53.108037 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1387/2765] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:52 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:53.633965 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-3b189afb-edd1-4ab6-a7ed-2de539417e82 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:53.634559 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-3b189afb-edd1-4ab6-a7ed-2de539417e82 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:53.641862 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3b189afb-edd1-4ab6-a7ed-2de539417e82 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:53.642316 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3b189afb-edd1-4ab6-a7ed-2de539417e82 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:53.643087 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3b189afb-edd1-4ab6-a7ed-2de539417e82 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:53.643550 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3b189afb-edd1-4ab6-a7ed-2de539417e82 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:53.771299 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-3b189afb-edd1-4ab6-a7ed-2de539417e82 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:53.779445 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-3b189afb-edd1-4ab6-a7ed-2de539417e82 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.149312 May 24 15:42:53.780016 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1379/2766] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:53 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:54.125267 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-f091dffe-862b-46ed-b447-901f0d191731 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:54.125877 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-f091dffe-862b-46ed-b447-901f0d191731 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:54.132372 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f091dffe-862b-46ed-b447-901f0d191731 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:54.132825 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f091dffe-862b-46ed-b447-901f0d191731 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:54.133584 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f091dffe-862b-46ed-b447-901f0d191731 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:54.134015 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f091dffe-862b-46ed-b447-901f0d191731 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:54.257565 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-f091dffe-862b-46ed-b447-901f0d191731 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:54.265494 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-f091dffe-862b-46ed-b447-901f0d191731 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.144776 May 24 15:42:54.266059 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1388/2767] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:54 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:54.797944 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-1b7d3710-7f63-4465-834d-f2614535de10 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:54.798564 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-1b7d3710-7f63-4465-834d-f2614535de10 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:54.805217 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1b7d3710-7f63-4465-834d-f2614535de10 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:54.805671 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1b7d3710-7f63-4465-834d-f2614535de10 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:54.806434 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1b7d3710-7f63-4465-834d-f2614535de10 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:54.806873 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1b7d3710-7f63-4465-834d-f2614535de10 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:54.933618 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-1b7d3710-7f63-4465-834d-f2614535de10 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:54.941587 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-1b7d3710-7f63-4465-834d-f2614535de10 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.149167 May 24 15:42:54.942155 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1380/2768] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:54 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:55.282343 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-5dd6c361-0a02-40ab-9d10-8bf33927f678 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:55.282956 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-5dd6c361-0a02-40ab-9d10-8bf33927f678 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:55.289407 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5dd6c361-0a02-40ab-9d10-8bf33927f678 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:55.289851 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5dd6c361-0a02-40ab-9d10-8bf33927f678 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:55.290594 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5dd6c361-0a02-40ab-9d10-8bf33927f678 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:55.291020 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5dd6c361-0a02-40ab-9d10-8bf33927f678 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:55.418584 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-5dd6c361-0a02-40ab-9d10-8bf33927f678 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:55.426569 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-5dd6c361-0a02-40ab-9d10-8bf33927f678 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.148038 May 24 15:42:55.427130 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1389/2769] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:55 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:55.958858 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-621b5960-e1a2-4b73-a5cb-06301716bc8d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:55.959476 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-621b5960-e1a2-4b73-a5cb-06301716bc8d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:55.966538 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-621b5960-e1a2-4b73-a5cb-06301716bc8d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:55.966989 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-621b5960-e1a2-4b73-a5cb-06301716bc8d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:55.967749 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-621b5960-e1a2-4b73-a5cb-06301716bc8d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:55.968189 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-621b5960-e1a2-4b73-a5cb-06301716bc8d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:56.094673 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-621b5960-e1a2-4b73-a5cb-06301716bc8d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:56.102592 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-621b5960-e1a2-4b73-a5cb-06301716bc8d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.147630 May 24 15:42:56.103158 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1381/2770] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:55 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:56.443632 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-95df10de-9bd7-45a5-b749-b34e4a24f763 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:56.444257 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-95df10de-9bd7-45a5-b749-b34e4a24f763 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:56.451280 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-95df10de-9bd7-45a5-b749-b34e4a24f763 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:56.451719 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-95df10de-9bd7-45a5-b749-b34e4a24f763 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:56.452569 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-95df10de-9bd7-45a5-b749-b34e4a24f763 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:56.453000 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-95df10de-9bd7-45a5-b749-b34e4a24f763 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:56.585312 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-95df10de-9bd7-45a5-b749-b34e4a24f763 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:56.593794 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-95df10de-9bd7-45a5-b749-b34e4a24f763 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.154012 May 24 15:42:56.594355 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1390/2771] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:56 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:57.120078 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-5d21d3b6-e7b2-43f9-bfca-6045b7bef766 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:57.121311 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-5d21d3b6-e7b2-43f9-bfca-6045b7bef766 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:57.123689 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_api:SELECT=52 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:42:57.129125 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5d21d3b6-e7b2-43f9-bfca-6045b7bef766 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:57.129576 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5d21d3b6-e7b2-43f9-bfca-6045b7bef766 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:57.130335 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5d21d3b6-e7b2-43f9-bfca-6045b7bef766 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:57.130775 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5d21d3b6-e7b2-43f9-bfca-6045b7bef766 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:57.262811 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-5d21d3b6-e7b2-43f9-bfca-6045b7bef766 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:57.271009 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-5d21d3b6-e7b2-43f9-bfca-6045b7bef766 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.154816 May 24 15:42:57.271582 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1382/2772] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:57 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:57.610579 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-a47cdd1f-8b77-45bc-84e1-094df4c32cc5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:57.611193 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-a47cdd1f-8b77-45bc-84e1-094df4c32cc5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:57.617949 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a47cdd1f-8b77-45bc-84e1-094df4c32cc5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:57.618400 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a47cdd1f-8b77-45bc-84e1-094df4c32cc5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:57.619158 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a47cdd1f-8b77-45bc-84e1-094df4c32cc5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:57.619595 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a47cdd1f-8b77-45bc-84e1-094df4c32cc5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:57.745998 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-a47cdd1f-8b77-45bc-84e1-094df4c32cc5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:57.753999 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-a47cdd1f-8b77-45bc-84e1-094df4c32cc5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.147311 May 24 15:42:57.754567 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1391/2773] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:57 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:58.287716 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a9755055-8d46-4d1e-a441-aa5a3320a5f0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:58.288392 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a9755055-8d46-4d1e-a441-aa5a3320a5f0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:58.294890 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a9755055-8d46-4d1e-a441-aa5a3320a5f0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:58.295339 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a9755055-8d46-4d1e-a441-aa5a3320a5f0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:58.296101 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a9755055-8d46-4d1e-a441-aa5a3320a5f0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:58.296574 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a9755055-8d46-4d1e-a441-aa5a3320a5f0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:58.423639 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-a9755055-8d46-4d1e-a441-aa5a3320a5f0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:58.431633 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a9755055-8d46-4d1e-a441-aa5a3320a5f0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.147780 May 24 15:42:58.432202 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1383/2774] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:58 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:58.771354 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-199e985d-9b0d-4cb0-9d19-8bfd9a212bc7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:58.771961 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-199e985d-9b0d-4cb0-9d19-8bfd9a212bc7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:58.778409 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-199e985d-9b0d-4cb0-9d19-8bfd9a212bc7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:58.778854 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-199e985d-9b0d-4cb0-9d19-8bfd9a212bc7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:58.779595 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-199e985d-9b0d-4cb0-9d19-8bfd9a212bc7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:58.780021 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-199e985d-9b0d-4cb0-9d19-8bfd9a212bc7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:58.905127 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-199e985d-9b0d-4cb0-9d19-8bfd9a212bc7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:58.912941 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-199e985d-9b0d-4cb0-9d19-8bfd9a212bc7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.145390 May 24 15:42:58.913496 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1392/2775] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:58 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:59.449538 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-381ca10d-3aad-4898-bb3e-ced01db7e779 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:59.450104 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-381ca10d-3aad-4898-bb3e-ced01db7e779 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:59.456598 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-381ca10d-3aad-4898-bb3e-ced01db7e779 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:59.457037 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-381ca10d-3aad-4898-bb3e-ced01db7e779 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:59.457783 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-381ca10d-3aad-4898-bb3e-ced01db7e779 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:59.458209 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-381ca10d-3aad-4898-bb3e-ced01db7e779 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:59.574832 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-f6bde8ca-fe05-439f-8c1f-bfeeb1ad5440 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:59.575325 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-f6bde8ca-fe05-439f-8c1f-bfeeb1ad5440 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: d8d131e6-a9cf-46ca-bd20-8fba3e295618] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:59.581312 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f6bde8ca-fe05-439f-8c1f-bfeeb1ad5440 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:59.581748 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f6bde8ca-fe05-439f-8c1f-bfeeb1ad5440 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:59.582500 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f6bde8ca-fe05-439f-8c1f-bfeeb1ad5440 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:59.582925 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f6bde8ca-fe05-439f-8c1f-bfeeb1ad5440 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:59.583117 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-381ca10d-3aad-4898-bb3e-ced01db7e779 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:59.591686 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-381ca10d-3aad-4898-bb3e-ced01db7e779 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.146546 May 24 15:42:59.592262 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1384/2776] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:59 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:59.606007 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-f6bde8ca-fe05-439f-8c1f-bfeeb1ad5440 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/d8d131e6-a9cf-46ca-bd20-8fba3e295618/ips" status: 200 len: 153 microversion: 2.20 time: 0.035555 May 24 15:42:59.606559 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1393/2777] 10.222.0.45 () {60 vars in 1288 bytes} [Tue May 24 15:42:59 2022] GET /compute/v2.1/servers/d8d131e6-a9cf-46ca-bd20-8fba3e295618/ips => generated 153 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 15:42:59.930095 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-105df17a-5fea-49a4-be8f-ee0e2605aec4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:59.930709 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-105df17a-5fea-49a4-be8f-ee0e2605aec4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:59.937270 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-105df17a-5fea-49a4-be8f-ee0e2605aec4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:59.937717 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-105df17a-5fea-49a4-be8f-ee0e2605aec4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:59.938469 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-105df17a-5fea-49a4-be8f-ee0e2605aec4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:59.938899 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-105df17a-5fea-49a4-be8f-ee0e2605aec4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:00.070118 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-105df17a-5fea-49a4-be8f-ee0e2605aec4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:00.078597 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-105df17a-5fea-49a4-be8f-ee0e2605aec4 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.152313 May 24 15:43:00.079165 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1385/2778] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:42:59 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:00.608589 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-50658b6b-5149-4e6e-8e2c-7e04c1023fc1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:00.609201 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-50658b6b-5149-4e6e-8e2c-7e04c1023fc1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:00.615714 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-50658b6b-5149-4e6e-8e2c-7e04c1023fc1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:00.616162 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-50658b6b-5149-4e6e-8e2c-7e04c1023fc1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:00.617214 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-50658b6b-5149-4e6e-8e2c-7e04c1023fc1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:00.617644 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-50658b6b-5149-4e6e-8e2c-7e04c1023fc1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:00.746882 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-50658b6b-5149-4e6e-8e2c-7e04c1023fc1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:00.754745 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-50658b6b-5149-4e6e-8e2c-7e04c1023fc1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.149963 May 24 15:43:00.755302 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1394/2779] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:00 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:01.095075 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-be813454-9948-49e0-994d-59f0b84621ba tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:01.095691 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-be813454-9948-49e0-994d-59f0b84621ba tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:01.102288 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-be813454-9948-49e0-994d-59f0b84621ba tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:01.102734 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-be813454-9948-49e0-994d-59f0b84621ba tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:01.103486 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-be813454-9948-49e0-994d-59f0b84621ba tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:01.103919 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-be813454-9948-49e0-994d-59f0b84621ba tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:01.235452 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-be813454-9948-49e0-994d-59f0b84621ba tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:01.243638 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-be813454-9948-49e0-994d-59f0b84621ba tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.152392 May 24 15:43:01.244209 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1386/2780] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:01 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:43:01.771413 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-6090e39a-1d48-493e-a4e0-bf68faa1bed9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:01.772020 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-6090e39a-1d48-493e-a4e0-bf68faa1bed9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:01.779186 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6090e39a-1d48-493e-a4e0-bf68faa1bed9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:01.779630 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6090e39a-1d48-493e-a4e0-bf68faa1bed9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:01.780402 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6090e39a-1d48-493e-a4e0-bf68faa1bed9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:01.780835 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6090e39a-1d48-493e-a4e0-bf68faa1bed9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:01.909357 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-6090e39a-1d48-493e-a4e0-bf68faa1bed9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:01.917333 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-6090e39a-1d48-493e-a4e0-bf68faa1bed9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.149652 May 24 15:43:01.917895 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1395/2781] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:01 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:02.260375 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e405e390-cd36-48cf-8e87-bb6ab9730b4d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:02.261534 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-e405e390-cd36-48cf-8e87-bb6ab9730b4d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:02.268025 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e405e390-cd36-48cf-8e87-bb6ab9730b4d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:02.268504 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e405e390-cd36-48cf-8e87-bb6ab9730b4d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:02.269254 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e405e390-cd36-48cf-8e87-bb6ab9730b4d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:02.269710 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e405e390-cd36-48cf-8e87-bb6ab9730b4d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:02.396797 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-e405e390-cd36-48cf-8e87-bb6ab9730b4d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:02.404644 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-e405e390-cd36-48cf-8e87-bb6ab9730b4d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.148129 May 24 15:43:02.405208 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1387/2782] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:02 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:02.934556 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-ddd64fc6-94ee-455b-8839-78d12bd9eb56 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:02.935101 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-ddd64fc6-94ee-455b-8839-78d12bd9eb56 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:02.941581 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ddd64fc6-94ee-455b-8839-78d12bd9eb56 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:02.942025 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ddd64fc6-94ee-455b-8839-78d12bd9eb56 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:02.942776 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ddd64fc6-94ee-455b-8839-78d12bd9eb56 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:02.943206 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ddd64fc6-94ee-455b-8839-78d12bd9eb56 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:03.070000 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ddd64fc6-94ee-455b-8839-78d12bd9eb56 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:03.078025 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-ddd64fc6-94ee-455b-8839-78d12bd9eb56 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.147350 May 24 15:43:03.078596 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1396/2783] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:02 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:03.421178 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-4f447f6e-24cb-44ff-aaac-1a3d0a833b60 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:03.421792 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-4f447f6e-24cb-44ff-aaac-1a3d0a833b60 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:03.428529 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4f447f6e-24cb-44ff-aaac-1a3d0a833b60 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:03.428981 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4f447f6e-24cb-44ff-aaac-1a3d0a833b60 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:03.429749 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4f447f6e-24cb-44ff-aaac-1a3d0a833b60 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:03.430182 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4f447f6e-24cb-44ff-aaac-1a3d0a833b60 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:03.554640 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-4f447f6e-24cb-44ff-aaac-1a3d0a833b60 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:03.563516 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-4f447f6e-24cb-44ff-aaac-1a3d0a833b60 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.146201 May 24 15:43:03.564084 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1388/2784] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:03 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:04.094826 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d8de8541-9c72-426f-adf6-8272d4680915 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:04.095460 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d8de8541-9c72-426f-adf6-8272d4680915 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:04.101868 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d8de8541-9c72-426f-adf6-8272d4680915 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:04.102310 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d8de8541-9c72-426f-adf6-8272d4680915 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:04.103049 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d8de8541-9c72-426f-adf6-8272d4680915 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:04.103478 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d8de8541-9c72-426f-adf6-8272d4680915 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:04.231136 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-d8de8541-9c72-426f-adf6-8272d4680915 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:04.238961 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d8de8541-9c72-426f-adf6-8272d4680915 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.147979 May 24 15:43:04.239523 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1397/2785] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:04 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:04.580166 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-79e3d2f9-c2e4-44e4-a861-dbeadb99b35c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:04.580852 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-79e3d2f9-c2e4-44e4-a861-dbeadb99b35c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:04.587342 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-79e3d2f9-c2e4-44e4-a861-dbeadb99b35c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:04.587786 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-79e3d2f9-c2e4-44e4-a861-dbeadb99b35c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:04.588586 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-79e3d2f9-c2e4-44e4-a861-dbeadb99b35c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:04.589497 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-79e3d2f9-c2e4-44e4-a861-dbeadb99b35c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:04.712400 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-79e3d2f9-c2e4-44e4-a861-dbeadb99b35c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:04.720805 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-79e3d2f9-c2e4-44e4-a861-dbeadb99b35c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.144497 May 24 15:43:04.721374 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1389/2786] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:04 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:05.256426 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-3940cb6e-1302-4911-8636-71fabb70f1b6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:05.257035 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-3940cb6e-1302-4911-8636-71fabb70f1b6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:05.264069 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3940cb6e-1302-4911-8636-71fabb70f1b6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:05.264542 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3940cb6e-1302-4911-8636-71fabb70f1b6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:05.265295 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3940cb6e-1302-4911-8636-71fabb70f1b6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:05.265734 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3940cb6e-1302-4911-8636-71fabb70f1b6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:05.391019 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-3940cb6e-1302-4911-8636-71fabb70f1b6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:05.398863 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-3940cb6e-1302-4911-8636-71fabb70f1b6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.146314 May 24 15:43:05.399420 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1398/2787] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:05 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:05.737821 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e34e98b1-da0a-4bdb-98df-31d9d9788c79 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:05.738464 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-e34e98b1-da0a-4bdb-98df-31d9d9788c79 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:05.745264 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e34e98b1-da0a-4bdb-98df-31d9d9788c79 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:05.745704 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e34e98b1-da0a-4bdb-98df-31d9d9788c79 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:05.746446 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e34e98b1-da0a-4bdb-98df-31d9d9788c79 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:05.746873 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e34e98b1-da0a-4bdb-98df-31d9d9788c79 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:05.875655 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-e34e98b1-da0a-4bdb-98df-31d9d9788c79 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:05.879049 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:43:05.884621 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-e34e98b1-da0a-4bdb-98df-31d9d9788c79 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.150967 May 24 15:43:05.885185 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1390/2788] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:05 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:06.415483 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-7382c0c4-5ff9-49c5-861f-1b3509b89c82 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:06.416021 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-7382c0c4-5ff9-49c5-861f-1b3509b89c82 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:06.422506 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7382c0c4-5ff9-49c5-861f-1b3509b89c82 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:06.422950 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7382c0c4-5ff9-49c5-861f-1b3509b89c82 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:06.423700 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7382c0c4-5ff9-49c5-861f-1b3509b89c82 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:06.424131 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7382c0c4-5ff9-49c5-861f-1b3509b89c82 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:06.428069 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:43:06.550677 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-7382c0c4-5ff9-49c5-861f-1b3509b89c82 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:06.558995 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-7382c0c4-5ff9-49c5-861f-1b3509b89c82 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.147465 May 24 15:43:06.560076 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1399/2789] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:06 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:06.901917 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-8c376fd0-159b-4f91-93d7-246bfe4bc551 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:06.902531 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-8c376fd0-159b-4f91-93d7-246bfe4bc551 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:06.909261 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8c376fd0-159b-4f91-93d7-246bfe4bc551 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:06.909872 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8c376fd0-159b-4f91-93d7-246bfe4bc551 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:06.910480 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8c376fd0-159b-4f91-93d7-246bfe4bc551 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:06.910988 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8c376fd0-159b-4f91-93d7-246bfe4bc551 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:07.037494 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-8c376fd0-159b-4f91-93d7-246bfe4bc551 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:07.045927 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-8c376fd0-159b-4f91-93d7-246bfe4bc551 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.148117 May 24 15:43:07.046501 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1391/2790] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:06 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:07.576270 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-9969e256-90df-4675-b63e-139f720640ae tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:07.576886 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-9969e256-90df-4675-b63e-139f720640ae tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:07.583369 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9969e256-90df-4675-b63e-139f720640ae tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:07.583813 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9969e256-90df-4675-b63e-139f720640ae tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:07.584587 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9969e256-90df-4675-b63e-139f720640ae tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:07.585013 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9969e256-90df-4675-b63e-139f720640ae tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:07.712576 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-9969e256-90df-4675-b63e-139f720640ae tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:07.721094 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-9969e256-90df-4675-b63e-139f720640ae tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.148706 May 24 15:43:07.721654 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1400/2791] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:07 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:08.064480 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-77a8f8f1-fdad-4806-abe7-e34bd4a88e5d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:08.065173 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-77a8f8f1-fdad-4806-abe7-e34bd4a88e5d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:08.071764 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-77a8f8f1-fdad-4806-abe7-e34bd4a88e5d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:08.072217 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-77a8f8f1-fdad-4806-abe7-e34bd4a88e5d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:08.073016 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-77a8f8f1-fdad-4806-abe7-e34bd4a88e5d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:08.074107 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-77a8f8f1-fdad-4806-abe7-e34bd4a88e5d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:08.201727 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-77a8f8f1-fdad-4806-abe7-e34bd4a88e5d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:08.209777 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-77a8f8f1-fdad-4806-abe7-e34bd4a88e5d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.149268 May 24 15:43:08.210355 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1392/2792] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:08 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:08.736920 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-4788ff47-9e8c-438d-b672-fc60beb74cf2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:08.737504 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-4788ff47-9e8c-438d-b672-fc60beb74cf2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:08.744263 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4788ff47-9e8c-438d-b672-fc60beb74cf2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:08.744736 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4788ff47-9e8c-438d-b672-fc60beb74cf2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:08.745480 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4788ff47-9e8c-438d-b672-fc60beb74cf2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:08.745909 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4788ff47-9e8c-438d-b672-fc60beb74cf2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:08.871612 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-4788ff47-9e8c-438d-b672-fc60beb74cf2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:08.879548 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-4788ff47-9e8c-438d-b672-fc60beb74cf2 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.146470 May 24 15:43:08.880118 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1401/2793] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:08 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:09.289685 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-26e42300-d329-4deb-a203-48906d2241db tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:09.290303 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-26e42300-d329-4deb-a203-48906d2241db tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:09.296273 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-26e42300-d329-4deb-a203-48906d2241db tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:09.296742 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-26e42300-d329-4deb-a203-48906d2241db tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:09.297495 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-26e42300-d329-4deb-a203-48906d2241db tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:09.297929 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-26e42300-d329-4deb-a203-48906d2241db tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:09.422559 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-26e42300-d329-4deb-a203-48906d2241db tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:09.431378 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-26e42300-d329-4deb-a203-48906d2241db tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.208631 May 24 15:43:09.431936 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1393/2794] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:09 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:09.896193 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-33ecbddb-472e-4708-92ff-42877672688f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:09.896831 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-33ecbddb-472e-4708-92ff-42877672688f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:09.903273 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-33ecbddb-472e-4708-92ff-42877672688f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:09.903717 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-33ecbddb-472e-4708-92ff-42877672688f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:09.904503 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-33ecbddb-472e-4708-92ff-42877672688f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:09.904937 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-33ecbddb-472e-4708-92ff-42877672688f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:10.033573 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-33ecbddb-472e-4708-92ff-42877672688f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:10.041346 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-33ecbddb-472e-4708-92ff-42877672688f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.148996 May 24 15:43:10.042388 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1402/2795] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:09 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:10.448248 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a8712858-21b7-4826-bb0f-5ded5e374355 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:10.448879 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a8712858-21b7-4826-bb0f-5ded5e374355 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:10.455087 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a8712858-21b7-4826-bb0f-5ded5e374355 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:10.455554 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a8712858-21b7-4826-bb0f-5ded5e374355 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:10.456358 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a8712858-21b7-4826-bb0f-5ded5e374355 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:10.456795 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a8712858-21b7-4826-bb0f-5ded5e374355 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:10.591076 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-a8712858-21b7-4826-bb0f-5ded5e374355 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:10.599309 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a8712858-21b7-4826-bb0f-5ded5e374355 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.154949 May 24 15:43:10.599870 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1394/2796] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:10 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:11.059073 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-f8b36b1c-cf3c-41c1-a4c9-2226f531d67e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:11.059658 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-f8b36b1c-cf3c-41c1-a4c9-2226f531d67e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:11.066134 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f8b36b1c-cf3c-41c1-a4c9-2226f531d67e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:11.066582 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f8b36b1c-cf3c-41c1-a4c9-2226f531d67e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:11.067362 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f8b36b1c-cf3c-41c1-a4c9-2226f531d67e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:11.067793 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f8b36b1c-cf3c-41c1-a4c9-2226f531d67e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:11.196518 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-f8b36b1c-cf3c-41c1-a4c9-2226f531d67e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:11.204942 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-f8b36b1c-cf3c-41c1-a4c9-2226f531d67e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.150212 May 24 15:43:11.205495 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1403/2797] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:11 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:11.617348 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f7d588c9-be5f-4db5-bf0f-c475dbea2312 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:11.617982 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f7d588c9-be5f-4db5-bf0f-c475dbea2312 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:11.625063 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f7d588c9-be5f-4db5-bf0f-c475dbea2312 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:11.625503 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f7d588c9-be5f-4db5-bf0f-c475dbea2312 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:11.626254 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f7d588c9-be5f-4db5-bf0f-c475dbea2312 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:11.626680 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f7d588c9-be5f-4db5-bf0f-c475dbea2312 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:11.751178 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-f7d588c9-be5f-4db5-bf0f-c475dbea2312 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:11.759073 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f7d588c9-be5f-4db5-bf0f-c475dbea2312 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.145821 May 24 15:43:11.759644 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1395/2798] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:11 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:12.221718 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-9c9055bf-7561-4c88-aee7-e94c436d29f9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:12.222327 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-9c9055bf-7561-4c88-aee7-e94c436d29f9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:12.229000 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9c9055bf-7561-4c88-aee7-e94c436d29f9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:12.229442 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9c9055bf-7561-4c88-aee7-e94c436d29f9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:12.230194 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9c9055bf-7561-4c88-aee7-e94c436d29f9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:12.230624 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9c9055bf-7561-4c88-aee7-e94c436d29f9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:12.359223 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-9c9055bf-7561-4c88-aee7-e94c436d29f9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:12.367701 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-9c9055bf-7561-4c88-aee7-e94c436d29f9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.149842 May 24 15:43:12.368260 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1404/2799] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:12 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:12.776243 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-5ce2997f-01b6-447b-9d9a-4f1a7270c03d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:12.776910 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-5ce2997f-01b6-447b-9d9a-4f1a7270c03d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:12.783407 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5ce2997f-01b6-447b-9d9a-4f1a7270c03d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:12.783854 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5ce2997f-01b6-447b-9d9a-4f1a7270c03d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:12.784634 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5ce2997f-01b6-447b-9d9a-4f1a7270c03d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:12.785065 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5ce2997f-01b6-447b-9d9a-4f1a7270c03d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:12.910152 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-5ce2997f-01b6-447b-9d9a-4f1a7270c03d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:12.918538 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-5ce2997f-01b6-447b-9d9a-4f1a7270c03d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.146257 May 24 15:43:12.919106 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1396/2800] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:12 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:43:13.384421 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-b892e86c-2610-4296-bfd4-b9775508fd82 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:13.385030 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-b892e86c-2610-4296-bfd4-b9775508fd82 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:13.391614 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b892e86c-2610-4296-bfd4-b9775508fd82 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:13.392061 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b892e86c-2610-4296-bfd4-b9775508fd82 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:13.392845 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b892e86c-2610-4296-bfd4-b9775508fd82 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:13.393282 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b892e86c-2610-4296-bfd4-b9775508fd82 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:13.519400 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-b892e86c-2610-4296-bfd4-b9775508fd82 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:13.527786 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-b892e86c-2610-4296-bfd4-b9775508fd82 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.147312 May 24 15:43:13.528362 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1405/2801] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:13 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:13.935253 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-5906c025-b4f5-4f16-8640-214032e593bd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:13.935873 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-5906c025-b4f5-4f16-8640-214032e593bd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:13.942476 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5906c025-b4f5-4f16-8640-214032e593bd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:13.942926 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5906c025-b4f5-4f16-8640-214032e593bd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:13.943688 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5906c025-b4f5-4f16-8640-214032e593bd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:13.944127 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5906c025-b4f5-4f16-8640-214032e593bd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:14.074247 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-5906c025-b4f5-4f16-8640-214032e593bd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:14.082286 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-5906c025-b4f5-4f16-8640-214032e593bd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.150881 May 24 15:43:14.082856 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1397/2802] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:13 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:14.544944 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-6f2aed51-c5a2-47c2-bf8e-281237f61e43 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:14.545558 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-6f2aed51-c5a2-47c2-bf8e-281237f61e43 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:14.552292 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6f2aed51-c5a2-47c2-bf8e-281237f61e43 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:14.552763 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6f2aed51-c5a2-47c2-bf8e-281237f61e43 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:14.553523 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6f2aed51-c5a2-47c2-bf8e-281237f61e43 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:14.553962 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6f2aed51-c5a2-47c2-bf8e-281237f61e43 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:14.679754 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-6f2aed51-c5a2-47c2-bf8e-281237f61e43 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:14.688391 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-6f2aed51-c5a2-47c2-bf8e-281237f61e43 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.147791 May 24 15:43:14.688962 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1406/2803] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:14 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:15.098900 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d4580526-482b-4988-a3a0-4ab63d6ad05c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:15.099556 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d4580526-482b-4988-a3a0-4ab63d6ad05c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:15.106811 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d4580526-482b-4988-a3a0-4ab63d6ad05c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:15.107262 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d4580526-482b-4988-a3a0-4ab63d6ad05c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:15.108033 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d4580526-482b-4988-a3a0-4ab63d6ad05c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:15.108561 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d4580526-482b-4988-a3a0-4ab63d6ad05c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:15.233775 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-d4580526-482b-4988-a3a0-4ab63d6ad05c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:15.241961 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d4580526-482b-4988-a3a0-4ab63d6ad05c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.146672 May 24 15:43:15.242532 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1398/2804] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:15 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:15.705069 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-492a6145-861c-40ef-9617-7d38244cb902 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:15.705688 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-492a6145-861c-40ef-9617-7d38244cb902 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:15.712208 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-492a6145-861c-40ef-9617-7d38244cb902 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:15.712689 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-492a6145-861c-40ef-9617-7d38244cb902 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:15.713445 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-492a6145-861c-40ef-9617-7d38244cb902 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:15.713901 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-492a6145-861c-40ef-9617-7d38244cb902 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:15.843400 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-492a6145-861c-40ef-9617-7d38244cb902 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:15.851413 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-492a6145-861c-40ef-9617-7d38244cb902 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.150159 May 24 15:43:15.852202 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1407/2805] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:15 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:16.258474 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-1414e8dc-70ec-492b-be87-f6ceff073787 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:16.259094 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-1414e8dc-70ec-492b-be87-f6ceff073787 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:16.265661 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1414e8dc-70ec-492b-be87-f6ceff073787 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:16.266107 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1414e8dc-70ec-492b-be87-f6ceff073787 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:16.266867 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1414e8dc-70ec-492b-be87-f6ceff073787 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:16.267302 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1414e8dc-70ec-492b-be87-f6ceff073787 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:16.395052 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-1414e8dc-70ec-492b-be87-f6ceff073787 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:16.403904 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-1414e8dc-70ec-492b-be87-f6ceff073787 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.149198 May 24 15:43:16.404517 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1399/2806] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:16 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:16.868735 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-1fd13165-8073-4135-8029-ad9926bba08c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:16.869349 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-1fd13165-8073-4135-8029-ad9926bba08c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:16.875807 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1fd13165-8073-4135-8029-ad9926bba08c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:16.876248 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1fd13165-8073-4135-8029-ad9926bba08c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:16.877048 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1fd13165-8073-4135-8029-ad9926bba08c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:16.877512 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1fd13165-8073-4135-8029-ad9926bba08c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:17.005512 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-1fd13165-8073-4135-8029-ad9926bba08c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:17.014055 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-1fd13165-8073-4135-8029-ad9926bba08c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.149381 May 24 15:43:17.014618 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1408/2807] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:16 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:17.421502 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-99fc7090-cbdc-465d-82ae-f5e1474c3d73 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:17.422303 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-99fc7090-cbdc-465d-82ae-f5e1474c3d73 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:17.428563 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-99fc7090-cbdc-465d-82ae-f5e1474c3d73 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:17.429003 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-99fc7090-cbdc-465d-82ae-f5e1474c3d73 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:17.429748 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-99fc7090-cbdc-465d-82ae-f5e1474c3d73 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:17.430179 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-99fc7090-cbdc-465d-82ae-f5e1474c3d73 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:17.554800 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-99fc7090-cbdc-465d-82ae-f5e1474c3d73 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:17.563361 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-99fc7090-cbdc-465d-82ae-f5e1474c3d73 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.146499 May 24 15:43:17.563922 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1400/2808] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:17 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:18.031128 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-3de318cb-a38d-4233-a9af-71cb74ac4755 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:18.031728 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-3de318cb-a38d-4233-a9af-71cb74ac4755 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:18.038145 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3de318cb-a38d-4233-a9af-71cb74ac4755 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:18.038582 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3de318cb-a38d-4233-a9af-71cb74ac4755 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:18.039321 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3de318cb-a38d-4233-a9af-71cb74ac4755 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:18.039744 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3de318cb-a38d-4233-a9af-71cb74ac4755 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:18.168366 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-3de318cb-a38d-4233-a9af-71cb74ac4755 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:18.176193 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-3de318cb-a38d-4233-a9af-71cb74ac4755 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.148815 May 24 15:43:18.176755 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1409/2809] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:18 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:18.580206 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-5271fb21-a28a-47d4-b238-8e5a812ec05c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:18.580853 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-5271fb21-a28a-47d4-b238-8e5a812ec05c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:18.587261 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5271fb21-a28a-47d4-b238-8e5a812ec05c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:18.587699 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5271fb21-a28a-47d4-b238-8e5a812ec05c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:18.588537 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5271fb21-a28a-47d4-b238-8e5a812ec05c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:18.588965 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5271fb21-a28a-47d4-b238-8e5a812ec05c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:18.718653 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-5271fb21-a28a-47d4-b238-8e5a812ec05c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:18.726490 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-5271fb21-a28a-47d4-b238-8e5a812ec05c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.150170 May 24 15:43:18.727050 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1401/2810] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:18 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:19.185097 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 15:43:19.185262 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Tue May 24 15:43:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 15:43:19.192806 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-73d66f6f-49e6-4a57-9627-b76bf2114512 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:19.193412 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-73d66f6f-49e6-4a57-9627-b76bf2114512 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:19.199828 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-73d66f6f-49e6-4a57-9627-b76bf2114512 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:19.200272 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-73d66f6f-49e6-4a57-9627-b76bf2114512 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:19.201056 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-73d66f6f-49e6-4a57-9627-b76bf2114512 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:19.201489 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-73d66f6f-49e6-4a57-9627-b76bf2114512 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:19.331110 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-73d66f6f-49e6-4a57-9627-b76bf2114512 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:19.339786 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-73d66f6f-49e6-4a57-9627-b76bf2114512 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.150746 May 24 15:43:19.340366 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1410/2811] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:19 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:19.746361 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-9bf644b9-e636-4662-9da1-5b0d1cdb2d44 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:19.746974 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-9bf644b9-e636-4662-9da1-5b0d1cdb2d44 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:19.753662 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9bf644b9-e636-4662-9da1-5b0d1cdb2d44 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:19.754111 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9bf644b9-e636-4662-9da1-5b0d1cdb2d44 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:19.754879 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9bf644b9-e636-4662-9da1-5b0d1cdb2d44 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:19.755308 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9bf644b9-e636-4662-9da1-5b0d1cdb2d44 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:19.887241 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-9bf644b9-e636-4662-9da1-5b0d1cdb2d44 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:19.895038 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-9bf644b9-e636-4662-9da1-5b0d1cdb2d44 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.152603 May 24 15:43:19.895604 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1402/2812] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:19 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:20.357023 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-dae2f581-f6bd-43b4-bb81-3eb9ea398dfa tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:20.357586 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-dae2f581-f6bd-43b4-bb81-3eb9ea398dfa tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:20.364074 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dae2f581-f6bd-43b4-bb81-3eb9ea398dfa tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:20.364575 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dae2f581-f6bd-43b4-bb81-3eb9ea398dfa tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:20.365339 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dae2f581-f6bd-43b4-bb81-3eb9ea398dfa tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:20.365776 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dae2f581-f6bd-43b4-bb81-3eb9ea398dfa tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:20.490156 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-dae2f581-f6bd-43b4-bb81-3eb9ea398dfa tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:20.498818 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-dae2f581-f6bd-43b4-bb81-3eb9ea398dfa tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.146255 May 24 15:43:20.499382 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1411/2813] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:20 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:20.912522 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-23bc9277-0b9e-4ff2-87c3-6f1ce745d72c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:20.913132 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-23bc9277-0b9e-4ff2-87c3-6f1ce745d72c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:20.920431 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-23bc9277-0b9e-4ff2-87c3-6f1ce745d72c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:20.920961 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-23bc9277-0b9e-4ff2-87c3-6f1ce745d72c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:20.921743 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-23bc9277-0b9e-4ff2-87c3-6f1ce745d72c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:20.922175 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-23bc9277-0b9e-4ff2-87c3-6f1ce745d72c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:21.046240 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-23bc9277-0b9e-4ff2-87c3-6f1ce745d72c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:21.054096 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-23bc9277-0b9e-4ff2-87c3-6f1ce745d72c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.145465 May 24 15:43:21.054653 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1403/2814] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:20 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:21.515904 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-5c6fcac2-9176-4d7c-b4e8-95ea1733b86b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:21.516546 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-5c6fcac2-9176-4d7c-b4e8-95ea1733b86b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:21.518968 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_api:SELECT=54 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:43:21.524196 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5c6fcac2-9176-4d7c-b4e8-95ea1733b86b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:21.524676 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5c6fcac2-9176-4d7c-b4e8-95ea1733b86b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:21.525427 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5c6fcac2-9176-4d7c-b4e8-95ea1733b86b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:21.525861 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5c6fcac2-9176-4d7c-b4e8-95ea1733b86b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:21.654098 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-5c6fcac2-9176-4d7c-b4e8-95ea1733b86b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:21.661932 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-5c6fcac2-9176-4d7c-b4e8-95ea1733b86b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.149852 May 24 15:43:21.662489 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1412/2815] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:21 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:22.071814 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-7552ba4d-bc93-4eaf-a061-cf5f6064f5e2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:22.072486 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-7552ba4d-bc93-4eaf-a061-cf5f6064f5e2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:22.078573 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7552ba4d-bc93-4eaf-a061-cf5f6064f5e2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:22.079026 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7552ba4d-bc93-4eaf-a061-cf5f6064f5e2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:22.079791 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7552ba4d-bc93-4eaf-a061-cf5f6064f5e2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:22.080227 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7552ba4d-bc93-4eaf-a061-cf5f6064f5e2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:22.209486 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-7552ba4d-bc93-4eaf-a061-cf5f6064f5e2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:22.217853 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-7552ba4d-bc93-4eaf-a061-cf5f6064f5e2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.150632 May 24 15:43:22.218404 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1404/2816] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:22 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:22.679153 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-264191dd-d7ea-4934-a94f-b3a6b659f6d0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:22.679784 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-264191dd-d7ea-4934-a94f-b3a6b659f6d0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:22.686253 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-264191dd-d7ea-4934-a94f-b3a6b659f6d0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:22.686697 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-264191dd-d7ea-4934-a94f-b3a6b659f6d0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:22.687444 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-264191dd-d7ea-4934-a94f-b3a6b659f6d0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:22.687867 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-264191dd-d7ea-4934-a94f-b3a6b659f6d0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:22.814236 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-264191dd-d7ea-4934-a94f-b3a6b659f6d0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:22.822354 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-264191dd-d7ea-4934-a94f-b3a6b659f6d0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.146985 May 24 15:43:22.823462 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1413/2817] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:22 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:23.234543 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-3bb7d292-7a83-4ec4-91ac-2ded7167114b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:23.235159 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-3bb7d292-7a83-4ec4-91ac-2ded7167114b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:23.241938 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3bb7d292-7a83-4ec4-91ac-2ded7167114b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:23.242383 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3bb7d292-7a83-4ec4-91ac-2ded7167114b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:23.243136 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3bb7d292-7a83-4ec4-91ac-2ded7167114b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:23.243570 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3bb7d292-7a83-4ec4-91ac-2ded7167114b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:23.368602 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-3bb7d292-7a83-4ec4-91ac-2ded7167114b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:23.377148 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-3bb7d292-7a83-4ec4-91ac-2ded7167114b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.146468 May 24 15:43:23.377712 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1405/2818] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:23 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:23.839376 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-80cd054f-6eb1-4f8c-8015-5cee937240d9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:23.839985 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-80cd054f-6eb1-4f8c-8015-5cee937240d9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:23.846533 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-80cd054f-6eb1-4f8c-8015-5cee937240d9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:23.846982 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-80cd054f-6eb1-4f8c-8015-5cee937240d9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:23.847734 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-80cd054f-6eb1-4f8c-8015-5cee937240d9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:23.848168 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-80cd054f-6eb1-4f8c-8015-5cee937240d9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:23.974542 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-80cd054f-6eb1-4f8c-8015-5cee937240d9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:23.982996 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-80cd054f-6eb1-4f8c-8015-5cee937240d9 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.147987 May 24 15:43:23.983559 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1414/2819] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:23 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:24.394025 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-aee69e9b-633a-4872-b4a6-3cfa44b86274 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:24.394665 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-aee69e9b-633a-4872-b4a6-3cfa44b86274 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:24.401865 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-aee69e9b-633a-4872-b4a6-3cfa44b86274 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:24.402307 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-aee69e9b-633a-4872-b4a6-3cfa44b86274 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:24.403071 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-aee69e9b-633a-4872-b4a6-3cfa44b86274 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:24.403502 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-aee69e9b-633a-4872-b4a6-3cfa44b86274 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:24.533526 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-aee69e9b-633a-4872-b4a6-3cfa44b86274 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:24.541405 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-aee69e9b-633a-4872-b4a6-3cfa44b86274 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.151293 May 24 15:43:24.541968 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1406/2820] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:24 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:25.000444 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-a31c82fd-65d0-4daa-8d78-d0e7c09f8ed1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:25.001030 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-a31c82fd-65d0-4daa-8d78-d0e7c09f8ed1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:25.007503 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a31c82fd-65d0-4daa-8d78-d0e7c09f8ed1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:25.007946 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a31c82fd-65d0-4daa-8d78-d0e7c09f8ed1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:25.008715 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a31c82fd-65d0-4daa-8d78-d0e7c09f8ed1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:25.009141 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a31c82fd-65d0-4daa-8d78-d0e7c09f8ed1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:25.139142 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-a31c82fd-65d0-4daa-8d78-d0e7c09f8ed1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:25.142539 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:43:25.147736 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-a31c82fd-65d0-4daa-8d78-d0e7c09f8ed1 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.151141 May 24 15:43:25.148307 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1415/2821] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:24 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:25.557795 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-3eda9917-e583-43b3-ae7f-05e25c35e578 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:25.558409 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-3eda9917-e583-43b3-ae7f-05e25c35e578 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:25.565018 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3eda9917-e583-43b3-ae7f-05e25c35e578 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:25.565470 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3eda9917-e583-43b3-ae7f-05e25c35e578 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:25.566229 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3eda9917-e583-43b3-ae7f-05e25c35e578 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:25.566661 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3eda9917-e583-43b3-ae7f-05e25c35e578 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:25.584703 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:43:25.696875 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-3eda9917-e583-43b3-ae7f-05e25c35e578 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:25.705264 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-3eda9917-e583-43b3-ae7f-05e25c35e578 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.151289 May 24 15:43:25.705837 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1407/2822] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:25 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:26.164153 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-6413ca83-0d31-4f25-8431-0f4a66ffb3fd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:26.164792 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-6413ca83-0d31-4f25-8431-0f4a66ffb3fd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:26.171333 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6413ca83-0d31-4f25-8431-0f4a66ffb3fd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:26.171784 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6413ca83-0d31-4f25-8431-0f4a66ffb3fd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:26.172567 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6413ca83-0d31-4f25-8431-0f4a66ffb3fd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:26.173010 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6413ca83-0d31-4f25-8431-0f4a66ffb3fd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:26.303752 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-6413ca83-0d31-4f25-8431-0f4a66ffb3fd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:26.312197 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-6413ca83-0d31-4f25-8431-0f4a66ffb3fd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.152119 May 24 15:43:26.312787 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1416/2823] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:26 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:26.723537 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-4ea32e18-f7c7-4c7b-8264-14638062f6bc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:26.724182 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-4ea32e18-f7c7-4c7b-8264-14638062f6bc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:26.731597 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4ea32e18-f7c7-4c7b-8264-14638062f6bc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:26.732047 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4ea32e18-f7c7-4c7b-8264-14638062f6bc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:26.732841 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4ea32e18-f7c7-4c7b-8264-14638062f6bc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:26.733281 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4ea32e18-f7c7-4c7b-8264-14638062f6bc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:26.858176 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-4ea32e18-f7c7-4c7b-8264-14638062f6bc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:26.866307 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-4ea32e18-f7c7-4c7b-8264-14638062f6bc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.146653 May 24 15:43:26.867141 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1408/2824] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:26 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:27.329667 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-2dc8380e-1fba-4dc9-a647-3f89568aa0d5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:27.330224 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-2dc8380e-1fba-4dc9-a647-3f89568aa0d5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:27.336694 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2dc8380e-1fba-4dc9-a647-3f89568aa0d5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:27.337138 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2dc8380e-1fba-4dc9-a647-3f89568aa0d5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:27.337887 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2dc8380e-1fba-4dc9-a647-3f89568aa0d5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:27.338937 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2dc8380e-1fba-4dc9-a647-3f89568aa0d5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:27.462942 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-2dc8380e-1fba-4dc9-a647-3f89568aa0d5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:27.471487 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-2dc8380e-1fba-4dc9-a647-3f89568aa0d5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.145730 May 24 15:43:27.472084 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1417/2825] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:27 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:27.883438 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-71b8c96d-ea38-46a4-a539-02522a64de96 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:27.884195 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-71b8c96d-ea38-46a4-a539-02522a64de96 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:27.886662 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_api:SELECT=54 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:43:27.891874 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-71b8c96d-ea38-46a4-a539-02522a64de96 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:27.892338 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-71b8c96d-ea38-46a4-a539-02522a64de96 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:27.893107 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-71b8c96d-ea38-46a4-a539-02522a64de96 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:27.893540 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-71b8c96d-ea38-46a4-a539-02522a64de96 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:28.024207 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-71b8c96d-ea38-46a4-a539-02522a64de96 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:28.032112 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-71b8c96d-ea38-46a4-a539-02522a64de96 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.152583 May 24 15:43:28.032710 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1409/2826] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:27 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:28.488341 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-98e5348c-067c-4cdb-9cc9-61010654d630 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:28.488949 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-98e5348c-067c-4cdb-9cc9-61010654d630 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:28.495674 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-98e5348c-067c-4cdb-9cc9-61010654d630 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:28.496117 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-98e5348c-067c-4cdb-9cc9-61010654d630 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:28.496910 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-98e5348c-067c-4cdb-9cc9-61010654d630 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:28.497343 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-98e5348c-067c-4cdb-9cc9-61010654d630 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:28.622572 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-98e5348c-067c-4cdb-9cc9-61010654d630 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:28.630437 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-98e5348c-067c-4cdb-9cc9-61010654d630 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.146133 May 24 15:43:28.631001 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1418/2827] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:28 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:29.048832 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d00c2601-8cc6-4df9-90e9-7cdeb1c18d04 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:29.049451 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d00c2601-8cc6-4df9-90e9-7cdeb1c18d04 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:29.056131 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d00c2601-8cc6-4df9-90e9-7cdeb1c18d04 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:29.056594 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d00c2601-8cc6-4df9-90e9-7cdeb1c18d04 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:29.057890 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d00c2601-8cc6-4df9-90e9-7cdeb1c18d04 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:29.058329 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d00c2601-8cc6-4df9-90e9-7cdeb1c18d04 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:29.185494 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-d00c2601-8cc6-4df9-90e9-7cdeb1c18d04 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:29.193648 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d00c2601-8cc6-4df9-90e9-7cdeb1c18d04 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.148668 May 24 15:43:29.194218 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1410/2828] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:29 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:29.647576 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-83a9b8a1-0729-4c79-b7ba-57b9fe6192bd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:29.648119 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-83a9b8a1-0729-4c79-b7ba-57b9fe6192bd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:29.654583 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-83a9b8a1-0729-4c79-b7ba-57b9fe6192bd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:29.655038 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-83a9b8a1-0729-4c79-b7ba-57b9fe6192bd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:29.655791 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-83a9b8a1-0729-4c79-b7ba-57b9fe6192bd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:29.656221 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-83a9b8a1-0729-4c79-b7ba-57b9fe6192bd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:29.783035 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-83a9b8a1-0729-4c79-b7ba-57b9fe6192bd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:29.790916 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-83a9b8a1-0729-4c79-b7ba-57b9fe6192bd tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.147228 May 24 15:43:29.792128 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1419/2829] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:29 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:30.211107 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-3f76777e-737f-4d95-a6a4-222ea0739a10 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:30.211722 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-3f76777e-737f-4d95-a6a4-222ea0739a10 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:30.218878 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3f76777e-737f-4d95-a6a4-222ea0739a10 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:30.219319 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3f76777e-737f-4d95-a6a4-222ea0739a10 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:30.220069 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3f76777e-737f-4d95-a6a4-222ea0739a10 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:30.220525 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3f76777e-737f-4d95-a6a4-222ea0739a10 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:30.349884 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-3f76777e-737f-4d95-a6a4-222ea0739a10 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:30.357815 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-3f76777e-737f-4d95-a6a4-222ea0739a10 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.150607 May 24 15:43:30.358378 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1411/2830] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:30 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:30.808949 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-f43a758c-50a5-4b7e-97dc-6890a11c4f5d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:30.809559 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-f43a758c-50a5-4b7e-97dc-6890a11c4f5d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:30.815918 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f43a758c-50a5-4b7e-97dc-6890a11c4f5d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:30.816396 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f43a758c-50a5-4b7e-97dc-6890a11c4f5d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:30.817141 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f43a758c-50a5-4b7e-97dc-6890a11c4f5d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:30.817568 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f43a758c-50a5-4b7e-97dc-6890a11c4f5d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:30.943784 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-f43a758c-50a5-4b7e-97dc-6890a11c4f5d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:30.951709 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-f43a758c-50a5-4b7e-97dc-6890a11c4f5d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.147333 May 24 15:43:30.952261 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1420/2831] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:30 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:31.374877 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-32df689e-485c-4de0-b2d3-85c995448ddc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:31.375408 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-32df689e-485c-4de0-b2d3-85c995448ddc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:31.381921 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-32df689e-485c-4de0-b2d3-85c995448ddc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:31.382365 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-32df689e-485c-4de0-b2d3-85c995448ddc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:31.383124 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-32df689e-485c-4de0-b2d3-85c995448ddc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:31.383553 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-32df689e-485c-4de0-b2d3-85c995448ddc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:31.510456 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-32df689e-485c-4de0-b2d3-85c995448ddc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:31.518306 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-32df689e-485c-4de0-b2d3-85c995448ddc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.147455 May 24 15:43:31.518868 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1412/2832] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:31 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:43:31.969087 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-dd1622c7-9448-4038-aa28-46eabf078eaf tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:31.969729 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-dd1622c7-9448-4038-aa28-46eabf078eaf tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:31.976718 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dd1622c7-9448-4038-aa28-46eabf078eaf tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:31.977159 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dd1622c7-9448-4038-aa28-46eabf078eaf tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:31.977901 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dd1622c7-9448-4038-aa28-46eabf078eaf tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:31.978326 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dd1622c7-9448-4038-aa28-46eabf078eaf tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:32.102823 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-dd1622c7-9448-4038-aa28-46eabf078eaf tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:32.110631 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-dd1622c7-9448-4038-aa28-46eabf078eaf tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.145485 May 24 15:43:32.111188 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1421/2833] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:31 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:32.535544 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-07e8c4bf-b8a7-49c2-a710-24f41eafe18e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:32.536161 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-07e8c4bf-b8a7-49c2-a710-24f41eafe18e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:32.543204 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-07e8c4bf-b8a7-49c2-a710-24f41eafe18e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:32.543654 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-07e8c4bf-b8a7-49c2-a710-24f41eafe18e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:32.544449 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-07e8c4bf-b8a7-49c2-a710-24f41eafe18e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:32.544885 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-07e8c4bf-b8a7-49c2-a710-24f41eafe18e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:32.670538 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-07e8c4bf-b8a7-49c2-a710-24f41eafe18e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:32.678739 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-07e8c4bf-b8a7-49c2-a710-24f41eafe18e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.147119 May 24 15:43:32.679307 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1413/2834] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:32 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:33.127787 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-6885b774-97dd-4407-86e1-a565c914c02d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:33.128416 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-6885b774-97dd-4407-86e1-a565c914c02d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:33.135401 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6885b774-97dd-4407-86e1-a565c914c02d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:33.135841 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6885b774-97dd-4407-86e1-a565c914c02d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:33.136602 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6885b774-97dd-4407-86e1-a565c914c02d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:33.137030 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6885b774-97dd-4407-86e1-a565c914c02d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:33.266551 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-6885b774-97dd-4407-86e1-a565c914c02d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:33.274329 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-6885b774-97dd-4407-86e1-a565c914c02d tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.150171 May 24 15:43:33.274888 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1422/2835] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:33 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:33.695938 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-792bb455-31e0-4e79-ab94-493d11de97f6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:33.696619 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-792bb455-31e0-4e79-ab94-493d11de97f6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:33.703667 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-792bb455-31e0-4e79-ab94-493d11de97f6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:33.704111 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-792bb455-31e0-4e79-ab94-493d11de97f6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:33.704903 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-792bb455-31e0-4e79-ab94-493d11de97f6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:33.705335 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-792bb455-31e0-4e79-ab94-493d11de97f6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:33.836159 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-792bb455-31e0-4e79-ab94-493d11de97f6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:33.844101 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-792bb455-31e0-4e79-ab94-493d11de97f6 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.152020 May 24 15:43:33.844689 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1414/2836] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:33 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:34.292509 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-18f552f3-2118-4f1e-9eed-629721512507 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:34.293109 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-18f552f3-2118-4f1e-9eed-629721512507 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:34.299656 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-18f552f3-2118-4f1e-9eed-629721512507 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:34.300099 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-18f552f3-2118-4f1e-9eed-629721512507 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:34.300877 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-18f552f3-2118-4f1e-9eed-629721512507 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:34.301309 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-18f552f3-2118-4f1e-9eed-629721512507 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:34.426000 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-18f552f3-2118-4f1e-9eed-629721512507 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:34.433957 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-18f552f3-2118-4f1e-9eed-629721512507 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.145967 May 24 15:43:34.434524 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1423/2837] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:34 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:34.860732 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-2df35e28-33bb-4514-9787-e0bf65eca4f7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:34.861426 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-2df35e28-33bb-4514-9787-e0bf65eca4f7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:34.868206 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2df35e28-33bb-4514-9787-e0bf65eca4f7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:34.868690 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2df35e28-33bb-4514-9787-e0bf65eca4f7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:34.869446 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2df35e28-33bb-4514-9787-e0bf65eca4f7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:34.869885 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2df35e28-33bb-4514-9787-e0bf65eca4f7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:35.000129 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-2df35e28-33bb-4514-9787-e0bf65eca4f7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:35.008095 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-2df35e28-33bb-4514-9787-e0bf65eca4f7 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.151208 May 24 15:43:35.008698 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1415/2838] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:34 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:35.450690 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-2d27b09b-4529-4a73-8ab4-c5cab350000e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:35.451304 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-2d27b09b-4529-4a73-8ab4-c5cab350000e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:35.457884 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2d27b09b-4529-4a73-8ab4-c5cab350000e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:35.458337 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2d27b09b-4529-4a73-8ab4-c5cab350000e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:35.459096 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2d27b09b-4529-4a73-8ab4-c5cab350000e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:35.459534 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2d27b09b-4529-4a73-8ab4-c5cab350000e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:35.585921 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-2d27b09b-4529-4a73-8ab4-c5cab350000e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:35.593836 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-2d27b09b-4529-4a73-8ab4-c5cab350000e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.146996 May 24 15:43:35.594401 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1424/2839] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:35 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:36.025940 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-348c29e7-bd4e-4e01-95aa-5d573e84cabb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:36.026579 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-348c29e7-bd4e-4e01-95aa-5d573e84cabb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:36.033239 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-348c29e7-bd4e-4e01-95aa-5d573e84cabb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:36.033678 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-348c29e7-bd4e-4e01-95aa-5d573e84cabb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:36.034427 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-348c29e7-bd4e-4e01-95aa-5d573e84cabb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:36.034853 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-348c29e7-bd4e-4e01-95aa-5d573e84cabb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:36.163290 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-348c29e7-bd4e-4e01-95aa-5d573e84cabb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:36.171116 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-348c29e7-bd4e-4e01-95aa-5d573e84cabb tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.149486 May 24 15:43:36.171676 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1416/2840] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:36 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:36.203746 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 15:43:36.203925 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Tue May 24 15:43:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 15:43:36.610473 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-052f8a2c-4202-402b-8065-f12cc850941b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:36.611072 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-052f8a2c-4202-402b-8065-f12cc850941b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:36.617774 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-052f8a2c-4202-402b-8065-f12cc850941b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:36.618214 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-052f8a2c-4202-402b-8065-f12cc850941b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:36.618971 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-052f8a2c-4202-402b-8065-f12cc850941b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:36.619931 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-052f8a2c-4202-402b-8065-f12cc850941b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:36.745423 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-052f8a2c-4202-402b-8065-f12cc850941b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:36.753248 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-052f8a2c-4202-402b-8065-f12cc850941b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.146627 May 24 15:43:36.753801 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1425/2841] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:36 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:37.188630 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-fa68b9dd-e578-4e19-ac39-df3845290486 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:37.189262 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-fa68b9dd-e578-4e19-ac39-df3845290486 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:37.195784 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fa68b9dd-e578-4e19-ac39-df3845290486 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:37.196223 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fa68b9dd-e578-4e19-ac39-df3845290486 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:37.196998 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fa68b9dd-e578-4e19-ac39-df3845290486 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:37.197423 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fa68b9dd-e578-4e19-ac39-df3845290486 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:37.321378 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-fa68b9dd-e578-4e19-ac39-df3845290486 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:37.329464 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-fa68b9dd-e578-4e19-ac39-df3845290486 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.144736 May 24 15:43:37.330020 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1417/2842] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:37 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:37.770571 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d20ac11a-5c45-4b51-aa29-f3e8ed6d5969 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:37.771210 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d20ac11a-5c45-4b51-aa29-f3e8ed6d5969 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:37.778318 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d20ac11a-5c45-4b51-aa29-f3e8ed6d5969 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:37.778758 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d20ac11a-5c45-4b51-aa29-f3e8ed6d5969 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:37.779501 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d20ac11a-5c45-4b51-aa29-f3e8ed6d5969 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:37.779951 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d20ac11a-5c45-4b51-aa29-f3e8ed6d5969 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:37.907090 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-d20ac11a-5c45-4b51-aa29-f3e8ed6d5969 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:37.914860 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d20ac11a-5c45-4b51-aa29-f3e8ed6d5969 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.148165 May 24 15:43:37.915416 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1426/2843] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:37 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:38.346721 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-4b639c39-8f2c-4f2c-9dea-031b088126e5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:38.347258 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-4b639c39-8f2c-4f2c-9dea-031b088126e5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:38.354247 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4b639c39-8f2c-4f2c-9dea-031b088126e5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:38.354687 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4b639c39-8f2c-4f2c-9dea-031b088126e5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:38.355432 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4b639c39-8f2c-4f2c-9dea-031b088126e5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:38.355855 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4b639c39-8f2c-4f2c-9dea-031b088126e5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:38.483902 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-4b639c39-8f2c-4f2c-9dea-031b088126e5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:38.491983 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-4b639c39-8f2c-4f2c-9dea-031b088126e5 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.148883 May 24 15:43:38.492586 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1418/2844] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:38 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:38.931911 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-f0e6cc01-bc02-43ca-8d03-f4d6173bc206 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:38.932737 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-f0e6cc01-bc02-43ca-8d03-f4d6173bc206 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:38.939402 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f0e6cc01-bc02-43ca-8d03-f4d6173bc206 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:38.939934 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f0e6cc01-bc02-43ca-8d03-f4d6173bc206 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:38.940838 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f0e6cc01-bc02-43ca-8d03-f4d6173bc206 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:38.941271 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f0e6cc01-bc02-43ca-8d03-f4d6173bc206 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:39.069391 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-f0e6cc01-bc02-43ca-8d03-f4d6173bc206 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:39.077535 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-f0e6cc01-bc02-43ca-8d03-f4d6173bc206 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.150413 May 24 15:43:39.078097 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1427/2845] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:38 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:39.509409 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-7b5b7707-75f5-4708-ab73-c974eb8b52bc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:39.510612 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-7b5b7707-75f5-4708-ab73-c974eb8b52bc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:39.517038 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7b5b7707-75f5-4708-ab73-c974eb8b52bc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:39.517479 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7b5b7707-75f5-4708-ab73-c974eb8b52bc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:39.518223 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7b5b7707-75f5-4708-ab73-c974eb8b52bc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:39.518648 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7b5b7707-75f5-4708-ab73-c974eb8b52bc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:39.642739 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-7b5b7707-75f5-4708-ab73-c974eb8b52bc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:39.650757 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-7b5b7707-75f5-4708-ab73-c974eb8b52bc tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.145010 May 24 15:43:39.651324 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1419/2846] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:39 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:40.094986 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d133ebc8-cbf4-4377-81e7-90a163ac3e7c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:40.095602 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d133ebc8-cbf4-4377-81e7-90a163ac3e7c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:40.101671 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d133ebc8-cbf4-4377-81e7-90a163ac3e7c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:40.102120 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d133ebc8-cbf4-4377-81e7-90a163ac3e7c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:40.102879 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d133ebc8-cbf4-4377-81e7-90a163ac3e7c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:40.103318 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d133ebc8-cbf4-4377-81e7-90a163ac3e7c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:40.230128 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-d133ebc8-cbf4-4377-81e7-90a163ac3e7c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:40.237984 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d133ebc8-cbf4-4377-81e7-90a163ac3e7c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.147001 May 24 15:43:40.238562 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1428/2847] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:40 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:40.666811 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-eaabbde9-0d04-4fcc-bbf7-e404f44df255 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:40.667416 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-eaabbde9-0d04-4fcc-bbf7-e404f44df255 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:40.673987 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-eaabbde9-0d04-4fcc-bbf7-e404f44df255 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:40.674427 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-eaabbde9-0d04-4fcc-bbf7-e404f44df255 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:40.675176 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-eaabbde9-0d04-4fcc-bbf7-e404f44df255 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:40.675607 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-eaabbde9-0d04-4fcc-bbf7-e404f44df255 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:40.802733 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-eaabbde9-0d04-4fcc-bbf7-e404f44df255 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:40.811106 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-eaabbde9-0d04-4fcc-bbf7-e404f44df255 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.148143 May 24 15:43:40.811666 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1420/2848] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:40 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:41.254801 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-69d60224-be3a-416e-8416-f12cb9facaf0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:41.255402 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-69d60224-be3a-416e-8416-f12cb9facaf0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:41.262452 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-69d60224-be3a-416e-8416-f12cb9facaf0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:41.262921 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-69d60224-be3a-416e-8416-f12cb9facaf0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:41.263663 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-69d60224-be3a-416e-8416-f12cb9facaf0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:41.264086 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-69d60224-be3a-416e-8416-f12cb9facaf0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:41.392889 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-69d60224-be3a-416e-8416-f12cb9facaf0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:41.400816 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-69d60224-be3a-416e-8416-f12cb9facaf0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.149789 May 24 15:43:41.401378 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1429/2849] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:41 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:41.827964 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-81f178f0-4f7c-43d5-ab59-479551046fa8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:41.828565 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-81f178f0-4f7c-43d5-ab59-479551046fa8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:41.834980 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-81f178f0-4f7c-43d5-ab59-479551046fa8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:41.835422 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-81f178f0-4f7c-43d5-ab59-479551046fa8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:41.836164 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-81f178f0-4f7c-43d5-ab59-479551046fa8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:41.836625 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-81f178f0-4f7c-43d5-ab59-479551046fa8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:41.838910 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 15:43:41.839052 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Tue May 24 15:43:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 15:43:41.966564 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-81f178f0-4f7c-43d5-ab59-479551046fa8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:41.974370 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-81f178f0-4f7c-43d5-ab59-479551046fa8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.150222 May 24 15:43:41.974938 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1421/2850] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:41 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:42.417564 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-cabad9fe-23e6-4e54-aa18-75ec8657285c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:42.418111 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-cabad9fe-23e6-4e54-aa18-75ec8657285c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:42.424712 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cabad9fe-23e6-4e54-aa18-75ec8657285c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:42.425158 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cabad9fe-23e6-4e54-aa18-75ec8657285c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:42.425911 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cabad9fe-23e6-4e54-aa18-75ec8657285c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:42.426344 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cabad9fe-23e6-4e54-aa18-75ec8657285c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:42.551431 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-cabad9fe-23e6-4e54-aa18-75ec8657285c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:42.559894 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-cabad9fe-23e6-4e54-aa18-75ec8657285c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.146288 May 24 15:43:42.560477 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1430/2851] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:42 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:42.992033 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-6bf0f35e-bf04-40fd-bbba-f5acd9054e6b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:42.992662 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-6bf0f35e-bf04-40fd-bbba-f5acd9054e6b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:42.999274 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6bf0f35e-bf04-40fd-bbba-f5acd9054e6b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:42.999726 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6bf0f35e-bf04-40fd-bbba-f5acd9054e6b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:43.000516 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6bf0f35e-bf04-40fd-bbba-f5acd9054e6b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:43.000955 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6bf0f35e-bf04-40fd-bbba-f5acd9054e6b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:43.127089 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-6bf0f35e-bf04-40fd-bbba-f5acd9054e6b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:43.135503 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-6bf0f35e-bf04-40fd-bbba-f5acd9054e6b tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.147082 May 24 15:43:43.136066 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1422/2852] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:42 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:43.577336 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-2423841c-334b-4cfb-95ee-969eb70a139c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:43.577971 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-2423841c-334b-4cfb-95ee-969eb70a139c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:43.584480 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2423841c-334b-4cfb-95ee-969eb70a139c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:43.584924 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2423841c-334b-4cfb-95ee-969eb70a139c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:43.585676 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2423841c-334b-4cfb-95ee-969eb70a139c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:43.586107 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2423841c-334b-4cfb-95ee-969eb70a139c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:43.713381 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-2423841c-334b-4cfb-95ee-969eb70a139c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:43.721320 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-2423841c-334b-4cfb-95ee-969eb70a139c tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.147848 May 24 15:43:43.721891 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1431/2853] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:43 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:43:44.152119 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-354e0129-a612-47f1-bc22-c1fe577ebdaf tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:44.152769 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-354e0129-a612-47f1-bc22-c1fe577ebdaf tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:44.159296 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-354e0129-a612-47f1-bc22-c1fe577ebdaf tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:44.159742 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-354e0129-a612-47f1-bc22-c1fe577ebdaf tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:44.160543 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-354e0129-a612-47f1-bc22-c1fe577ebdaf tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:44.160977 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-354e0129-a612-47f1-bc22-c1fe577ebdaf tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:44.288126 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-354e0129-a612-47f1-bc22-c1fe577ebdaf tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:44.296741 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-354e0129-a612-47f1-bc22-c1fe577ebdaf tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.148886 May 24 15:43:44.297309 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1423/2854] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:44 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:44.738473 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-fb5e9566-bb1f-4991-89d7-dafc3b8fafb4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:44.739086 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-fb5e9566-bb1f-4991-89d7-dafc3b8fafb4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:44.746486 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fb5e9566-bb1f-4991-89d7-dafc3b8fafb4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:44.746934 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fb5e9566-bb1f-4991-89d7-dafc3b8fafb4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:44.747683 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fb5e9566-bb1f-4991-89d7-dafc3b8fafb4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:44.748114 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-fb5e9566-bb1f-4991-89d7-dafc3b8fafb4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:44.766004 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=100 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:43:44.878875 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-fb5e9566-bb1f-4991-89d7-dafc3b8fafb4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:44.887468 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-fb5e9566-bb1f-4991-89d7-dafc3b8fafb4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.152833 May 24 15:43:44.888013 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1432/2855] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:44 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:45.314086 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-4312905a-e383-4866-aadb-015aa86dcc28 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:45.314702 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-4312905a-e383-4866-aadb-015aa86dcc28 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:45.321371 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4312905a-e383-4866-aadb-015aa86dcc28 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:45.321772 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4312905a-e383-4866-aadb-015aa86dcc28 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:45.322529 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4312905a-e383-4866-aadb-015aa86dcc28 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:45.322968 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4312905a-e383-4866-aadb-015aa86dcc28 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:45.326878 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:43:45.449299 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-4312905a-e383-4866-aadb-015aa86dcc28 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:45.457125 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-4312905a-e383-4866-aadb-015aa86dcc28 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.146898 May 24 15:43:45.457704 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1424/2856] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:45 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:45.904721 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-1df521a4-a6c5-405b-80b5-3ae0df52f2d6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:45.905271 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-1df521a4-a6c5-405b-80b5-3ae0df52f2d6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:45.911629 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1df521a4-a6c5-405b-80b5-3ae0df52f2d6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:45.912069 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1df521a4-a6c5-405b-80b5-3ae0df52f2d6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:45.912855 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1df521a4-a6c5-405b-80b5-3ae0df52f2d6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:45.913277 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1df521a4-a6c5-405b-80b5-3ae0df52f2d6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:46.037695 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-1df521a4-a6c5-405b-80b5-3ae0df52f2d6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:46.045603 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-1df521a4-a6c5-405b-80b5-3ae0df52f2d6 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.145383 May 24 15:43:46.046160 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1433/2857] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:45 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:46.474350 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-37f0ba0d-851f-41d5-96ca-febc1a044c8e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:46.474992 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-37f0ba0d-851f-41d5-96ca-febc1a044c8e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:46.481537 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-37f0ba0d-851f-41d5-96ca-febc1a044c8e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:46.481977 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-37f0ba0d-851f-41d5-96ca-febc1a044c8e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:46.482726 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-37f0ba0d-851f-41d5-96ca-febc1a044c8e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:46.483156 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-37f0ba0d-851f-41d5-96ca-febc1a044c8e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:46.607563 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-37f0ba0d-851f-41d5-96ca-febc1a044c8e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:46.615420 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-37f0ba0d-851f-41d5-96ca-febc1a044c8e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.144912 May 24 15:43:46.615985 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1425/2858] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:46 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:47.061622 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-035440f7-3aba-4416-b63e-7e901f0fc9fe tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:47.062299 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-035440f7-3aba-4416-b63e-7e901f0fc9fe tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:47.070506 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-035440f7-3aba-4416-b63e-7e901f0fc9fe tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:47.070948 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-035440f7-3aba-4416-b63e-7e901f0fc9fe tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:47.071719 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-035440f7-3aba-4416-b63e-7e901f0fc9fe tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:47.072157 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-035440f7-3aba-4416-b63e-7e901f0fc9fe tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:47.214458 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-035440f7-3aba-4416-b63e-7e901f0fc9fe tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:47.222536 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-035440f7-3aba-4416-b63e-7e901f0fc9fe tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.164917 May 24 15:43:47.223089 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1434/2859] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:47 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:47.633159 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-06769b2b-db5e-4e35-8fa5-ef4539d6bb5a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:47.633771 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-06769b2b-db5e-4e35-8fa5-ef4539d6bb5a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:47.640776 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-06769b2b-db5e-4e35-8fa5-ef4539d6bb5a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:47.641220 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-06769b2b-db5e-4e35-8fa5-ef4539d6bb5a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:47.641967 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-06769b2b-db5e-4e35-8fa5-ef4539d6bb5a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:47.642675 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-06769b2b-db5e-4e35-8fa5-ef4539d6bb5a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:47.772604 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-06769b2b-db5e-4e35-8fa5-ef4539d6bb5a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:47.781206 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-06769b2b-db5e-4e35-8fa5-ef4539d6bb5a tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.151812 May 24 15:43:47.781774 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1426/2860] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:47 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:48.240316 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-4dfada6f-fa8d-4ff1-a921-a3650736664e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:48.240932 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-4dfada6f-fa8d-4ff1-a921-a3650736664e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:48.248331 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4dfada6f-fa8d-4ff1-a921-a3650736664e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:48.248795 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4dfada6f-fa8d-4ff1-a921-a3650736664e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:48.249580 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4dfada6f-fa8d-4ff1-a921-a3650736664e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:48.250014 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4dfada6f-fa8d-4ff1-a921-a3650736664e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:48.377123 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-4dfada6f-fa8d-4ff1-a921-a3650736664e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:48.385088 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-4dfada6f-fa8d-4ff1-a921-a3650736664e tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.148639 May 24 15:43:48.385646 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1435/2861] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:48 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:48.798135 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-c0710a5b-138e-4891-ab18-9324c4cb2645 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:48.798736 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-c0710a5b-138e-4891-ab18-9324c4cb2645 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:48.805274 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c0710a5b-138e-4891-ab18-9324c4cb2645 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:48.805721 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c0710a5b-138e-4891-ab18-9324c4cb2645 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:48.806480 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c0710a5b-138e-4891-ab18-9324c4cb2645 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:48.806910 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c0710a5b-138e-4891-ab18-9324c4cb2645 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:48.930137 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-c0710a5b-138e-4891-ab18-9324c4cb2645 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:48.938585 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-c0710a5b-138e-4891-ab18-9324c4cb2645 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.144280 May 24 15:43:48.939283 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1427/2862] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:48 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:49.401947 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-8db56768-86ae-40e2-91bc-7d578ebb6688 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:49.402489 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-8db56768-86ae-40e2-91bc-7d578ebb6688 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:49.409013 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8db56768-86ae-40e2-91bc-7d578ebb6688 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:49.409489 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8db56768-86ae-40e2-91bc-7d578ebb6688 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:49.410241 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8db56768-86ae-40e2-91bc-7d578ebb6688 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:49.410693 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8db56768-86ae-40e2-91bc-7d578ebb6688 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:49.538052 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-8db56768-86ae-40e2-91bc-7d578ebb6688 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:49.546064 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-8db56768-86ae-40e2-91bc-7d578ebb6688 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.148056 May 24 15:43:49.546626 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1436/2863] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:49 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:49.955974 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-8c072511-4c75-415c-83e1-aa72d2539a66 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:49.956603 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-8c072511-4c75-415c-83e1-aa72d2539a66 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:49.963564 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8c072511-4c75-415c-83e1-aa72d2539a66 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:49.964003 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8c072511-4c75-415c-83e1-aa72d2539a66 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:49.964778 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8c072511-4c75-415c-83e1-aa72d2539a66 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:49.965204 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8c072511-4c75-415c-83e1-aa72d2539a66 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:50.096424 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-8c072511-4c75-415c-83e1-aa72d2539a66 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:50.104886 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-8c072511-4c75-415c-83e1-aa72d2539a66 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.152763 May 24 15:43:50.105450 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1428/2864] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:49 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:43:50.562799 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-67204cbf-71c3-4258-85eb-4572dd402c70 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:50.563407 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-67204cbf-71c3-4258-85eb-4572dd402c70 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:50.570002 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-67204cbf-71c3-4258-85eb-4572dd402c70 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:50.570446 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-67204cbf-71c3-4258-85eb-4572dd402c70 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:50.571201 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-67204cbf-71c3-4258-85eb-4572dd402c70 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:50.571638 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-67204cbf-71c3-4258-85eb-4572dd402c70 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:50.697477 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-67204cbf-71c3-4258-85eb-4572dd402c70 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:50.705554 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-67204cbf-71c3-4258-85eb-4572dd402c70 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.146567 May 24 15:43:50.706112 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1437/2865] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:50 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:51.122099 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-2ceece8c-7554-412c-a822-7a3fdeb7580f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:51.122709 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-2ceece8c-7554-412c-a822-7a3fdeb7580f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:51.129725 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2ceece8c-7554-412c-a822-7a3fdeb7580f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:51.130238 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2ceece8c-7554-412c-a822-7a3fdeb7580f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:51.131066 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2ceece8c-7554-412c-a822-7a3fdeb7580f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:51.131522 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2ceece8c-7554-412c-a822-7a3fdeb7580f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:51.257703 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-2ceece8c-7554-412c-a822-7a3fdeb7580f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:51.265566 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-2ceece8c-7554-412c-a822-7a3fdeb7580f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.147988 May 24 15:43:51.266126 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1429/2866] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:51 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:51.722243 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-1ac01376-cf55-49ae-af40-08a19a164aae tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:51.722850 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-1ac01376-cf55-49ae-af40-08a19a164aae tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:51.725191 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_api:SELECT=52 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:43:51.730600 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1ac01376-cf55-49ae-af40-08a19a164aae tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:51.731045 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1ac01376-cf55-49ae-af40-08a19a164aae tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:51.731792 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1ac01376-cf55-49ae-af40-08a19a164aae tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:51.732226 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1ac01376-cf55-49ae-af40-08a19a164aae tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:51.859974 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-1ac01376-cf55-49ae-af40-08a19a164aae tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:51.868108 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-1ac01376-cf55-49ae-af40-08a19a164aae tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.149717 May 24 15:43:51.868702 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1438/2867] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:51 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:52.282253 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-c0498894-ce98-47a9-8a64-5cec5f3478ed tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:52.282857 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-c0498894-ce98-47a9-8a64-5cec5f3478ed tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:52.289608 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c0498894-ce98-47a9-8a64-5cec5f3478ed tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:52.290042 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c0498894-ce98-47a9-8a64-5cec5f3478ed tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:52.291400 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c0498894-ce98-47a9-8a64-5cec5f3478ed tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:52.291829 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c0498894-ce98-47a9-8a64-5cec5f3478ed tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:52.419726 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-c0498894-ce98-47a9-8a64-5cec5f3478ed tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:52.427597 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-c0498894-ce98-47a9-8a64-5cec5f3478ed tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.149176 May 24 15:43:52.428156 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1430/2868] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:52 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:52.886013 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-46901913-985c-4271-9ca8-b388d9b87471 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:52.886572 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-46901913-985c-4271-9ca8-b388d9b87471 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:52.893266 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-46901913-985c-4271-9ca8-b388d9b87471 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:52.893719 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-46901913-985c-4271-9ca8-b388d9b87471 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:52.894478 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-46901913-985c-4271-9ca8-b388d9b87471 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:52.894917 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-46901913-985c-4271-9ca8-b388d9b87471 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:53.019008 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-46901913-985c-4271-9ca8-b388d9b87471 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:53.026902 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-46901913-985c-4271-9ca8-b388d9b87471 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.145367 May 24 15:43:53.027468 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1439/2869] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:52 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:53.444093 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-06874d26-5799-4910-8afa-3ae6e32f5fb8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:53.444795 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-06874d26-5799-4910-8afa-3ae6e32f5fb8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:53.451283 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-06874d26-5799-4910-8afa-3ae6e32f5fb8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:53.451725 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-06874d26-5799-4910-8afa-3ae6e32f5fb8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:53.452509 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-06874d26-5799-4910-8afa-3ae6e32f5fb8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:53.452942 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-06874d26-5799-4910-8afa-3ae6e32f5fb8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:53.577905 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-06874d26-5799-4910-8afa-3ae6e32f5fb8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:53.585700 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-06874d26-5799-4910-8afa-3ae6e32f5fb8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.145614 May 24 15:43:53.586262 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1431/2870] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:53 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:54.043444 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c984306c-099d-4100-a8d2-856ab8a5d45f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:54.044046 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-c984306c-099d-4100-a8d2-856ab8a5d45f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:54.050541 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c984306c-099d-4100-a8d2-856ab8a5d45f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:54.050990 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c984306c-099d-4100-a8d2-856ab8a5d45f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:54.051764 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c984306c-099d-4100-a8d2-856ab8a5d45f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:54.052200 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c984306c-099d-4100-a8d2-856ab8a5d45f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:54.176134 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-c984306c-099d-4100-a8d2-856ab8a5d45f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:54.184016 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-c984306c-099d-4100-a8d2-856ab8a5d45f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.145038 May 24 15:43:54.184607 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1440/2871] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:54 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:54.602425 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-ae3b1df2-6e3c-44bd-95b8-a275d5163842 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:54.603029 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-ae3b1df2-6e3c-44bd-95b8-a275d5163842 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:54.609889 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ae3b1df2-6e3c-44bd-95b8-a275d5163842 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:54.610325 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ae3b1df2-6e3c-44bd-95b8-a275d5163842 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:54.611065 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ae3b1df2-6e3c-44bd-95b8-a275d5163842 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:54.611572 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ae3b1df2-6e3c-44bd-95b8-a275d5163842 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:54.738061 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-ae3b1df2-6e3c-44bd-95b8-a275d5163842 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:54.746829 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-ae3b1df2-6e3c-44bd-95b8-a275d5163842 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.148269 May 24 15:43:54.747438 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1432/2872] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:54 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:55.200054 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e40ee06f-d526-41b4-88a2-e68017295168 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:55.200705 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e40ee06f-d526-41b4-88a2-e68017295168 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:55.207347 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e40ee06f-d526-41b4-88a2-e68017295168 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:55.207797 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e40ee06f-d526-41b4-88a2-e68017295168 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:55.208592 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e40ee06f-d526-41b4-88a2-e68017295168 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:55.209031 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e40ee06f-d526-41b4-88a2-e68017295168 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:55.338900 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e40ee06f-d526-41b4-88a2-e68017295168 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:55.346826 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e40ee06f-d526-41b4-88a2-e68017295168 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.150622 May 24 15:43:55.347391 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1441/2873] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:55 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:55.763746 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-13be7b39-0ffc-4793-a7d7-07043da9f1e1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:55.764373 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-13be7b39-0ffc-4793-a7d7-07043da9f1e1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:55.770913 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-13be7b39-0ffc-4793-a7d7-07043da9f1e1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:55.771356 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-13be7b39-0ffc-4793-a7d7-07043da9f1e1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:55.772103 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-13be7b39-0ffc-4793-a7d7-07043da9f1e1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:55.772571 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-13be7b39-0ffc-4793-a7d7-07043da9f1e1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:55.901308 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-13be7b39-0ffc-4793-a7d7-07043da9f1e1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:55.909142 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-13be7b39-0ffc-4793-a7d7-07043da9f1e1 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.149298 May 24 15:43:55.909701 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1433/2874] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:55 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:56.364258 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-1901d9fb-f0da-4864-b828-ccbca9f9b3ce tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:56.364822 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-1901d9fb-f0da-4864-b828-ccbca9f9b3ce tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:56.372213 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1901d9fb-f0da-4864-b828-ccbca9f9b3ce tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:56.372688 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1901d9fb-f0da-4864-b828-ccbca9f9b3ce tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:56.373444 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1901d9fb-f0da-4864-b828-ccbca9f9b3ce tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:56.373879 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1901d9fb-f0da-4864-b828-ccbca9f9b3ce tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:56.497737 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-1901d9fb-f0da-4864-b828-ccbca9f9b3ce tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:56.505614 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-1901d9fb-f0da-4864-b828-ccbca9f9b3ce tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.145231 May 24 15:43:56.506161 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1442/2875] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:56 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:56.925475 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d7518a06-c50c-4d97-9b37-9c305ba85f0c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:56.926245 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d7518a06-c50c-4d97-9b37-9c305ba85f0c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:56.932800 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d7518a06-c50c-4d97-9b37-9c305ba85f0c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:56.933238 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d7518a06-c50c-4d97-9b37-9c305ba85f0c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:56.933989 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d7518a06-c50c-4d97-9b37-9c305ba85f0c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:56.934417 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d7518a06-c50c-4d97-9b37-9c305ba85f0c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:57.059649 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-d7518a06-c50c-4d97-9b37-9c305ba85f0c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:57.067781 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d7518a06-c50c-4d97-9b37-9c305ba85f0c tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.146196 May 24 15:43:57.068584 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1434/2876] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:56 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:57.522842 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c41bb410-c136-4a9b-b310-866a941ef604 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:57.523452 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-c41bb410-c136-4a9b-b310-866a941ef604 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:57.530073 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c41bb410-c136-4a9b-b310-866a941ef604 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:57.530467 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c41bb410-c136-4a9b-b310-866a941ef604 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:57.531227 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c41bb410-c136-4a9b-b310-866a941ef604 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:57.531661 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c41bb410-c136-4a9b-b310-866a941ef604 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:57.658702 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-c41bb410-c136-4a9b-b310-866a941ef604 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:57.666586 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-c41bb410-c136-4a9b-b310-866a941ef604 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.147611 May 24 15:43:57.667135 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1443/2877] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:57 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:58.084819 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-5448df73-b346-4f04-bb6e-884cc9ea8bbe tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:58.085434 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-5448df73-b346-4f04-bb6e-884cc9ea8bbe tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:58.088467 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_api:SELECT=52 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:43:58.093896 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5448df73-b346-4f04-bb6e-884cc9ea8bbe tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:58.094337 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5448df73-b346-4f04-bb6e-884cc9ea8bbe tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:58.095094 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5448df73-b346-4f04-bb6e-884cc9ea8bbe tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:58.095528 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5448df73-b346-4f04-bb6e-884cc9ea8bbe tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:58.222801 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-5448df73-b346-4f04-bb6e-884cc9ea8bbe tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:58.230662 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-5448df73-b346-4f04-bb6e-884cc9ea8bbe tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.149671 May 24 15:43:58.231227 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1435/2878] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:58 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:58.683867 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-2b18dabf-27f7-4f3e-a981-871087b4cb70 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:58.684433 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-2b18dabf-27f7-4f3e-a981-871087b4cb70 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:58.690848 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2b18dabf-27f7-4f3e-a981-871087b4cb70 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:58.691290 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2b18dabf-27f7-4f3e-a981-871087b4cb70 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:58.692033 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2b18dabf-27f7-4f3e-a981-871087b4cb70 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:58.692497 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2b18dabf-27f7-4f3e-a981-871087b4cb70 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:58.821584 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-2b18dabf-27f7-4f3e-a981-871087b4cb70 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:58.829785 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-2b18dabf-27f7-4f3e-a981-871087b4cb70 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.150442 May 24 15:43:58.830340 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1444/2879] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:58 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:59.247587 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-66e52703-27ef-475a-91bd-7f20b5f89abd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:59.248197 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-66e52703-27ef-475a-91bd-7f20b5f89abd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:59.254711 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-66e52703-27ef-475a-91bd-7f20b5f89abd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:59.255157 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-66e52703-27ef-475a-91bd-7f20b5f89abd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:59.255907 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-66e52703-27ef-475a-91bd-7f20b5f89abd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:59.256368 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-66e52703-27ef-475a-91bd-7f20b5f89abd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:59.386163 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-66e52703-27ef-475a-91bd-7f20b5f89abd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:59.394078 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-66e52703-27ef-475a-91bd-7f20b5f89abd tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.150312 May 24 15:43:59.394639 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1436/2880] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:59 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:59.674391 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d83d9b45-7284-42a1-8f25-d4df633ce559 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:59.674810 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d83d9b45-7284-42a1-8f25-d4df633ce559 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: d8d131e6-a9cf-46ca-bd20-8fba3e295618] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:59.680975 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d83d9b45-7284-42a1-8f25-d4df633ce559 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:59.681443 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d83d9b45-7284-42a1-8f25-d4df633ce559 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:59.682226 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d83d9b45-7284-42a1-8f25-d4df633ce559 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:59.682652 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d83d9b45-7284-42a1-8f25-d4df633ce559 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:59.707313 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d83d9b45-7284-42a1-8f25-d4df633ce559 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: d8d131e6-a9cf-46ca-bd20-8fba3e295618] Going to try to terminate instance {{(pid=117698) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 15:43:59.782845 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d83d9b45-7284-42a1-8f25-d4df633ce559 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "DELETE /compute/v2.1/servers/d8d131e6-a9cf-46ca-bd20-8fba3e295618" status: 204 len: 0 microversion: 2.20 time: 0.112100 May 24 15:43:59.783487 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1445/2881] 10.222.0.45 () {60 vars in 1279 bytes} [Tue May 24 15:43:59 2022] DELETE /compute/v2.1/servers/d8d131e6-a9cf-46ca-bd20-8fba3e295618 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 24 15:43:59.791909 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-8e7706af-8105-4493-bd0b-1b65bd7db66e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:59.792578 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-8e7706af-8105-4493-bd0b-1b65bd7db66e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: d8d131e6-a9cf-46ca-bd20-8fba3e295618] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:59.798542 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8e7706af-8105-4493-bd0b-1b65bd7db66e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:59.799040 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8e7706af-8105-4493-bd0b-1b65bd7db66e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:59.799834 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8e7706af-8105-4493-bd0b-1b65bd7db66e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:59.800268 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8e7706af-8105-4493-bd0b-1b65bd7db66e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:59.847186 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-1febd1f2-210a-474a-9738-c4020fb6507b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:59.847965 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-1febd1f2-210a-474a-9738-c4020fb6507b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:59.854033 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1febd1f2-210a-474a-9738-c4020fb6507b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:59.854565 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1febd1f2-210a-474a-9738-c4020fb6507b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:59.855297 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1febd1f2-210a-474a-9738-c4020fb6507b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:59.855723 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1febd1f2-210a-474a-9738-c4020fb6507b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:59.925940 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-8e7706af-8105-4493-bd0b-1b65bd7db66e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:59.934291 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-8e7706af-8105-4493-bd0b-1b65bd7db66e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:59.935781 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-8e7706af-8105-4493-bd0b-1b65bd7db66e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:59.936960 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-8e7706af-8105-4493-bd0b-1b65bd7db66e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/d8d131e6-a9cf-46ca-bd20-8fba3e295618" status: 200 len: 1724 microversion: 2.20 time: 0.148955 May 24 15:43:59.937520 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1437/2882] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:43:59 2022] GET /compute/v2.1/servers/d8d131e6-a9cf-46ca-bd20-8fba3e295618 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:43:59.983073 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-1febd1f2-210a-474a-9738-c4020fb6507b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:59.991094 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-1febd1f2-210a-474a-9738-c4020fb6507b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.148258 May 24 15:43:59.991908 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1446/2883] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:43:59 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:44:00.410586 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-ebe38fc7-28ad-4250-aedd-da09a7a865e2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:00.411197 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-ebe38fc7-28ad-4250-aedd-da09a7a865e2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:00.418207 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ebe38fc7-28ad-4250-aedd-da09a7a865e2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:00.418643 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ebe38fc7-28ad-4250-aedd-da09a7a865e2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:00.419388 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ebe38fc7-28ad-4250-aedd-da09a7a865e2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:00.419814 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ebe38fc7-28ad-4250-aedd-da09a7a865e2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:00.546484 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-ebe38fc7-28ad-4250-aedd-da09a7a865e2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:00.554339 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-ebe38fc7-28ad-4250-aedd-da09a7a865e2 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.147602 May 24 15:44:00.554896 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1438/2884] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:44:00 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:00.955037 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-ce3d95da-28ed-486e-abb0-34b716e7861c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:00.955662 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-ce3d95da-28ed-486e-abb0-34b716e7861c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: d8d131e6-a9cf-46ca-bd20-8fba3e295618] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:00.963329 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ce3d95da-28ed-486e-abb0-34b716e7861c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:00.963781 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ce3d95da-28ed-486e-abb0-34b716e7861c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:00.964601 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ce3d95da-28ed-486e-abb0-34b716e7861c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:00.965072 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ce3d95da-28ed-486e-abb0-34b716e7861c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:00.982719 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:44:01.007818 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-16063d63-c306-4f52-bdce-a58ccadbe479 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:01.008468 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-16063d63-c306-4f52-bdce-a58ccadbe479 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:01.015010 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-16063d63-c306-4f52-bdce-a58ccadbe479 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:01.015463 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-16063d63-c306-4f52-bdce-a58ccadbe479 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:01.016337 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-16063d63-c306-4f52-bdce-a58ccadbe479 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:01.016701 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-16063d63-c306-4f52-bdce-a58ccadbe479 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:01.099425 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ce3d95da-28ed-486e-abb0-34b716e7861c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:01.107579 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ce3d95da-28ed-486e-abb0-34b716e7861c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:01.109101 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ce3d95da-28ed-486e-abb0-34b716e7861c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:01.110243 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-ce3d95da-28ed-486e-abb0-34b716e7861c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/d8d131e6-a9cf-46ca-bd20-8fba3e295618" status: 200 len: 1724 microversion: 2.20 time: 0.159111 May 24 15:44:01.110795 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1447/2885] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:44:00 2022] GET /compute/v2.1/servers/d8d131e6-a9cf-46ca-bd20-8fba3e295618 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:44:01.146228 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-16063d63-c306-4f52-bdce-a58ccadbe479 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:01.154831 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-16063d63-c306-4f52-bdce-a58ccadbe479 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.150804 May 24 15:44:01.155393 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1439/2886] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:44:01 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:44:01.570936 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-81b69733-3922-4ec8-b1ee-85337e19b438 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:01.571585 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-81b69733-3922-4ec8-b1ee-85337e19b438 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:01.578441 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-81b69733-3922-4ec8-b1ee-85337e19b438 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:01.578882 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-81b69733-3922-4ec8-b1ee-85337e19b438 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:01.579670 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-81b69733-3922-4ec8-b1ee-85337e19b438 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:01.580097 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-81b69733-3922-4ec8-b1ee-85337e19b438 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:01.804540 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-81b69733-3922-4ec8-b1ee-85337e19b438 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:01.813129 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-81b69733-3922-4ec8-b1ee-85337e19b438 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.246104 May 24 15:44:01.813883 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1448/2887] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:44:01 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:02.128637 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-3edb2672-d1b7-4752-b389-3073ebd52b5f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:02.129341 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-3edb2672-d1b7-4752-b389-3073ebd52b5f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: d8d131e6-a9cf-46ca-bd20-8fba3e295618] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:02.135949 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3edb2672-d1b7-4752-b389-3073ebd52b5f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:02.136501 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3edb2672-d1b7-4752-b389-3073ebd52b5f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:02.137338 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3edb2672-d1b7-4752-b389-3073ebd52b5f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:02.137848 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3edb2672-d1b7-4752-b389-3073ebd52b5f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:02.171994 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-157955d2-0c98-4246-8284-155326c3b931 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:02.172724 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-157955d2-0c98-4246-8284-155326c3b931 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:02.179805 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-157955d2-0c98-4246-8284-155326c3b931 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:02.180466 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-157955d2-0c98-4246-8284-155326c3b931 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:02.181358 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-157955d2-0c98-4246-8284-155326c3b931 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:02.181921 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-157955d2-0c98-4246-8284-155326c3b931 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:02.205511 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-3edb2672-d1b7-4752-b389-3073ebd52b5f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:02.209157 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=100 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:44:02.215426 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-3edb2672-d1b7-4752-b389-3073ebd52b5f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:02.216957 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-3edb2672-d1b7-4752-b389-3073ebd52b5f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:02.218128 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-3edb2672-d1b7-4752-b389-3073ebd52b5f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/d8d131e6-a9cf-46ca-bd20-8fba3e295618" status: 200 len: 1656 microversion: 2.20 time: 0.093421 May 24 15:44:02.218697 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1440/2888] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:44:02 2022] GET /compute/v2.1/servers/d8d131e6-a9cf-46ca-bd20-8fba3e295618 => generated 1656 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:44:02.566757 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-157955d2-0c98-4246-8284-155326c3b931 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:02.575433 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-157955d2-0c98-4246-8284-155326c3b931 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.407269 May 24 15:44:02.576014 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1449/2889] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:44:02 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:44:02.673491 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [req-2b409e1b-c2d6-42d5-a9c6-e8ab4c87933f req-ad1dc52c-c857-42f6-9b13-664b4553b07d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8d131e6-a9cf-46ca-bd20-8fba3e295618", "name": "network-vif-deleted", "tag": "ab5bccec-476f-4ab7-97df-9a2b9fc9bf17"}]} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:44:02.682652 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-2b409e1b-c2d6-42d5-a9c6-e8ab4c87933f req-ad1dc52c-c857-42f6-9b13-664b4553b07d service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:02.683100 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-2b409e1b-c2d6-42d5-a9c6-e8ab4c87933f req-ad1dc52c-c857-42f6-9b13-664b4553b07d service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:02.695522 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.compute.server_external_events [req-2b409e1b-c2d6-42d5-a9c6-e8ab4c87933f req-ad1dc52c-c857-42f6-9b13-664b4553b07d service nova] Creating event network-vif-deleted:ab5bccec-476f-4ab7-97df-9a2b9fc9bf17 for instance d8d131e6-a9cf-46ca-bd20-8fba3e295618 on hv-cinder-84315 May 24 15:44:02.701754 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [req-2b409e1b-c2d6-42d5-a9c6-e8ab4c87933f req-ad1dc52c-c857-42f6-9b13-664b4553b07d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031904 May 24 15:44:02.702662 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1441/2890] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:44:02.831408 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-8e6f7983-4baa-4448-a153-429184538c57 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:02.832521 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-8e6f7983-4baa-4448-a153-429184538c57 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:02.839783 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8e6f7983-4baa-4448-a153-429184538c57 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:02.840427 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8e6f7983-4baa-4448-a153-429184538c57 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:02.841321 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8e6f7983-4baa-4448-a153-429184538c57 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:02.842121 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8e6f7983-4baa-4448-a153-429184538c57 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:02.973277 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-8e6f7983-4baa-4448-a153-429184538c57 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:02.981438 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-8e6f7983-4baa-4448-a153-429184538c57 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.155303 May 24 15:44:02.982098 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1450/2891] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:44:02 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:03.238036 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-22824a5e-555d-4eef-8f40-359bd49869c2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:03.238772 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-22824a5e-555d-4eef-8f40-359bd49869c2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: d8d131e6-a9cf-46ca-bd20-8fba3e295618] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:03.246079 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-22824a5e-555d-4eef-8f40-359bd49869c2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:03.246611 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-22824a5e-555d-4eef-8f40-359bd49869c2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:03.247488 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-22824a5e-555d-4eef-8f40-359bd49869c2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:03.248000 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-22824a5e-555d-4eef-8f40-359bd49869c2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:03.280150 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-22824a5e-555d-4eef-8f40-359bd49869c2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:03.280645 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-22824a5e-555d-4eef-8f40-359bd49869c2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:03.281116 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.objects.instance [None req-22824a5e-555d-4eef-8f40-359bd49869c2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lazy-loading 'fault' on Instance uuid d8d131e6-a9cf-46ca-bd20-8fba3e295618 {{(pid=117699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 15:44:03.327195 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-22824a5e-555d-4eef-8f40-359bd49869c2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:03.338338 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-22824a5e-555d-4eef-8f40-359bd49869c2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:03.339952 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-22824a5e-555d-4eef-8f40-359bd49869c2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40db5795ce7e4c5bbf06fb81ce404e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe1d758c40542e9b237f9d7bcfa5755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:03.341248 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-22824a5e-555d-4eef-8f40-359bd49869c2 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/d8d131e6-a9cf-46ca-bd20-8fba3e295618" status: 200 len: 1370 microversion: 2.20 time: 0.108143 May 24 15:44:03.342246 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1442/2892] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:44:03 2022] GET /compute/v2.1/servers/d8d131e6-a9cf-46ca-bd20-8fba3e295618 => generated 1370 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:44:03.592853 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-aac8b6ed-2d84-4f44-ac32-cccb6a246f40 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:03.593611 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-aac8b6ed-2d84-4f44-ac32-cccb6a246f40 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:03.600307 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-aac8b6ed-2d84-4f44-ac32-cccb6a246f40 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:03.600777 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-aac8b6ed-2d84-4f44-ac32-cccb6a246f40 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:03.601578 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-aac8b6ed-2d84-4f44-ac32-cccb6a246f40 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:03.602047 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-aac8b6ed-2d84-4f44-ac32-cccb6a246f40 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:03.736604 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-aac8b6ed-2d84-4f44-ac32-cccb6a246f40 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:03.746674 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-aac8b6ed-2d84-4f44-ac32-cccb6a246f40 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.157152 May 24 15:44:03.747562 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1451/2893] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:44:03 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:44:03.999252 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-b3eb71a9-c162-48e4-8131-68925d29b91f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:03.999893 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-b3eb71a9-c162-48e4-8131-68925d29b91f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:04.006394 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b3eb71a9-c162-48e4-8131-68925d29b91f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:04.006833 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b3eb71a9-c162-48e4-8131-68925d29b91f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:04.007855 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b3eb71a9-c162-48e4-8131-68925d29b91f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:04.008288 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b3eb71a9-c162-48e4-8131-68925d29b91f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:04.133823 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-b3eb71a9-c162-48e4-8131-68925d29b91f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:04.142160 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-b3eb71a9-c162-48e4-8131-68925d29b91f tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.146979 May 24 15:44:04.142725 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1443/2894] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:44:03 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:04.358635 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-98aca81d-6ec2-456e-9971-9349674ae50f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:04.359162 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-98aca81d-6ec2-456e-9971-9349674ae50f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: d8d131e6-a9cf-46ca-bd20-8fba3e295618] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:04.365228 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-98aca81d-6ec2-456e-9971-9349674ae50f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:04.365671 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-98aca81d-6ec2-456e-9971-9349674ae50f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:04.366421 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-98aca81d-6ec2-456e-9971-9349674ae50f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:04.367106 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-98aca81d-6ec2-456e-9971-9349674ae50f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:04.380491 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.wsgi [None req-98aca81d-6ec2-456e-9971-9349674ae50f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] HTTP exception thrown: Instance d8d131e6-a9cf-46ca-bd20-8fba3e295618 could not be found. May 24 15:44:04.382100 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-98aca81d-6ec2-456e-9971-9349674ae50f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Request method failure captured: May 24 15:44:04.382100 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: request: GET /compute/v2.1/servers/d8d131e6-a9cf-46ca-bd20-8fba3e295618 HTTP/1.1 May 24 15:44:04.382100 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Accept: application/json May 24 15:44:04.382100 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Accept-Encoding: identity May 24 15:44:04.382100 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Connection: close May 24 15:44:04.382100 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Content-Length: 0 May 24 15:44:04.382100 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Content-Type: application/json May 24 15:44:04.382100 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Host: 10.222.0.45 May 24 15:44:04.382100 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Openstack-System-Scope: None May 24 15:44:04.382100 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: User-Agent: python-urllib3/1.26.9 May 24 15:44:04.382100 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Auth-Token: gAAAAABijPeuaufzab__LW0AXFUD7qP3coXWErtTGwE4hbdoUo03gqoDEHy5CS-BmHgidyoVMWAvp5Uj_iNGcThIDUxA4GGTxU20jlxu0ExSDAc6-x58RvVeGBXOesvIA0pDu8VTfm-9ODH44J9iSDAjfB9glnXGDaB1SAI3dZmmiIY2DodrS1Y May 24 15:44:04.382100 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Domain-Id: None May 24 15:44:04.382100 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Domain-Name: None May 24 15:44:04.382100 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Identity-Status: Confirmed May 24 15:44:04.382100 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Is-Admin-Project: True May 24 15:44:04.382100 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Openstack-Nova-Api-Version: 2.20 May 24 15:44:04.382100 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Domain-Id: default May 24 15:44:04.382100 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Domain-Name: Default May 24 15:44:04.382100 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Id: 0fe1d758c40542e9b237f9d7bcfa5755 May 24 15:44:04.382100 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-467395804 May 24 15:44:04.382100 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Role: reader,member May 24 15:44:04.382100 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Roles: reader,member May 24 15:44:04.384028 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0fe1d758c40542e9b237f9d7bcfa5755"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0fe1d758c40542e9b237f9d7bcfa5755"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0fe1d758c40542e9b237f9d7bcfa5755"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0fe1d758c40542e9b237f9d7bcfa5755"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 24 15:44:04.384028 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Tenant: tempest-AttachVolumeShelveTestJSON-467395804 May 24 15:44:04.384028 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Tenant-Id: 0fe1d758c40542e9b237f9d7bcfa5755 May 24 15:44:04.384028 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-467395804 May 24 15:44:04.384028 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User: tempest-AttachVolumeShelveTestJSON-467395804-project May 24 15:44:04.384028 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Domain-Id: default May 24 15:44:04.384028 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Domain-Name: Default May 24 15:44:04.384028 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Id: 40db5795ce7e4c5bbf06fb81ce404e78 May 24 15:44:04.384028 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Name: tempest-AttachVolumeShelveTestJSON-467395804-project May 24 15:44:04.384028 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: method: > May 24 15:44:04.384028 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: exception: Instance d8d131e6-a9cf-46ca-bd20-8fba3e295618 could not be found. May 24 15:44:04.384028 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: action_args: {'id': 'd8d131e6-a9cf-46ca-bd20-8fba3e295618'} May 24 15:44:04.385675 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:44:04.385675 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:44:04.385675 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:44:04.385675 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:44:04.385675 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:44:04.385675 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:44:04.385675 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:44:04.385675 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:44:04.385675 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:44:04.385675 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:44:04.385675 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8d131e6-a9cf-46ca-bd20-8fba3e295618 could not be found. May 24 15:44:04.385675 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:44:04.385675 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:44:04.385675 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:44:04.385675 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:44:04.385675 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:44:04.385675 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:44:04.385675 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:44:04.385675 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:44:04.385675 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:44:04.387327 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:44:04.387327 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 15:44:04.387327 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 15:44:04.387327 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:44:04.387327 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:44:04.387327 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:44:04.387327 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:44:04.387327 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8d131e6-a9cf-46ca-bd20-8fba3e295618 could not be found. May 24 15:44:04.387327 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:44:04.387327 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:44:04.387327 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:44:04.387327 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:44:04.387327 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:44:04.387327 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:44:04.387327 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:44:04.387327 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:44:04.387327 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8d131e6-a9cf-46ca-bd20-8fba3e295618 could not be found. May 24 15:44:04.387327 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:44:04.388817 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-98aca81d-6ec2-456e-9971-9349674ae50f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Returning 404 to user: Instance d8d131e6-a9cf-46ca-bd20-8fba3e295618 could not be found. {{(pid=117698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:44:04.388817 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-98aca81d-6ec2-456e-9971-9349674ae50f tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/d8d131e6-a9cf-46ca-bd20-8fba3e295618" status: 404 len: 111 microversion: 2.20 time: 0.028832 May 24 15:44:04.388817 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1452/2895] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:44:04 2022] GET /compute/v2.1/servers/d8d131e6-a9cf-46ca-bd20-8fba3e295618 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 24 15:44:04.392832 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-02863565-f522-48cc-92b3-396985ea286e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '.version_select at 0x7f2ddc01ee50>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:04.413440 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-02863565-f522-48cc-92b3-396985ea286e tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-853202945" status: 204 len: 0 microversion: 2.20 time: 0.024356 May 24 15:44:04.414093 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1444/2896] 10.222.0.45 () {60 vars in 1258 bytes} [Tue May 24 15:44:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-853202945 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 24 15:44:04.762883 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-0fc0ddf4-5447-4141-8f34-86678fecb902 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:04.763487 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-0fc0ddf4-5447-4141-8f34-86678fecb902 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:04.770181 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0fc0ddf4-5447-4141-8f34-86678fecb902 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:04.770629 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0fc0ddf4-5447-4141-8f34-86678fecb902 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:04.771387 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0fc0ddf4-5447-4141-8f34-86678fecb902 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:04.771816 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0fc0ddf4-5447-4141-8f34-86678fecb902 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:04.959485 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-0fc0ddf4-5447-4141-8f34-86678fecb902 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:04.968103 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-0fc0ddf4-5447-4141-8f34-86678fecb902 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.209041 May 24 15:44:04.968720 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1453/2897] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:44:04 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:05.087803 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-3090be5f-79cf-4958-8fc4-a9b65d94f24c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:05.088324 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-3090be5f-79cf-4958-8fc4-a9b65d94f24c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: d8d131e6-a9cf-46ca-bd20-8fba3e295618] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:05.094466 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3090be5f-79cf-4958-8fc4-a9b65d94f24c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:05.094945 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3090be5f-79cf-4958-8fc4-a9b65d94f24c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:05.095706 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3090be5f-79cf-4958-8fc4-a9b65d94f24c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:05.096145 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-3090be5f-79cf-4958-8fc4-a9b65d94f24c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:05.110073 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.wsgi [None req-3090be5f-79cf-4958-8fc4-a9b65d94f24c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] HTTP exception thrown: Instance d8d131e6-a9cf-46ca-bd20-8fba3e295618 could not be found. May 24 15:44:05.111723 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-3090be5f-79cf-4958-8fc4-a9b65d94f24c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Request method failure captured: May 24 15:44:05.111723 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: request: DELETE /compute/v2.1/servers/d8d131e6-a9cf-46ca-bd20-8fba3e295618 HTTP/1.1 May 24 15:44:05.111723 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Accept: application/json May 24 15:44:05.111723 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Accept-Encoding: identity May 24 15:44:05.111723 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Connection: close May 24 15:44:05.111723 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Content-Length: 0 May 24 15:44:05.111723 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Content-Type: application/json May 24 15:44:05.111723 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Host: 10.222.0.45 May 24 15:44:05.111723 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Openstack-System-Scope: None May 24 15:44:05.111723 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: User-Agent: python-urllib3/1.26.9 May 24 15:44:05.111723 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Auth-Token: gAAAAABijPeuaufzab__LW0AXFUD7qP3coXWErtTGwE4hbdoUo03gqoDEHy5CS-BmHgidyoVMWAvp5Uj_iNGcThIDUxA4GGTxU20jlxu0ExSDAc6-x58RvVeGBXOesvIA0pDu8VTfm-9ODH44J9iSDAjfB9glnXGDaB1SAI3dZmmiIY2DodrS1Y May 24 15:44:05.111723 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Domain-Id: None May 24 15:44:05.111723 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Domain-Name: None May 24 15:44:05.111723 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Identity-Status: Confirmed May 24 15:44:05.111723 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Is-Admin-Project: True May 24 15:44:05.111723 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Openstack-Nova-Api-Version: 2.20 May 24 15:44:05.111723 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Domain-Id: default May 24 15:44:05.111723 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Domain-Name: Default May 24 15:44:05.111723 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Id: 0fe1d758c40542e9b237f9d7bcfa5755 May 24 15:44:05.111723 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-467395804 May 24 15:44:05.111723 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Role: reader,member May 24 15:44:05.111723 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Roles: reader,member May 24 15:44:05.113608 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0fe1d758c40542e9b237f9d7bcfa5755"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0fe1d758c40542e9b237f9d7bcfa5755"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0fe1d758c40542e9b237f9d7bcfa5755"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0fe1d758c40542e9b237f9d7bcfa5755"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 24 15:44:05.113608 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant: tempest-AttachVolumeShelveTestJSON-467395804 May 24 15:44:05.113608 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant-Id: 0fe1d758c40542e9b237f9d7bcfa5755 May 24 15:44:05.113608 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-467395804 May 24 15:44:05.113608 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User: tempest-AttachVolumeShelveTestJSON-467395804-project May 24 15:44:05.113608 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Domain-Id: default May 24 15:44:05.113608 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Domain-Name: Default May 24 15:44:05.113608 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Id: 40db5795ce7e4c5bbf06fb81ce404e78 May 24 15:44:05.113608 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Name: tempest-AttachVolumeShelveTestJSON-467395804-project May 24 15:44:05.113608 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: method: > May 24 15:44:05.113608 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: exception: Instance d8d131e6-a9cf-46ca-bd20-8fba3e295618 could not be found. May 24 15:44:05.113608 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: action_args: {'id': 'd8d131e6-a9cf-46ca-bd20-8fba3e295618'} May 24 15:44:05.115640 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:44:05.115640 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:44:05.115640 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:44:05.115640 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:44:05.115640 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:44:05.115640 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:44:05.115640 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:44:05.115640 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:44:05.115640 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:44:05.115640 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:44:05.115640 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8d131e6-a9cf-46ca-bd20-8fba3e295618 could not be found. May 24 15:44:05.115640 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:44:05.115640 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:44:05.115640 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:44:05.115640 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:44:05.115640 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:44:05.115640 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:44:05.115640 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:44:05.115640 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:44:05.115640 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:44:05.117885 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:44:05.117885 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 24 15:44:05.117885 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 24 15:44:05.117885 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 24 15:44:05.117885 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 24 15:44:05.117885 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:44:05.117885 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:44:05.117885 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:44:05.117885 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:44:05.117885 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8d131e6-a9cf-46ca-bd20-8fba3e295618 could not be found. May 24 15:44:05.117885 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:44:05.117885 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:44:05.117885 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:44:05.117885 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:44:05.117885 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:44:05.117885 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:44:05.117885 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:44:05.117885 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:44:05.117885 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8d131e6-a9cf-46ca-bd20-8fba3e295618 could not be found. May 24 15:44:05.117885 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:44:05.119444 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-3090be5f-79cf-4958-8fc4-a9b65d94f24c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Returning 404 to user: Instance d8d131e6-a9cf-46ca-bd20-8fba3e295618 could not be found. {{(pid=117699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:44:05.119444 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-3090be5f-79cf-4958-8fc4-a9b65d94f24c tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "DELETE /compute/v2.1/servers/d8d131e6-a9cf-46ca-bd20-8fba3e295618" status: 404 len: 111 microversion: 2.20 time: 0.029801 May 24 15:44:05.119444 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1445/2898] 10.222.0.45 () {60 vars in 1279 bytes} [Tue May 24 15:44:05 2022] DELETE /compute/v2.1/servers/d8d131e6-a9cf-46ca-bd20-8fba3e295618 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 24 15:44:05.121704 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-937d01f3-c02d-4260-a998-5a6291957372 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:05.122314 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-937d01f3-c02d-4260-a998-5a6291957372 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: d8d131e6-a9cf-46ca-bd20-8fba3e295618] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:05.128399 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-937d01f3-c02d-4260-a998-5a6291957372 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:05.128849 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-937d01f3-c02d-4260-a998-5a6291957372 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:05.129604 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-937d01f3-c02d-4260-a998-5a6291957372 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:05.130040 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-937d01f3-c02d-4260-a998-5a6291957372 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:05.142980 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.wsgi [None req-937d01f3-c02d-4260-a998-5a6291957372 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] HTTP exception thrown: Instance d8d131e6-a9cf-46ca-bd20-8fba3e295618 could not be found. May 24 15:44:05.144529 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-937d01f3-c02d-4260-a998-5a6291957372 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Request method failure captured: May 24 15:44:05.144529 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: request: GET /compute/v2.1/servers/d8d131e6-a9cf-46ca-bd20-8fba3e295618 HTTP/1.1 May 24 15:44:05.144529 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Accept: application/json May 24 15:44:05.144529 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Accept-Encoding: identity May 24 15:44:05.144529 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Connection: close May 24 15:44:05.144529 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Content-Length: 0 May 24 15:44:05.144529 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Content-Type: application/json May 24 15:44:05.144529 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Host: 10.222.0.45 May 24 15:44:05.144529 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Openstack-System-Scope: None May 24 15:44:05.144529 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: User-Agent: python-urllib3/1.26.9 May 24 15:44:05.144529 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Auth-Token: gAAAAABijPeuaufzab__LW0AXFUD7qP3coXWErtTGwE4hbdoUo03gqoDEHy5CS-BmHgidyoVMWAvp5Uj_iNGcThIDUxA4GGTxU20jlxu0ExSDAc6-x58RvVeGBXOesvIA0pDu8VTfm-9ODH44J9iSDAjfB9glnXGDaB1SAI3dZmmiIY2DodrS1Y May 24 15:44:05.144529 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Domain-Id: None May 24 15:44:05.144529 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Domain-Name: None May 24 15:44:05.144529 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Identity-Status: Confirmed May 24 15:44:05.144529 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Is-Admin-Project: True May 24 15:44:05.144529 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Openstack-Nova-Api-Version: 2.20 May 24 15:44:05.144529 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Domain-Id: default May 24 15:44:05.144529 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Domain-Name: Default May 24 15:44:05.144529 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Id: 0fe1d758c40542e9b237f9d7bcfa5755 May 24 15:44:05.144529 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-467395804 May 24 15:44:05.144529 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Role: reader,member May 24 15:44:05.144529 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Roles: reader,member May 24 15:44:05.146280 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0fe1d758c40542e9b237f9d7bcfa5755"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0fe1d758c40542e9b237f9d7bcfa5755"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0fe1d758c40542e9b237f9d7bcfa5755"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0fe1d758c40542e9b237f9d7bcfa5755"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 24 15:44:05.146280 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Tenant: tempest-AttachVolumeShelveTestJSON-467395804 May 24 15:44:05.146280 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Tenant-Id: 0fe1d758c40542e9b237f9d7bcfa5755 May 24 15:44:05.146280 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-467395804 May 24 15:44:05.146280 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User: tempest-AttachVolumeShelveTestJSON-467395804-project May 24 15:44:05.146280 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Domain-Id: default May 24 15:44:05.146280 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Domain-Name: Default May 24 15:44:05.146280 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Id: 40db5795ce7e4c5bbf06fb81ce404e78 May 24 15:44:05.146280 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Name: tempest-AttachVolumeShelveTestJSON-467395804-project May 24 15:44:05.146280 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: method: > May 24 15:44:05.146280 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: exception: Instance d8d131e6-a9cf-46ca-bd20-8fba3e295618 could not be found. May 24 15:44:05.146280 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: action_args: {'id': 'd8d131e6-a9cf-46ca-bd20-8fba3e295618'} May 24 15:44:05.147462 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:44:05.147462 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:44:05.147462 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:44:05.147462 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:44:05.147462 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:44:05.147462 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:44:05.147462 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:44:05.147462 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:44:05.147462 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:44:05.147462 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:44:05.147462 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8d131e6-a9cf-46ca-bd20-8fba3e295618 could not be found. May 24 15:44:05.147462 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:44:05.147462 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:44:05.147462 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:44:05.147462 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:44:05.147462 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:44:05.147462 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:44:05.147462 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:44:05.147462 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:44:05.147462 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:44:05.149168 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:44:05.149168 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 15:44:05.149168 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 15:44:05.149168 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:44:05.149168 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:44:05.149168 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:44:05.149168 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:44:05.149168 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8d131e6-a9cf-46ca-bd20-8fba3e295618 could not be found. May 24 15:44:05.149168 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:44:05.149168 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:44:05.149168 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:44:05.149168 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:44:05.149168 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:44:05.149168 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:44:05.149168 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:44:05.149168 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:44:05.149168 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8d131e6-a9cf-46ca-bd20-8fba3e295618 could not be found. May 24 15:44:05.149168 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:44:05.151141 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-937d01f3-c02d-4260-a998-5a6291957372 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Returning 404 to user: Instance d8d131e6-a9cf-46ca-bd20-8fba3e295618 could not be found. {{(pid=117698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:44:05.151141 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-937d01f3-c02d-4260-a998-5a6291957372 tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/d8d131e6-a9cf-46ca-bd20-8fba3e295618" status: 404 len: 111 microversion: 2.20 time: 0.028042 May 24 15:44:05.151141 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1454/2899] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:44:05 2022] GET /compute/v2.1/servers/d8d131e6-a9cf-46ca-bd20-8fba3e295618 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 24 15:44:05.158773 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-c4eb7b0b-cfdd-4dd4-823b-bd85d62982af tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:05.159383 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-c4eb7b0b-cfdd-4dd4-823b-bd85d62982af tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:05.166143 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c4eb7b0b-cfdd-4dd4-823b-bd85d62982af tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:05.166594 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c4eb7b0b-cfdd-4dd4-823b-bd85d62982af tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:05.167354 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c4eb7b0b-cfdd-4dd4-823b-bd85d62982af tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:05.167788 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c4eb7b0b-cfdd-4dd4-823b-bd85d62982af tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:05.295257 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-c4eb7b0b-cfdd-4dd4-823b-bd85d62982af tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:05.303227 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-c4eb7b0b-cfdd-4dd4-823b-bd85d62982af tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.148192 May 24 15:44:05.303792 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1446/2900] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:44:05 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:05.985150 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-b97f940a-dcb1-4df9-a07e-4fa4ff7816a4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:05.985800 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-b97f940a-dcb1-4df9-a07e-4fa4ff7816a4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:05.992567 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b97f940a-dcb1-4df9-a07e-4fa4ff7816a4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:05.993006 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b97f940a-dcb1-4df9-a07e-4fa4ff7816a4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:05.994914 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b97f940a-dcb1-4df9-a07e-4fa4ff7816a4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:05.995342 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b97f940a-dcb1-4df9-a07e-4fa4ff7816a4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:06.123872 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-b97f940a-dcb1-4df9-a07e-4fa4ff7816a4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:06.131973 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-b97f940a-dcb1-4df9-a07e-4fa4ff7816a4 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.150608 May 24 15:44:06.132556 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1455/2901] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:44:05 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:06.319942 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-1d698e8e-f976-42c8-b6b1-9c6c5fcc55b8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:06.320499 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-1d698e8e-f976-42c8-b6b1-9c6c5fcc55b8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:06.327049 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1d698e8e-f976-42c8-b6b1-9c6c5fcc55b8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:06.327486 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1d698e8e-f976-42c8-b6b1-9c6c5fcc55b8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:06.328230 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1d698e8e-f976-42c8-b6b1-9c6c5fcc55b8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:06.328683 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1d698e8e-f976-42c8-b6b1-9c6c5fcc55b8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:06.453311 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-1d698e8e-f976-42c8-b6b1-9c6c5fcc55b8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:06.461111 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-1d698e8e-f976-42c8-b6b1-9c6c5fcc55b8 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.145032 May 24 15:44:06.461667 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1447/2902] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:44:06 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:07.148447 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-69ab7d07-b993-46c2-9f3b-f8d4b51f838a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:07.149065 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-69ab7d07-b993-46c2-9f3b-f8d4b51f838a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:07.156190 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-69ab7d07-b993-46c2-9f3b-f8d4b51f838a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:07.156667 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-69ab7d07-b993-46c2-9f3b-f8d4b51f838a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:07.157421 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-69ab7d07-b993-46c2-9f3b-f8d4b51f838a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:07.157856 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-69ab7d07-b993-46c2-9f3b-f8d4b51f838a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:07.287148 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-69ab7d07-b993-46c2-9f3b-f8d4b51f838a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:07.294995 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-69ab7d07-b993-46c2-9f3b-f8d4b51f838a tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.150389 May 24 15:44:07.295550 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1456/2903] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:44:07 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:07.478400 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-dd1f2a92-c22a-42d6-8b9d-cb9298da4d61 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:07.479017 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-dd1f2a92-c22a-42d6-8b9d-cb9298da4d61 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:07.485827 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dd1f2a92-c22a-42d6-8b9d-cb9298da4d61 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:07.486277 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dd1f2a92-c22a-42d6-8b9d-cb9298da4d61 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:07.487095 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dd1f2a92-c22a-42d6-8b9d-cb9298da4d61 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:07.487475 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-dd1f2a92-c22a-42d6-8b9d-cb9298da4d61 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:07.615868 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-dd1f2a92-c22a-42d6-8b9d-cb9298da4d61 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:07.625132 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-dd1f2a92-c22a-42d6-8b9d-cb9298da4d61 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.150645 May 24 15:44:07.625691 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1448/2904] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:44:07 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:08.311599 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-72042c4a-3fa2-4d02-b77f-01279f2f101b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:08.312204 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-72042c4a-3fa2-4d02-b77f-01279f2f101b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:08.318697 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-72042c4a-3fa2-4d02-b77f-01279f2f101b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:08.319139 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-72042c4a-3fa2-4d02-b77f-01279f2f101b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:08.319886 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-72042c4a-3fa2-4d02-b77f-01279f2f101b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:08.320330 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-72042c4a-3fa2-4d02-b77f-01279f2f101b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:08.444098 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-72042c4a-3fa2-4d02-b77f-01279f2f101b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:08.452544 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-72042c4a-3fa2-4d02-b77f-01279f2f101b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.144737 May 24 15:44:08.453114 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1457/2905] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:44:08 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:08.641722 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e7fddadd-9072-4fa5-a637-8acb3aff7f9e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:08.642328 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-e7fddadd-9072-4fa5-a637-8acb3aff7f9e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:08.648871 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e7fddadd-9072-4fa5-a637-8acb3aff7f9e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:08.649260 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e7fddadd-9072-4fa5-a637-8acb3aff7f9e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:08.650650 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e7fddadd-9072-4fa5-a637-8acb3aff7f9e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:08.651073 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e7fddadd-9072-4fa5-a637-8acb3aff7f9e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:08.774652 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-e7fddadd-9072-4fa5-a637-8acb3aff7f9e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:08.782534 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-e7fddadd-9072-4fa5-a637-8acb3aff7f9e tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.144650 May 24 15:44:08.783097 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1449/2906] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:44:08 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:09.468747 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e3084169-33cb-4061-b4fd-a666e7cd41b0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:09.469357 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e3084169-33cb-4061-b4fd-a666e7cd41b0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:09.475771 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e3084169-33cb-4061-b4fd-a666e7cd41b0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:09.476218 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e3084169-33cb-4061-b4fd-a666e7cd41b0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:09.477091 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e3084169-33cb-4061-b4fd-a666e7cd41b0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:09.477522 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e3084169-33cb-4061-b4fd-a666e7cd41b0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:09.605523 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e3084169-33cb-4061-b4fd-a666e7cd41b0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:09.613332 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e3084169-33cb-4061-b4fd-a666e7cd41b0 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.148422 May 24 15:44:09.613891 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1458/2907] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:44:09 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:09.798994 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-1fd10845-dff5-4293-ae58-126988cafabf tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:09.799584 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-1fd10845-dff5-4293-ae58-126988cafabf tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:09.805722 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1fd10845-dff5-4293-ae58-126988cafabf tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:09.806238 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1fd10845-dff5-4293-ae58-126988cafabf tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:09.807110 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1fd10845-dff5-4293-ae58-126988cafabf tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:09.807543 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1fd10845-dff5-4293-ae58-126988cafabf tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:09.932337 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-1fd10845-dff5-4293-ae58-126988cafabf tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:09.940107 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-1fd10845-dff5-4293-ae58-126988cafabf tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.145039 May 24 15:44:09.940705 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1450/2908] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:44:09 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:10.630206 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-84405d71-c99a-4b49-961d-d64064a5439f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:10.630828 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-84405d71-c99a-4b49-961d-d64064a5439f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: 3017990e-8735-4d85-a686-1eebb1484dd3] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:10.637211 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-84405d71-c99a-4b49-961d-d64064a5439f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:10.637661 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-84405d71-c99a-4b49-961d-d64064a5439f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:10.638417 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-84405d71-c99a-4b49-961d-d64064a5439f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:10.638855 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-84405d71-c99a-4b49-961d-d64064a5439f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:10.762258 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-84405d71-c99a-4b49-961d-d64064a5439f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:10.770359 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-84405d71-c99a-4b49-961d-d64064a5439f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3" status: 200 len: 1735 microversion: 2.1 time: 0.143988 May 24 15:44:10.770928 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1459/2909] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:44:10 2022] GET /compute/v2.1/servers/3017990e-8735-4d85-a686-1eebb1484dd3 => generated 1735 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:10.785841 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-0c8b1ba7-0697-480f-b136-a9fea4a402f5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '.version_select at 0x7f2ddc02c160>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:10.803077 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-0c8b1ba7-0697-480f-b136-a9fea4a402f5 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1306177571" status: 202 len: 0 microversion: 2.1 time: 0.020925 May 24 15:44:10.803678 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1451/2910] 10.222.0.45 () {58 vars in 1220 bytes} [Tue May 24 15:44:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1306177571 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 15:44:10.956966 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-01501d60-7932-4c1c-b50f-ec0a06e35b43 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:10.957575 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-01501d60-7932-4c1c-b50f-ec0a06e35b43 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] [instance: c395e512-b693-4a96-8301-640831fee66f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:10.964167 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-01501d60-7932-4c1c-b50f-ec0a06e35b43 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:10.964640 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-01501d60-7932-4c1c-b50f-ec0a06e35b43 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:10.965392 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-01501d60-7932-4c1c-b50f-ec0a06e35b43 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:10.965810 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-01501d60-7932-4c1c-b50f-ec0a06e35b43 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:11.198918 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-01501d60-7932-4c1c-b50f-ec0a06e35b43 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927951dcdbb348d6ac8d467753c55d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb659dae6f4b4f26a2d869138f573561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:11.209701 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-01501d60-7932-4c1c-b50f-ec0a06e35b43 tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f" status: 200 len: 1600 microversion: 2.1 time: 0.256582 May 24 15:44:11.210745 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1460/2911] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:44:10 2022] GET /compute/v2.1/servers/c395e512-b693-4a96-8301-640831fee66f => generated 1600 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:11.225990 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-858f275e-f303-4d63-912f-dd0142c71a1d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] Calling method '.version_select at 0x7f2ddc029ee0>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:11.245785 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-858f275e-f303-4d63-912f-dd0142c71a1d tempest-TestMinimumBasicScenario-226540700 tempest-TestMinimumBasicScenario-226540700-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-891689507" status: 202 len: 0 microversion: 2.1 time: 0.023440 May 24 15:44:11.246699 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1452/2912] 10.222.0.45 () {58 vars in 1268 bytes} [Tue May 24 15:44:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-891689507 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 15:44:11.902104 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [req-e06fea2a-5159-4056-a90b-1d0b8b1e7a77 req-37400273-6701-417b-82fb-dc90aa651a8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3017990e-8735-4d85-a686-1eebb1484dd3", "tag": "ca6cef6e-61fd-4449-934f-86f49e0487c0"}]} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:44:11.911138 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-e06fea2a-5159-4056-a90b-1d0b8b1e7a77 req-37400273-6701-417b-82fb-dc90aa651a8a service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:11.912410 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-e06fea2a-5159-4056-a90b-1d0b8b1e7a77 req-37400273-6701-417b-82fb-dc90aa651a8a service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:11.925922 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.compute.server_external_events [req-e06fea2a-5159-4056-a90b-1d0b8b1e7a77 req-37400273-6701-417b-82fb-dc90aa651a8a service nova] Creating event network-changed:ca6cef6e-61fd-4449-934f-86f49e0487c0 for instance 3017990e-8735-4d85-a686-1eebb1484dd3 on hv-cinder-84315 May 24 15:44:11.932098 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [req-e06fea2a-5159-4056-a90b-1d0b8b1e7a77 req-37400273-6701-417b-82fb-dc90aa651a8a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033181 May 24 15:44:11.935844 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1461/2913] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:44:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:44:15.423715 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-bef9ceee-dc21-4a5a-83a8-0b19d6ab80a7 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:15.424252 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-bef9ceee-dc21-4a5a-83a8-0b19d6ab80a7 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:15.432045 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bef9ceee-dc21-4a5a-83a8-0b19d6ab80a7 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:15.432530 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bef9ceee-dc21-4a5a-83a8-0b19d6ab80a7 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:15.433300 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bef9ceee-dc21-4a5a-83a8-0b19d6ab80a7 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:15.433754 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-bef9ceee-dc21-4a5a-83a8-0b19d6ab80a7 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:15.449268 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.wsgi [None req-bef9ceee-dc21-4a5a-83a8-0b19d6ab80a7 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] HTTP exception thrown: Instance 4aeb46b7-2550-490d-b4a1-f393d14133fa could not be found. May 24 15:44:15.450584 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-bef9ceee-dc21-4a5a-83a8-0b19d6ab80a7 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Request method failure captured: May 24 15:44:15.450584 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: request: DELETE /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa HTTP/1.1 May 24 15:44:15.450584 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Accept: application/json May 24 15:44:15.450584 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Accept-Encoding: identity May 24 15:44:15.450584 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Connection: close May 24 15:44:15.450584 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Content-Length: 0 May 24 15:44:15.450584 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Content-Type: application/json May 24 15:44:15.450584 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Host: 10.222.0.45 May 24 15:44:15.450584 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Openstack-System-Scope: None May 24 15:44:15.450584 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: User-Agent: python-urllib3/1.26.9 May 24 15:44:15.450584 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Auth-Token: gAAAAABijPenpuB3nhOrbi-s3yxL7m-sBG8ZJZ51rBJ3imPzJ57HWeKwFeyebtAB5n2bRdpBGRV3d5i1o5IlYb6fCewd8gSuMgbjsTvWfWnQ_U8M7n-X8RXyXojhl7q-zYypOQ1v7H4itKL87AzjyCIaWDLZ-yW18KI11cscCi_s9fBvwKCcm3E May 24 15:44:15.450584 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Domain-Id: None May 24 15:44:15.450584 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Domain-Name: None May 24 15:44:15.450584 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Identity-Status: Confirmed May 24 15:44:15.450584 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Is-Admin-Project: True May 24 15:44:15.450584 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Domain-Id: default May 24 15:44:15.450584 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Domain-Name: Default May 24 15:44:15.450584 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Id: 0812b13a287c43259d7e09b0c658d4c8 May 24 15:44:15.450584 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Name: tempest-AttachVolumeTestJSON-590500594 May 24 15:44:15.450584 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Role: reader,member May 24 15:44:15.450584 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Roles: reader,member May 24 15:44:15.452413 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0812b13a287c43259d7e09b0c658d4c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0812b13a287c43259d7e09b0c658d4c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0812b13a287c43259d7e09b0c658d4c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0812b13a287c43259d7e09b0c658d4c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 24 15:44:15.452413 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant: tempest-AttachVolumeTestJSON-590500594 May 24 15:44:15.452413 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant-Id: 0812b13a287c43259d7e09b0c658d4c8 May 24 15:44:15.452413 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant-Name: tempest-AttachVolumeTestJSON-590500594 May 24 15:44:15.452413 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User: tempest-AttachVolumeTestJSON-590500594-project May 24 15:44:15.452413 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Domain-Id: default May 24 15:44:15.452413 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Domain-Name: Default May 24 15:44:15.452413 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Id: 2befe74ad06542b785d326101fc06d0b May 24 15:44:15.452413 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Name: tempest-AttachVolumeTestJSON-590500594-project May 24 15:44:15.452413 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: method: > May 24 15:44:15.452413 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: exception: Instance 4aeb46b7-2550-490d-b4a1-f393d14133fa could not be found. May 24 15:44:15.452413 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: action_args: {'id': '4aeb46b7-2550-490d-b4a1-f393d14133fa'} May 24 15:44:15.456460 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:44:15.456460 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:44:15.456460 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:44:15.456460 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:44:15.456460 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:44:15.456460 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:44:15.456460 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:44:15.456460 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:44:15.456460 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:44:15.456460 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:44:15.456460 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4aeb46b7-2550-490d-b4a1-f393d14133fa could not be found. May 24 15:44:15.456460 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:44:15.456460 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:44:15.456460 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:44:15.456460 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:44:15.456460 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:44:15.456460 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:44:15.456460 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:44:15.456460 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:44:15.456460 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:44:15.458139 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:44:15.458139 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 24 15:44:15.458139 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 24 15:44:15.458139 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 24 15:44:15.458139 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 24 15:44:15.458139 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:44:15.458139 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:44:15.458139 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:44:15.458139 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:44:15.458139 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4aeb46b7-2550-490d-b4a1-f393d14133fa could not be found. May 24 15:44:15.458139 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:44:15.458139 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:44:15.458139 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:44:15.458139 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:44:15.458139 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:44:15.458139 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:44:15.458139 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:44:15.458139 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:44:15.458139 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4aeb46b7-2550-490d-b4a1-f393d14133fa could not be found. May 24 15:44:15.458139 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:44:15.460112 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-bef9ceee-dc21-4a5a-83a8-0b19d6ab80a7 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Returning 404 to user: Instance 4aeb46b7-2550-490d-b4a1-f393d14133fa could not be found. {{(pid=117699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:44:15.460112 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-bef9ceee-dc21-4a5a-83a8-0b19d6ab80a7 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "DELETE /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 404 len: 111 microversion: 2.1 time: 0.032753 May 24 15:44:15.460112 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1453/2914] 10.222.0.45 () {58 vars in 1238 bytes} [Tue May 24 15:44:15 2022] DELETE /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:44:15.461570 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-09680c0c-49cc-4fc2-8a8a-3aa8ad233681 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:15.462782 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-09680c0c-49cc-4fc2-8a8a-3aa8ad233681 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] [instance: 4aeb46b7-2550-490d-b4a1-f393d14133fa] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:15.468974 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-09680c0c-49cc-4fc2-8a8a-3aa8ad233681 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:15.469448 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-09680c0c-49cc-4fc2-8a8a-3aa8ad233681 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:15.470158 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-09680c0c-49cc-4fc2-8a8a-3aa8ad233681 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:15.470584 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-09680c0c-49cc-4fc2-8a8a-3aa8ad233681 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:15.484276 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.wsgi [None req-09680c0c-49cc-4fc2-8a8a-3aa8ad233681 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] HTTP exception thrown: Instance 4aeb46b7-2550-490d-b4a1-f393d14133fa could not be found. May 24 15:44:15.485889 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-09680c0c-49cc-4fc2-8a8a-3aa8ad233681 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Request method failure captured: May 24 15:44:15.485889 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: request: GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa HTTP/1.1 May 24 15:44:15.485889 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Accept: application/json May 24 15:44:15.485889 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Accept-Encoding: identity May 24 15:44:15.485889 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Connection: close May 24 15:44:15.485889 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Content-Length: 0 May 24 15:44:15.485889 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Content-Type: application/json May 24 15:44:15.485889 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Host: 10.222.0.45 May 24 15:44:15.485889 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Openstack-System-Scope: None May 24 15:44:15.485889 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: User-Agent: python-urllib3/1.26.9 May 24 15:44:15.485889 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Auth-Token: gAAAAABijPenpuB3nhOrbi-s3yxL7m-sBG8ZJZ51rBJ3imPzJ57HWeKwFeyebtAB5n2bRdpBGRV3d5i1o5IlYb6fCewd8gSuMgbjsTvWfWnQ_U8M7n-X8RXyXojhl7q-zYypOQ1v7H4itKL87AzjyCIaWDLZ-yW18KI11cscCi_s9fBvwKCcm3E May 24 15:44:15.485889 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Domain-Id: None May 24 15:44:15.485889 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Domain-Name: None May 24 15:44:15.485889 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Identity-Status: Confirmed May 24 15:44:15.485889 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Is-Admin-Project: True May 24 15:44:15.485889 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Domain-Id: default May 24 15:44:15.485889 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Domain-Name: Default May 24 15:44:15.485889 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Id: 0812b13a287c43259d7e09b0c658d4c8 May 24 15:44:15.485889 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Name: tempest-AttachVolumeTestJSON-590500594 May 24 15:44:15.485889 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Role: reader,member May 24 15:44:15.485889 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Roles: reader,member May 24 15:44:15.488055 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0812b13a287c43259d7e09b0c658d4c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0812b13a287c43259d7e09b0c658d4c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0812b13a287c43259d7e09b0c658d4c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0812b13a287c43259d7e09b0c658d4c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 24 15:44:15.488055 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Tenant: tempest-AttachVolumeTestJSON-590500594 May 24 15:44:15.488055 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Tenant-Id: 0812b13a287c43259d7e09b0c658d4c8 May 24 15:44:15.488055 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Tenant-Name: tempest-AttachVolumeTestJSON-590500594 May 24 15:44:15.488055 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User: tempest-AttachVolumeTestJSON-590500594-project May 24 15:44:15.488055 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Domain-Id: default May 24 15:44:15.488055 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Domain-Name: Default May 24 15:44:15.488055 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Id: 2befe74ad06542b785d326101fc06d0b May 24 15:44:15.488055 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Name: tempest-AttachVolumeTestJSON-590500594-project May 24 15:44:15.488055 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: method: > May 24 15:44:15.488055 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: exception: Instance 4aeb46b7-2550-490d-b4a1-f393d14133fa could not be found. May 24 15:44:15.488055 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: action_args: {'id': '4aeb46b7-2550-490d-b4a1-f393d14133fa'} May 24 15:44:15.489064 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:44:15.489064 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:44:15.489064 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:44:15.489064 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:44:15.489064 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:44:15.489064 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:44:15.489064 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:44:15.489064 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:44:15.489064 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:44:15.489064 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:44:15.489064 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4aeb46b7-2550-490d-b4a1-f393d14133fa could not be found. May 24 15:44:15.489064 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:44:15.489064 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:44:15.489064 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:44:15.489064 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:44:15.489064 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:44:15.489064 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:44:15.489064 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:44:15.489064 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:44:15.489064 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:44:15.490671 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:44:15.490671 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 15:44:15.490671 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 15:44:15.490671 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:44:15.490671 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:44:15.490671 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:44:15.490671 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:44:15.490671 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4aeb46b7-2550-490d-b4a1-f393d14133fa could not be found. May 24 15:44:15.490671 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:44:15.490671 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:44:15.490671 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:44:15.490671 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:44:15.490671 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:44:15.490671 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:44:15.490671 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:44:15.490671 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:44:15.490671 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4aeb46b7-2550-490d-b4a1-f393d14133fa could not be found. May 24 15:44:15.490671 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:44:15.493002 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-09680c0c-49cc-4fc2-8a8a-3aa8ad233681 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] Returning 404 to user: Instance 4aeb46b7-2550-490d-b4a1-f393d14133fa could not be found. {{(pid=117698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:44:15.493002 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-09680c0c-49cc-4fc2-8a8a-3aa8ad233681 tempest-AttachVolumeTestJSON-590500594 tempest-AttachVolumeTestJSON-590500594-project] 10.222.0.45 "GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa" status: 404 len: 111 microversion: 2.1 time: 0.030529 May 24 15:44:15.493002 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1462/2915] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:44:15 2022] GET /compute/v2.1/servers/4aeb46b7-2550-490d-b4a1-f393d14133fa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:44:17.139297 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [req-3811518c-1677-4cd9-8147-263f83a8a2f2 req-da3bd070-150c-4748-8551-0d748930b373 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c395e512-b693-4a96-8301-640831fee66f", "name": "network-vif-deleted", "tag": "3b9228a9-f1b9-4ba1-9526-b1b918986c1b"}]} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:44:17.150156 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-3811518c-1677-4cd9-8147-263f83a8a2f2 req-da3bd070-150c-4748-8551-0d748930b373 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:17.150944 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-3811518c-1677-4cd9-8147-263f83a8a2f2 req-da3bd070-150c-4748-8551-0d748930b373 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:17.172194 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.compute.server_external_events [req-3811518c-1677-4cd9-8147-263f83a8a2f2 req-da3bd070-150c-4748-8551-0d748930b373 service nova] Creating event network-vif-deleted:3b9228a9-f1b9-4ba1-9526-b1b918986c1b for instance c395e512-b693-4a96-8301-640831fee66f on hv-cinder-84315 May 24 15:44:17.178100 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [req-3811518c-1677-4cd9-8147-263f83a8a2f2 req-da3bd070-150c-4748-8551-0d748930b373 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043051 May 24 15:44:17.178929 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1454/2916] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:44:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:44:24.346694 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-f0a95414-ba1f-4e9f-8d5b-832231e4baa1 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Action: 'create', calling method: .version_select at 0x7f2dd277aee0>, body: {"keypair": {"name": "tempest-keypair-1210249924", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBELxP00i1vX3GYrigU2+tkVMOsY4NJDaC5Qf3k7g4vC1fQrsW29N+ubIzo6+eknp6/sY/XsoTW8Zyr0SEvbkkGGXkFQahHivrUJmZaJ1KZYHCptoxuOrIwFV3os2Ea0bqg=="}} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:44:24.351148 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:44:24.364031 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.quota [None req-f0a95414-ba1f-4e9f-8d5b-832231e4baa1 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Getting quotas for project 3c965241379a45d8b9103af1913791a7. Resources: {'key_pairs'} {{(pid=117698) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 15:44:24.369199 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.quota [None req-f0a95414-ba1f-4e9f-8d5b-832231e4baa1 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Getting quotas for user ca179fc319904fcb9b343c9e7de28e6f and project 3c965241379a45d8b9103af1913791a7. Resources: {'key_pairs'} {{(pid=117698) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 15:44:24.381252 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f0a95414-ba1f-4e9f-8d5b-832231e4baa1 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [5aebd939-39d2-4eea-9422-761c2eb5df8c] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 24 15:44:25.389839 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO oslo.messaging._drivers.impl_rabbit [None req-f0a95414-ba1f-4e9f-8d5b-832231e4baa1 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [5aebd939-39d2-4eea-9422-761c2eb5df8c] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 55506. May 24 15:44:25.406676 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-f0a95414-ba1f-4e9f-8d5b-832231e4baa1 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.185678 May 24 15:44:25.407269 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1463/2917] 10.222.0.45 () {60 vars in 1158 bytes} [Tue May 24 15:44:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:44:26.694269 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-1c38a06e-f57e-4e58-a2a1-6cac7505cd75 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1932010252", "imageRef": "f921f75e-bbd1-4d99-ab1e-5cce2d895148", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "61d3a675-5b96-4570-966d-358ac466c5d5"}], "security_groups": [{"name": "tempest-securitygroup--1359454835"}], "key_name": "tempest-keypair-1210249924", "user_data": "}} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:44:26.806907 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.network.neutron [None req-1c38a06e-f57e-4e58-a2a1-6cac7505cd75 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] validate_networks() for [('61d3a675-5b96-4570-966d-358ac466c5d5', None, None, None, None, None)] {{(pid=117699) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 15:44:27.162810 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=52 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:44:27.328284 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.virt.hardware [None req-1c38a06e-f57e-4e58-a2a1-6cac7505cd75 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Flavor limits 0:0:0 {{(pid=117699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 15:44:27.329068 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.virt.hardware [None req-1c38a06e-f57e-4e58-a2a1-6cac7505cd75 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Image limits 0:0:0 {{(pid=117699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 15:44:27.329690 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.virt.hardware [None req-1c38a06e-f57e-4e58-a2a1-6cac7505cd75 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Flavor pref 0:0:0 {{(pid=117699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 15:44:27.330354 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.virt.hardware [None req-1c38a06e-f57e-4e58-a2a1-6cac7505cd75 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Image pref 0:0:0 {{(pid=117699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 15:44:27.330872 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.virt.hardware [None req-1c38a06e-f57e-4e58-a2a1-6cac7505cd75 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 15:44:27.346501 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1c38a06e-f57e-4e58-a2a1-6cac7505cd75 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:27.347110 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1c38a06e-f57e-4e58-a2a1-6cac7505cd75 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:27.348180 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1c38a06e-f57e-4e58-a2a1-6cac7505cd75 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:27.348882 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1c38a06e-f57e-4e58-a2a1-6cac7505cd75 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:27.368964 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.quota [None req-1c38a06e-f57e-4e58-a2a1-6cac7505cd75 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Getting quotas for project 3c965241379a45d8b9103af1913791a7. Resources: {'instances', 'ram', 'cores'} {{(pid=117699) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 15:44:27.375109 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.quota [None req-1c38a06e-f57e-4e58-a2a1-6cac7505cd75 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Getting quotas for user ca179fc319904fcb9b343c9e7de28e6f and project 3c965241379a45d8b9103af1913791a7. Resources: {'instances', 'ram', 'cores'} {{(pid=117699) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 15:44:27.387270 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-1c38a06e-f57e-4e58-a2a1-6cac7505cd75 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Going to run 1 instances... {{(pid=117699) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 15:44:27.389786 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-1c38a06e-f57e-4e58-a2a1-6cac7505cd75 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [instance: 14af50a7-06c8-4c6e-a797-3e3c55b59d65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f921f75e-bbd1-4d99-ab1e-5cce2d895148',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 15:44:27.444219 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-1c38a06e-f57e-4e58-a2a1-6cac7505cd75 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.755574 May 24 15:44:27.444909 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1455/2918] 10.222.0.45 () {60 vars in 1146 bytes} [Tue May 24 15:44:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 15:44:27.455458 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-55215f66-6a89-4a12-b7ab-81101e5c0c9b tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:27.456068 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-55215f66-6a89-4a12-b7ab-81101e5c0c9b tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [instance: 14af50a7-06c8-4c6e-a797-3e3c55b59d65] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:27.458157 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=76 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:44:27.528289 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-55215f66-6a89-4a12-b7ab-81101e5c0c9b tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca179fc319904fcb9b343c9e7de28e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c965241379a45d8b9103af1913791a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:27.535608 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-55215f66-6a89-4a12-b7ab-81101e5c0c9b tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "GET /compute/v2.1/servers/14af50a7-06c8-4c6e-a797-3e3c55b59d65" status: 200 len: 1242 microversion: 2.1 time: 0.083962 May 24 15:44:27.548481 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1464/2919] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:44:27 2022] GET /compute/v2.1/servers/14af50a7-06c8-4c6e-a797-3e3c55b59d65 => generated 1242 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:28.553941 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a530b3f9-b02a-4cf3-bf19-9d282b3ab95f tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:28.554596 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a530b3f9-b02a-4cf3-bf19-9d282b3ab95f tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [instance: 14af50a7-06c8-4c6e-a797-3e3c55b59d65] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:28.558618 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:44:28.563367 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a530b3f9-b02a-4cf3-bf19-9d282b3ab95f tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:28.563805 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a530b3f9-b02a-4cf3-bf19-9d282b3ab95f tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:28.564598 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a530b3f9-b02a-4cf3-bf19-9d282b3ab95f tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:28.565025 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a530b3f9-b02a-4cf3-bf19-9d282b3ab95f tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:28.634188 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-a530b3f9-b02a-4cf3-bf19-9d282b3ab95f tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca179fc319904fcb9b343c9e7de28e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c965241379a45d8b9103af1913791a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:28.643099 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a530b3f9-b02a-4cf3-bf19-9d282b3ab95f tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "GET /compute/v2.1/servers/14af50a7-06c8-4c6e-a797-3e3c55b59d65" status: 200 len: 1302 microversion: 2.1 time: 0.093886 May 24 15:44:28.643662 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1456/2920] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:44:28 2022] GET /compute/v2.1/servers/14af50a7-06c8-4c6e-a797-3e3c55b59d65 => generated 1302 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:29.659943 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-0cda466a-42ee-4560-a059-2255624d3655 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:29.661269 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-0cda466a-42ee-4560-a059-2255624d3655 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [instance: 14af50a7-06c8-4c6e-a797-3e3c55b59d65] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:29.668684 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0cda466a-42ee-4560-a059-2255624d3655 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:29.669130 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0cda466a-42ee-4560-a059-2255624d3655 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:29.669948 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0cda466a-42ee-4560-a059-2255624d3655 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:29.670589 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0cda466a-42ee-4560-a059-2255624d3655 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:29.884442 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-0cda466a-42ee-4560-a059-2255624d3655 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca179fc319904fcb9b343c9e7de28e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c965241379a45d8b9103af1913791a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:29.892200 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-0cda466a-42ee-4560-a059-2255624d3655 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "GET /compute/v2.1/servers/14af50a7-06c8-4c6e-a797-3e3c55b59d65" status: 200 len: 1368 microversion: 2.1 time: 0.236141 May 24 15:44:29.892796 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1465/2921] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:44:29 2022] GET /compute/v2.1/servers/14af50a7-06c8-4c6e-a797-3e3c55b59d65 => generated 1368 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:30.206273 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [req-811b3d31-1942-4cac-ac1f-81ee709e7f98 req-4dd7c6d8-989f-4e7b-a559-9c860949abe7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14af50a7-06c8-4c6e-a797-3e3c55b59d65", "tag": "4b10cb73-83f2-4d51-8f2c-4c13cc97e7f3"}]} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:44:30.218714 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-811b3d31-1942-4cac-ac1f-81ee709e7f98 req-4dd7c6d8-989f-4e7b-a559-9c860949abe7 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:30.219169 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-811b3d31-1942-4cac-ac1f-81ee709e7f98 req-4dd7c6d8-989f-4e7b-a559-9c860949abe7 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:30.233244 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.compute.server_external_events [req-811b3d31-1942-4cac-ac1f-81ee709e7f98 req-4dd7c6d8-989f-4e7b-a559-9c860949abe7 service nova] Creating event network-changed:4b10cb73-83f2-4d51-8f2c-4c13cc97e7f3 for instance 14af50a7-06c8-4c6e-a797-3e3c55b59d65 on hv-cinder-84315 May 24 15:44:30.238476 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [req-811b3d31-1942-4cac-ac1f-81ee709e7f98 req-4dd7c6d8-989f-4e7b-a559-9c860949abe7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035966 May 24 15:44:30.240460 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1457/2922] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:44:30.908735 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c90a4236-d4f6-49f6-9cec-edbc1b924da0 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:30.909259 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-c90a4236-d4f6-49f6-9cec-edbc1b924da0 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [instance: 14af50a7-06c8-4c6e-a797-3e3c55b59d65] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:30.915675 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c90a4236-d4f6-49f6-9cec-edbc1b924da0 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:30.916117 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c90a4236-d4f6-49f6-9cec-edbc1b924da0 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:30.916897 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c90a4236-d4f6-49f6-9cec-edbc1b924da0 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:30.917325 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c90a4236-d4f6-49f6-9cec-edbc1b924da0 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:31.054839 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-c90a4236-d4f6-49f6-9cec-edbc1b924da0 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca179fc319904fcb9b343c9e7de28e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c965241379a45d8b9103af1913791a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:31.062222 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-c90a4236-d4f6-49f6-9cec-edbc1b924da0 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "GET /compute/v2.1/servers/14af50a7-06c8-4c6e-a797-3e3c55b59d65" status: 200 len: 1368 microversion: 2.1 time: 0.157423 May 24 15:44:31.062775 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1466/2923] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:44:30 2022] GET /compute/v2.1/servers/14af50a7-06c8-4c6e-a797-3e3c55b59d65 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:32.079903 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-4c64181a-96c6-4853-870a-d7fc8528ba4a tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:32.080626 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-4c64181a-96c6-4853-870a-d7fc8528ba4a tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [instance: 14af50a7-06c8-4c6e-a797-3e3c55b59d65] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:32.087354 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4c64181a-96c6-4853-870a-d7fc8528ba4a tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:32.087797 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4c64181a-96c6-4853-870a-d7fc8528ba4a tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:32.088599 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4c64181a-96c6-4853-870a-d7fc8528ba4a tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:32.089031 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4c64181a-96c6-4853-870a-d7fc8528ba4a tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:32.232530 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-4c64181a-96c6-4853-870a-d7fc8528ba4a tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca179fc319904fcb9b343c9e7de28e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c965241379a45d8b9103af1913791a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:32.240868 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-4c64181a-96c6-4853-870a-d7fc8528ba4a tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "GET /compute/v2.1/servers/14af50a7-06c8-4c6e-a797-3e3c55b59d65" status: 200 len: 1368 microversion: 2.1 time: 0.165666 May 24 15:44:32.241430 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1458/2924] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:44:32 2022] GET /compute/v2.1/servers/14af50a7-06c8-4c6e-a797-3e3c55b59d65 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:33.257790 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c75b928c-b996-4b0f-8a55-fd11bdf0a6dd tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:33.258446 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-c75b928c-b996-4b0f-8a55-fd11bdf0a6dd tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [instance: 14af50a7-06c8-4c6e-a797-3e3c55b59d65] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:33.264640 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c75b928c-b996-4b0f-8a55-fd11bdf0a6dd tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:33.265083 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c75b928c-b996-4b0f-8a55-fd11bdf0a6dd tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:33.265825 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c75b928c-b996-4b0f-8a55-fd11bdf0a6dd tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:33.266250 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c75b928c-b996-4b0f-8a55-fd11bdf0a6dd tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:33.391474 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-c75b928c-b996-4b0f-8a55-fd11bdf0a6dd tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca179fc319904fcb9b343c9e7de28e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c965241379a45d8b9103af1913791a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:33.398820 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-c75b928c-b996-4b0f-8a55-fd11bdf0a6dd tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "GET /compute/v2.1/servers/14af50a7-06c8-4c6e-a797-3e3c55b59d65" status: 200 len: 1368 microversion: 2.1 time: 0.144902 May 24 15:44:33.399952 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1467/2925] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:44:33 2022] GET /compute/v2.1/servers/14af50a7-06c8-4c6e-a797-3e3c55b59d65 => generated 1368 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:34.260749 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [req-42032a5e-1a18-4944-8f65-92ea3fb938c2 req-39f81e8b-02c0-4fc9-8c76-2c99df17692f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14af50a7-06c8-4c6e-a797-3e3c55b59d65", "name": "network-vif-plugged", "status": "completed", "tag": "4b10cb73-83f2-4d51-8f2c-4c13cc97e7f3"}]} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:44:34.271977 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-42032a5e-1a18-4944-8f65-92ea3fb938c2 req-39f81e8b-02c0-4fc9-8c76-2c99df17692f service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:34.272550 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-42032a5e-1a18-4944-8f65-92ea3fb938c2 req-39f81e8b-02c0-4fc9-8c76-2c99df17692f service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:34.284709 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.compute.server_external_events [req-42032a5e-1a18-4944-8f65-92ea3fb938c2 req-39f81e8b-02c0-4fc9-8c76-2c99df17692f service nova] Creating event network-vif-plugged:4b10cb73-83f2-4d51-8f2c-4c13cc97e7f3 for instance 14af50a7-06c8-4c6e-a797-3e3c55b59d65 on hv-cinder-84315 May 24 15:44:34.290321 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [req-42032a5e-1a18-4944-8f65-92ea3fb938c2 req-39f81e8b-02c0-4fc9-8c76-2c99df17692f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033778 May 24 15:44:34.290914 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1459/2926] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:44:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:44:34.416402 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-1038942a-5936-4abc-a79a-74238dcc4c80 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:34.417014 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-1038942a-5936-4abc-a79a-74238dcc4c80 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [instance: 14af50a7-06c8-4c6e-a797-3e3c55b59d65] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:34.423461 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1038942a-5936-4abc-a79a-74238dcc4c80 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:34.423903 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1038942a-5936-4abc-a79a-74238dcc4c80 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:34.424683 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1038942a-5936-4abc-a79a-74238dcc4c80 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:34.425233 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1038942a-5936-4abc-a79a-74238dcc4c80 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:34.600420 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-1038942a-5936-4abc-a79a-74238dcc4c80 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca179fc319904fcb9b343c9e7de28e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c965241379a45d8b9103af1913791a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:34.608647 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-1038942a-5936-4abc-a79a-74238dcc4c80 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "GET /compute/v2.1/servers/14af50a7-06c8-4c6e-a797-3e3c55b59d65" status: 200 len: 1368 microversion: 2.1 time: 0.196514 May 24 15:44:34.613760 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1468/2927] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:44:34 2022] GET /compute/v2.1/servers/14af50a7-06c8-4c6e-a797-3e3c55b59d65 => generated 1368 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:35.626554 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-0cd7e3e5-3f2b-4599-8dae-72e59a9ac860 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:35.627170 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-0cd7e3e5-3f2b-4599-8dae-72e59a9ac860 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [instance: 14af50a7-06c8-4c6e-a797-3e3c55b59d65] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:35.634097 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0cd7e3e5-3f2b-4599-8dae-72e59a9ac860 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:35.634536 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0cd7e3e5-3f2b-4599-8dae-72e59a9ac860 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:35.635287 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0cd7e3e5-3f2b-4599-8dae-72e59a9ac860 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:35.635714 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-0cd7e3e5-3f2b-4599-8dae-72e59a9ac860 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:35.770059 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-0cd7e3e5-3f2b-4599-8dae-72e59a9ac860 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca179fc319904fcb9b343c9e7de28e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c965241379a45d8b9103af1913791a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:35.777419 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-0cd7e3e5-3f2b-4599-8dae-72e59a9ac860 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "GET /compute/v2.1/servers/14af50a7-06c8-4c6e-a797-3e3c55b59d65" status: 200 len: 1368 microversion: 2.1 time: 0.155579 May 24 15:44:35.777979 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1460/2928] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:44:35 2022] GET /compute/v2.1/servers/14af50a7-06c8-4c6e-a797-3e3c55b59d65 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:36.794136 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-4386ce05-9e3d-497d-93a5-62697865b44a tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:36.794740 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-4386ce05-9e3d-497d-93a5-62697865b44a tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [instance: 14af50a7-06c8-4c6e-a797-3e3c55b59d65] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:36.801172 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4386ce05-9e3d-497d-93a5-62697865b44a tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:36.801614 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4386ce05-9e3d-497d-93a5-62697865b44a tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:36.802357 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4386ce05-9e3d-497d-93a5-62697865b44a tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:36.802790 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4386ce05-9e3d-497d-93a5-62697865b44a tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:36.931371 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-4386ce05-9e3d-497d-93a5-62697865b44a tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca179fc319904fcb9b343c9e7de28e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c965241379a45d8b9103af1913791a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:36.938774 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-4386ce05-9e3d-497d-93a5-62697865b44a tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "GET /compute/v2.1/servers/14af50a7-06c8-4c6e-a797-3e3c55b59d65" status: 200 len: 1557 microversion: 2.1 time: 0.149039 May 24 15:44:36.939344 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1469/2929] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:44:36 2022] GET /compute/v2.1/servers/14af50a7-06c8-4c6e-a797-3e3c55b59d65 => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:36.956737 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-643c5589-9ef3-4aa8-a82d-e1302d63462a tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:36.957320 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-643c5589-9ef3-4aa8-a82d-e1302d63462a tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [instance: 14af50a7-06c8-4c6e-a797-3e3c55b59d65] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:36.964459 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-643c5589-9ef3-4aa8-a82d-e1302d63462a tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:36.964903 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-643c5589-9ef3-4aa8-a82d-e1302d63462a tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:36.965651 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-643c5589-9ef3-4aa8-a82d-e1302d63462a tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:36.966075 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-643c5589-9ef3-4aa8-a82d-e1302d63462a tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:37.204236 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-643c5589-9ef3-4aa8-a82d-e1302d63462a tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "GET /compute/v2.1/servers/14af50a7-06c8-4c6e-a797-3e3c55b59d65/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.252449 May 24 15:44:37.204847 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1461/2930] 10.222.0.45 () {58 vars in 1274 bytes} [Tue May 24 15:44:36 2022] GET /compute/v2.1/servers/14af50a7-06c8-4c6e-a797-3e3c55b59d65/os-interface => generated 284 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:44:38.104562 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell0:SELECT=6 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:44:38.162489 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [req-b7a26c8b-1a85-49fb-90b3-c23a94c73049 req-158e64bc-0021-4ec9-a589-0f5d588bce37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14af50a7-06c8-4c6e-a797-3e3c55b59d65", "tag": "4b10cb73-83f2-4d51-8f2c-4c13cc97e7f3"}]} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:44:38.171355 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-b7a26c8b-1a85-49fb-90b3-c23a94c73049 req-158e64bc-0021-4ec9-a589-0f5d588bce37 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:38.171797 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-b7a26c8b-1a85-49fb-90b3-c23a94c73049 req-158e64bc-0021-4ec9-a589-0f5d588bce37 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:38.183868 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.compute.server_external_events [req-b7a26c8b-1a85-49fb-90b3-c23a94c73049 req-158e64bc-0021-4ec9-a589-0f5d588bce37 service nova] Creating event network-changed:4b10cb73-83f2-4d51-8f2c-4c13cc97e7f3 for instance 14af50a7-06c8-4c6e-a797-3e3c55b59d65 on hv-cinder-84315 May 24 15:44:38.189168 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [req-b7a26c8b-1a85-49fb-90b3-c23a94c73049 req-158e64bc-0021-4ec9-a589-0f5d588bce37 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089383 May 24 15:44:38.189776 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1470/2931] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:44:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:45:14.274602 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell0:SELECT=2 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:45:14.275301 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell0:SELECT=6 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:45:14.276731 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_api:SELECT=11 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:45:14.277407 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=28 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:45:14.281562 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-835278b6-4082-4ec7-b485-04962fbdc181 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:45:14.282096 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-835278b6-4082-4ec7-b485-04962fbdc181 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [instance: 14af50a7-06c8-4c6e-a797-3e3c55b59d65] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:45:14.290105 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-835278b6-4082-4ec7-b485-04962fbdc181 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:14.291140 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-835278b6-4082-4ec7-b485-04962fbdc181 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:14.291884 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-835278b6-4082-4ec7-b485-04962fbdc181 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:14.292363 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-835278b6-4082-4ec7-b485-04962fbdc181 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:14.315456 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-835278b6-4082-4ec7-b485-04962fbdc181 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "GET /compute/v2.1/servers/14af50a7-06c8-4c6e-a797-3e3c55b59d65/ips" status: 200 len: 148 microversion: 2.1 time: 0.041787 May 24 15:45:14.316001 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1462/2932] 10.222.0.45 () {58 vars in 1247 bytes} [Tue May 24 15:45:14 2022] GET /compute/v2.1/servers/14af50a7-06c8-4c6e-a797-3e3c55b59d65/ips => generated 148 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:45:26.285551 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 15:45:26.286041 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Tue May 24 15:45:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 15:46:14.396700 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7e770269-d0e3-4f7f-b076-1dfeee56f131] AMQP server on 10.222.0.45:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed May 24 15:46:14.397365 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:46:14.399033 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=32 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:46:14.404707 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-79d2d750-71aa-4379-aca8-ff42aa259873 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:14.405286 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-79d2d750-71aa-4379-aca8-ff42aa259873 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [instance: 14af50a7-06c8-4c6e-a797-3e3c55b59d65] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:14.412678 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-79d2d750-71aa-4379-aca8-ff42aa259873 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:14.413141 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-79d2d750-71aa-4379-aca8-ff42aa259873 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:14.413895 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-79d2d750-71aa-4379-aca8-ff42aa259873 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:14.414327 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-79d2d750-71aa-4379-aca8-ff42aa259873 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:14.438832 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-79d2d750-71aa-4379-aca8-ff42aa259873 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [instance: 14af50a7-06c8-4c6e-a797-3e3c55b59d65] Going to try to terminate instance {{(pid=117698) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 15:46:14.514125 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-79d2d750-71aa-4379-aca8-ff42aa259873 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "DELETE /compute/v2.1/servers/14af50a7-06c8-4c6e-a797-3e3c55b59d65" status: 204 len: 0 microversion: 2.1 time: 0.120055 May 24 15:46:14.514729 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1471/2933] 10.222.0.45 () {58 vars in 1238 bytes} [Tue May 24 15:46:14 2022] DELETE /compute/v2.1/servers/14af50a7-06c8-4c6e-a797-3e3c55b59d65 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 15:46:14.521062 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_api:SELECT=2 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:46:14.522490 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=4 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:46:14.527449 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-2d8f5532-2c1d-44a5-a02f-81ac9394047e tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:14.528038 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-2d8f5532-2c1d-44a5-a02f-81ac9394047e tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [instance: 14af50a7-06c8-4c6e-a797-3e3c55b59d65] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:14.534993 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2d8f5532-2c1d-44a5-a02f-81ac9394047e tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:14.535435 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2d8f5532-2c1d-44a5-a02f-81ac9394047e tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:14.536187 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2d8f5532-2c1d-44a5-a02f-81ac9394047e tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:14.536653 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2d8f5532-2c1d-44a5-a02f-81ac9394047e tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:14.749328 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-2d8f5532-2c1d-44a5-a02f-81ac9394047e tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca179fc319904fcb9b343c9e7de28e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c965241379a45d8b9103af1913791a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:46:14.757092 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-2d8f5532-2c1d-44a5-a02f-81ac9394047e tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "GET /compute/v2.1/servers/14af50a7-06c8-4c6e-a797-3e3c55b59d65" status: 200 len: 1681 microversion: 2.1 time: 0.237909 May 24 15:46:14.758257 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1463/2934] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:46:14 2022] GET /compute/v2.1/servers/14af50a7-06c8-4c6e-a797-3e3c55b59d65 => generated 1681 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:46:15.775424 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-7760e646-152d-4f6a-8fda-7f081ea8fb5c tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:15.776117 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-7760e646-152d-4f6a-8fda-7f081ea8fb5c tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [instance: 14af50a7-06c8-4c6e-a797-3e3c55b59d65] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:15.787144 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7760e646-152d-4f6a-8fda-7f081ea8fb5c tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:15.787584 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7760e646-152d-4f6a-8fda-7f081ea8fb5c tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:15.788363 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7760e646-152d-4f6a-8fda-7f081ea8fb5c tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:15.789293 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7760e646-152d-4f6a-8fda-7f081ea8fb5c tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:15.792738 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO oslo.messaging._drivers.impl_rabbit [-] [7e770269-d0e3-4f7f-b076-1dfeee56f131] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 55624. May 24 15:46:15.989585 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-7760e646-152d-4f6a-8fda-7f081ea8fb5c tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca179fc319904fcb9b343c9e7de28e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c965241379a45d8b9103af1913791a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:46:15.997587 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-7760e646-152d-4f6a-8fda-7f081ea8fb5c tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "GET /compute/v2.1/servers/14af50a7-06c8-4c6e-a797-3e3c55b59d65" status: 200 len: 1681 microversion: 2.1 time: 0.226425 May 24 15:46:15.998138 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1472/2935] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:46:15 2022] GET /compute/v2.1/servers/14af50a7-06c8-4c6e-a797-3e3c55b59d65 => generated 1681 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:46:17.015277 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-182c9725-15e3-43de-ba96-7349a81ef55c tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:17.016212 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-182c9725-15e3-43de-ba96-7349a81ef55c tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [instance: 14af50a7-06c8-4c6e-a797-3e3c55b59d65] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:17.023369 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-182c9725-15e3-43de-ba96-7349a81ef55c tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:17.023912 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-182c9725-15e3-43de-ba96-7349a81ef55c tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:17.024770 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-182c9725-15e3-43de-ba96-7349a81ef55c tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:17.025278 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-182c9725-15e3-43de-ba96-7349a81ef55c tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:17.087524 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-182c9725-15e3-43de-ba96-7349a81ef55c tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca179fc319904fcb9b343c9e7de28e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c965241379a45d8b9103af1913791a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:46:17.095486 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-182c9725-15e3-43de-ba96-7349a81ef55c tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "GET /compute/v2.1/servers/14af50a7-06c8-4c6e-a797-3e3c55b59d65" status: 200 len: 1613 microversion: 2.1 time: 0.084476 May 24 15:46:17.096133 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1464/2936] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:46:17 2022] GET /compute/v2.1/servers/14af50a7-06c8-4c6e-a797-3e3c55b59d65 => generated 1613 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:46:17.390124 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [req-60cf6b13-a8d8-450c-9fb3-68a1ab786131 req-3358dc0c-0bf4-417c-b92f-821a562c45d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14af50a7-06c8-4c6e-a797-3e3c55b59d65", "name": "network-vif-deleted", "tag": "4b10cb73-83f2-4d51-8f2c-4c13cc97e7f3"}]} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:46:17.401408 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-60cf6b13-a8d8-450c-9fb3-68a1ab786131 req-3358dc0c-0bf4-417c-b92f-821a562c45d7 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:17.401934 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-60cf6b13-a8d8-450c-9fb3-68a1ab786131 req-3358dc0c-0bf4-417c-b92f-821a562c45d7 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:17.414007 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.compute.server_external_events [req-60cf6b13-a8d8-450c-9fb3-68a1ab786131 req-3358dc0c-0bf4-417c-b92f-821a562c45d7 service nova] Creating event network-vif-deleted:4b10cb73-83f2-4d51-8f2c-4c13cc97e7f3 for instance 14af50a7-06c8-4c6e-a797-3e3c55b59d65 on hv-cinder-84315 May 24 15:46:17.419160 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [req-60cf6b13-a8d8-450c-9fb3-68a1ab786131 req-3358dc0c-0bf4-417c-b92f-821a562c45d7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032780 May 24 15:46:17.420278 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1473/2937] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:46:18.112760 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-da9d01f3-2b40-45f0-9e4e-01badff62126 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:18.113466 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-da9d01f3-2b40-45f0-9e4e-01badff62126 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [instance: 14af50a7-06c8-4c6e-a797-3e3c55b59d65] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:18.127897 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-da9d01f3-2b40-45f0-9e4e-01badff62126 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:18.128379 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-da9d01f3-2b40-45f0-9e4e-01badff62126 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:18.129161 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-da9d01f3-2b40-45f0-9e4e-01badff62126 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:18.129600 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-da9d01f3-2b40-45f0-9e4e-01badff62126 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:18.144506 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.wsgi [None req-da9d01f3-2b40-45f0-9e4e-01badff62126 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] HTTP exception thrown: Instance 14af50a7-06c8-4c6e-a797-3e3c55b59d65 could not be found. May 24 15:46:18.146305 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-da9d01f3-2b40-45f0-9e4e-01badff62126 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Request method failure captured: May 24 15:46:18.146305 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: request: GET /compute/v2.1/servers/14af50a7-06c8-4c6e-a797-3e3c55b59d65 HTTP/1.1 May 24 15:46:18.146305 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Accept: application/json May 24 15:46:18.146305 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Accept-Encoding: identity May 24 15:46:18.146305 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Connection: close May 24 15:46:18.146305 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Content-Length: 0 May 24 15:46:18.146305 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Content-Type: application/json May 24 15:46:18.146305 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Host: 10.222.0.45 May 24 15:46:18.146305 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Openstack-System-Scope: None May 24 15:46:18.146305 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: User-Agent: python-urllib3/1.26.9 May 24 15:46:18.146305 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Auth-Token: gAAAAABijP1YsWLVx2yKd3xZ-7AmopHcskG7Py4h3AywsL7wRiF9sIB3K9XWsOPrepBYhkSC0f8H8voqnNxx3PZo2JJP5pt0hxBmzxUX9XPN-nwQNiEbyPhdB9fPTGyUfX_CHqZfTaARTJ_yNKsMculK3yTKaKnStctkbnkIneIg0uj0XmxB5ZU May 24 15:46:18.146305 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Domain-Id: None May 24 15:46:18.146305 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Domain-Name: None May 24 15:46:18.146305 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Identity-Status: Confirmed May 24 15:46:18.146305 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Is-Admin-Project: True May 24 15:46:18.146305 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Domain-Id: default May 24 15:46:18.146305 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Domain-Name: Default May 24 15:46:18.146305 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Id: 3c965241379a45d8b9103af1913791a7 May 24 15:46:18.146305 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Name: tempest-AttachVolumeNegativeTest-2098560824 May 24 15:46:18.146305 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Role: reader,member May 24 15:46:18.146305 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Roles: reader,member May 24 15:46:18.148216 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3c965241379a45d8b9103af1913791a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3c965241379a45d8b9103af1913791a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3c965241379a45d8b9103af1913791a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3c965241379a45d8b9103af1913791a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 24 15:46:18.148216 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant: tempest-AttachVolumeNegativeTest-2098560824 May 24 15:46:18.148216 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant-Id: 3c965241379a45d8b9103af1913791a7 May 24 15:46:18.148216 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2098560824 May 24 15:46:18.148216 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User: tempest-AttachVolumeNegativeTest-2098560824-project May 24 15:46:18.148216 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Domain-Id: default May 24 15:46:18.148216 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Domain-Name: Default May 24 15:46:18.148216 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Id: ca179fc319904fcb9b343c9e7de28e6f May 24 15:46:18.148216 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Name: tempest-AttachVolumeNegativeTest-2098560824-project May 24 15:46:18.148216 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: method: > May 24 15:46:18.148216 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: exception: Instance 14af50a7-06c8-4c6e-a797-3e3c55b59d65 could not be found. May 24 15:46:18.148216 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: action_args: {'id': '14af50a7-06c8-4c6e-a797-3e3c55b59d65'} May 24 15:46:18.149286 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:46:18.149286 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:46:18.149286 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:46:18.149286 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:46:18.149286 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:46:18.149286 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:46:18.149286 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:46:18.149286 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:46:18.149286 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:46:18.149286 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:46:18.149286 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14af50a7-06c8-4c6e-a797-3e3c55b59d65 could not be found. May 24 15:46:18.149286 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:46:18.149286 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:46:18.149286 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:46:18.149286 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:46:18.149286 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:46:18.149286 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:46:18.149286 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:46:18.149286 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:46:18.149286 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:46:18.151439 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:46:18.151439 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 15:46:18.151439 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 15:46:18.151439 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:46:18.151439 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:46:18.151439 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:46:18.151439 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:46:18.151439 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14af50a7-06c8-4c6e-a797-3e3c55b59d65 could not be found. May 24 15:46:18.151439 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:46:18.151439 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:46:18.151439 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:46:18.151439 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:46:18.151439 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:46:18.151439 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:46:18.151439 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:46:18.151439 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:46:18.151439 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14af50a7-06c8-4c6e-a797-3e3c55b59d65 could not be found. May 24 15:46:18.151439 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:46:18.153216 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-da9d01f3-2b40-45f0-9e4e-01badff62126 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Returning 404 to user: Instance 14af50a7-06c8-4c6e-a797-3e3c55b59d65 could not be found. {{(pid=117699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:46:18.153216 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-da9d01f3-2b40-45f0-9e4e-01badff62126 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "GET /compute/v2.1/servers/14af50a7-06c8-4c6e-a797-3e3c55b59d65" status: 404 len: 111 microversion: 2.1 time: 0.039065 May 24 15:46:18.153216 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1465/2938] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:46:18 2022] GET /compute/v2.1/servers/14af50a7-06c8-4c6e-a797-3e3c55b59d65 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:46:18.157969 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-773c3c42-16b5-47a4-88c5-5816988d21f1 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Calling method '.version_select at 0x7f2dd277ae50>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:18.176285 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-773c3c42-16b5-47a4-88c5-5816988d21f1 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1210249924" status: 202 len: 0 microversion: 2.1 time: 0.023005 May 24 15:46:18.177210 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1474/2939] 10.222.0.45 () {58 vars in 1220 bytes} [Tue May 24 15:46:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1210249924 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 15:46:18.795716 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-0c6958eb-bb02-46d6-9f3b-e1fa6ea2e186 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Action: 'create', calling method: .version_select at 0x7f2dd8235700>, body: {"keypair": {"name": "tempest-keypair-1879487349", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+z2pXsz+/Dp6rNdXk6ZzBESS7r4Z/jOtC/DDi1vsH8VpuL7YPjP9daLuNiyQ+hbqNDagjJWSvTEwqnxcoYIeyyShtZaTX8IGY9+OgSu9tUQSeJKkaUP40wQdNo+/t3Sg=="}} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:46:18.809282 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.quota [None req-0c6958eb-bb02-46d6-9f3b-e1fa6ea2e186 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Getting quotas for project 3c965241379a45d8b9103af1913791a7. Resources: {'key_pairs'} {{(pid=117699) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 15:46:18.813060 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.quota [None req-0c6958eb-bb02-46d6-9f3b-e1fa6ea2e186 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Getting quotas for user ca179fc319904fcb9b343c9e7de28e6f and project 3c965241379a45d8b9103af1913791a7. Resources: {'key_pairs'} {{(pid=117699) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 15:46:18.835162 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-0c6958eb-bb02-46d6-9f3b-e1fa6ea2e186 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.043363 May 24 15:46:18.836285 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1466/2940] 10.222.0.45 () {60 vars in 1158 bytes} [Tue May 24 15:46:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:46:20.288989 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d9fd9f1a-f2a0-4119-823b-ab417d1436ba tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1727777630", "imageRef": "f921f75e-bbd1-4d99-ab1e-5cce2d895148", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "61d3a675-5b96-4570-966d-358ac466c5d5"}], "security_groups": [{"name": "tempest-securitygroup--1209389827"}], "key_name": "tempest-keypair-1879487349", "user_data": "}} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:46:20.387257 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.network.neutron [None req-d9fd9f1a-f2a0-4119-823b-ab417d1436ba tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] validate_networks() for [('61d3a675-5b96-4570-966d-358ac466c5d5', None, None, None, None, None)] {{(pid=117698) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 15:46:20.748785 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.virt.hardware [None req-d9fd9f1a-f2a0-4119-823b-ab417d1436ba tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Flavor limits 0:0:0 {{(pid=117698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 15:46:20.749214 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.virt.hardware [None req-d9fd9f1a-f2a0-4119-823b-ab417d1436ba tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Image limits 0:0:0 {{(pid=117698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 15:46:20.749713 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.virt.hardware [None req-d9fd9f1a-f2a0-4119-823b-ab417d1436ba tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Flavor pref 0:0:0 {{(pid=117698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 15:46:20.750115 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.virt.hardware [None req-d9fd9f1a-f2a0-4119-823b-ab417d1436ba tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Image pref 0:0:0 {{(pid=117698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 15:46:20.750552 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.virt.hardware [None req-d9fd9f1a-f2a0-4119-823b-ab417d1436ba tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 15:46:20.759193 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d9fd9f1a-f2a0-4119-823b-ab417d1436ba tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:20.759630 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d9fd9f1a-f2a0-4119-823b-ab417d1436ba tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:20.760512 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d9fd9f1a-f2a0-4119-823b-ab417d1436ba tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:20.760942 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d9fd9f1a-f2a0-4119-823b-ab417d1436ba tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:20.777689 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.quota [None req-d9fd9f1a-f2a0-4119-823b-ab417d1436ba tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Getting quotas for project 3c965241379a45d8b9103af1913791a7. Resources: {'instances', 'ram', 'cores'} {{(pid=117698) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 15:46:20.781552 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.quota [None req-d9fd9f1a-f2a0-4119-823b-ab417d1436ba tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Getting quotas for user ca179fc319904fcb9b343c9e7de28e6f and project 3c965241379a45d8b9103af1913791a7. Resources: {'instances', 'ram', 'cores'} {{(pid=117698) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 15:46:20.792873 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d9fd9f1a-f2a0-4119-823b-ab417d1436ba tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Going to run 1 instances... {{(pid=117698) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 15:46:20.795355 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d9fd9f1a-f2a0-4119-823b-ab417d1436ba tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [instance: 7502fb75-d125-4862-9e46-a19dd4cef13a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f921f75e-bbd1-4d99-ab1e-5cce2d895148',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 15:46:20.842972 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d9fd9f1a-f2a0-4119-823b-ab417d1436ba tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.559174 May 24 15:46:20.843677 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1475/2941] 10.222.0.45 () {60 vars in 1146 bytes} [Tue May 24 15:46:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 15:46:20.854216 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-4a2c14ef-1d01-4dcb-b341-6ed03caa1f82 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:20.854826 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-4a2c14ef-1d01-4dcb-b341-6ed03caa1f82 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [instance: 7502fb75-d125-4862-9e46-a19dd4cef13a] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:20.909999 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-4a2c14ef-1d01-4dcb-b341-6ed03caa1f82 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca179fc319904fcb9b343c9e7de28e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c965241379a45d8b9103af1913791a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:46:20.918191 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-4a2c14ef-1d01-4dcb-b341-6ed03caa1f82 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "GET /compute/v2.1/servers/7502fb75-d125-4862-9e46-a19dd4cef13a" status: 200 len: 1242 microversion: 2.1 time: 0.068290 May 24 15:46:20.918675 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1467/2942] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:46:20 2022] GET /compute/v2.1/servers/7502fb75-d125-4862-9e46-a19dd4cef13a => generated 1242 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:46:21.936000 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-96c661ea-86b8-41f2-9533-99bb08d33e85 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:21.936632 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-96c661ea-86b8-41f2-9533-99bb08d33e85 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [instance: 7502fb75-d125-4862-9e46-a19dd4cef13a] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:21.943462 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-96c661ea-86b8-41f2-9533-99bb08d33e85 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:21.943902 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-96c661ea-86b8-41f2-9533-99bb08d33e85 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:21.944686 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-96c661ea-86b8-41f2-9533-99bb08d33e85 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:21.945114 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-96c661ea-86b8-41f2-9533-99bb08d33e85 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:22.006737 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-96c661ea-86b8-41f2-9533-99bb08d33e85 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca179fc319904fcb9b343c9e7de28e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c965241379a45d8b9103af1913791a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:46:22.014138 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-96c661ea-86b8-41f2-9533-99bb08d33e85 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "GET /compute/v2.1/servers/7502fb75-d125-4862-9e46-a19dd4cef13a" status: 200 len: 1302 microversion: 2.1 time: 0.082569 May 24 15:46:22.014691 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1476/2943] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:46:21 2022] GET /compute/v2.1/servers/7502fb75-d125-4862-9e46-a19dd4cef13a => generated 1302 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:46:23.031065 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-62045cbc-f9a8-4346-aea1-02288ef49b3a tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:23.031748 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-62045cbc-f9a8-4346-aea1-02288ef49b3a tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [instance: 7502fb75-d125-4862-9e46-a19dd4cef13a] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:23.038444 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-62045cbc-f9a8-4346-aea1-02288ef49b3a tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:23.038882 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-62045cbc-f9a8-4346-aea1-02288ef49b3a tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:23.039646 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-62045cbc-f9a8-4346-aea1-02288ef49b3a tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:23.040078 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-62045cbc-f9a8-4346-aea1-02288ef49b3a tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:23.179520 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-62045cbc-f9a8-4346-aea1-02288ef49b3a tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca179fc319904fcb9b343c9e7de28e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c965241379a45d8b9103af1913791a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:46:23.189861 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-62045cbc-f9a8-4346-aea1-02288ef49b3a tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "GET /compute/v2.1/servers/7502fb75-d125-4862-9e46-a19dd4cef13a" status: 200 len: 1368 microversion: 2.1 time: 0.162710 May 24 15:46:23.195161 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1468/2944] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:46:23 2022] GET /compute/v2.1/servers/7502fb75-d125-4862-9e46-a19dd4cef13a => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:46:23.878368 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [req-9e5598b0-8f3f-4000-9b4b-0d6ca7b9daeb req-2957726b-47ec-49c2-ab85-574200af9109 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7502fb75-d125-4862-9e46-a19dd4cef13a", "tag": "c88c568d-066d-42ae-bfde-5b29c4ae542e"}]} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:46:23.901042 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-9e5598b0-8f3f-4000-9b4b-0d6ca7b9daeb req-2957726b-47ec-49c2-ab85-574200af9109 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:23.905112 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-9e5598b0-8f3f-4000-9b4b-0d6ca7b9daeb req-2957726b-47ec-49c2-ab85-574200af9109 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:23.924077 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.compute.server_external_events [req-9e5598b0-8f3f-4000-9b4b-0d6ca7b9daeb req-2957726b-47ec-49c2-ab85-574200af9109 service nova] Creating event network-changed:c88c568d-066d-42ae-bfde-5b29c4ae542e for instance 7502fb75-d125-4862-9e46-a19dd4cef13a on hv-cinder-84315 May 24 15:46:23.929590 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [req-9e5598b0-8f3f-4000-9b4b-0d6ca7b9daeb req-2957726b-47ec-49c2-ab85-574200af9109 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056014 May 24 15:46:23.930684 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1477/2945] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:46:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:46:24.208431 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f27eec6e-8fa8-40b2-b91c-da7d092efd85 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:24.209055 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f27eec6e-8fa8-40b2-b91c-da7d092efd85 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [instance: 7502fb75-d125-4862-9e46-a19dd4cef13a] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:24.215704 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f27eec6e-8fa8-40b2-b91c-da7d092efd85 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:24.216153 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f27eec6e-8fa8-40b2-b91c-da7d092efd85 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:24.216950 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f27eec6e-8fa8-40b2-b91c-da7d092efd85 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:24.217390 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f27eec6e-8fa8-40b2-b91c-da7d092efd85 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:24.347439 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-f27eec6e-8fa8-40b2-b91c-da7d092efd85 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca179fc319904fcb9b343c9e7de28e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c965241379a45d8b9103af1913791a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:46:24.355570 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f27eec6e-8fa8-40b2-b91c-da7d092efd85 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "GET /compute/v2.1/servers/7502fb75-d125-4862-9e46-a19dd4cef13a" status: 200 len: 1368 microversion: 2.1 time: 0.151049 May 24 15:46:24.356133 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1469/2946] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:46:24 2022] GET /compute/v2.1/servers/7502fb75-d125-4862-9e46-a19dd4cef13a => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:46:25.373559 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e33af80a-cd2f-4d87-91db-43b76af714ea tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:25.374174 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e33af80a-cd2f-4d87-91db-43b76af714ea tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [instance: 7502fb75-d125-4862-9e46-a19dd4cef13a] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:25.380493 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e33af80a-cd2f-4d87-91db-43b76af714ea tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:25.380942 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e33af80a-cd2f-4d87-91db-43b76af714ea tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:25.381695 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e33af80a-cd2f-4d87-91db-43b76af714ea tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:25.382128 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e33af80a-cd2f-4d87-91db-43b76af714ea tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:25.554325 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e33af80a-cd2f-4d87-91db-43b76af714ea tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca179fc319904fcb9b343c9e7de28e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c965241379a45d8b9103af1913791a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:46:25.561740 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e33af80a-cd2f-4d87-91db-43b76af714ea tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "GET /compute/v2.1/servers/7502fb75-d125-4862-9e46-a19dd4cef13a" status: 200 len: 1368 microversion: 2.1 time: 0.192963 May 24 15:46:25.562297 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1478/2947] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:46:25 2022] GET /compute/v2.1/servers/7502fb75-d125-4862-9e46-a19dd4cef13a => generated 1368 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:46:26.578763 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-aa306206-b931-4e23-81c1-1603c0c9aabc tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:26.579372 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-aa306206-b931-4e23-81c1-1603c0c9aabc tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [instance: 7502fb75-d125-4862-9e46-a19dd4cef13a] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:26.586640 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-aa306206-b931-4e23-81c1-1603c0c9aabc tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:26.587125 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-aa306206-b931-4e23-81c1-1603c0c9aabc tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:26.587896 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-aa306206-b931-4e23-81c1-1603c0c9aabc tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:26.588389 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-aa306206-b931-4e23-81c1-1603c0c9aabc tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:26.716513 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-aa306206-b931-4e23-81c1-1603c0c9aabc tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca179fc319904fcb9b343c9e7de28e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c965241379a45d8b9103af1913791a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:46:26.723987 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-aa306206-b931-4e23-81c1-1603c0c9aabc tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "GET /compute/v2.1/servers/7502fb75-d125-4862-9e46-a19dd4cef13a" status: 200 len: 1368 microversion: 2.1 time: 0.149090 May 24 15:46:26.724663 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1470/2948] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:46:26 2022] GET /compute/v2.1/servers/7502fb75-d125-4862-9e46-a19dd4cef13a => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:46:27.739927 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-b02ab2e9-e704-4992-9c52-3cec541ca531 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:27.740538 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-b02ab2e9-e704-4992-9c52-3cec541ca531 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [instance: 7502fb75-d125-4862-9e46-a19dd4cef13a] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:27.747336 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b02ab2e9-e704-4992-9c52-3cec541ca531 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:27.747779 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b02ab2e9-e704-4992-9c52-3cec541ca531 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:27.748559 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b02ab2e9-e704-4992-9c52-3cec541ca531 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:27.748988 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b02ab2e9-e704-4992-9c52-3cec541ca531 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:27.875867 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-b02ab2e9-e704-4992-9c52-3cec541ca531 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca179fc319904fcb9b343c9e7de28e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c965241379a45d8b9103af1913791a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:46:27.883749 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-b02ab2e9-e704-4992-9c52-3cec541ca531 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "GET /compute/v2.1/servers/7502fb75-d125-4862-9e46-a19dd4cef13a" status: 200 len: 1368 microversion: 2.1 time: 0.147686 May 24 15:46:27.884323 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1479/2949] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:46:27 2022] GET /compute/v2.1/servers/7502fb75-d125-4862-9e46-a19dd4cef13a => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:46:28.848621 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [req-dd5f5cb3-922a-4021-b23f-abdca7c3439e req-f91c66be-4407-4560-bec0-a6c859a30108 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7502fb75-d125-4862-9e46-a19dd4cef13a", "name": "network-vif-plugged", "status": "completed", "tag": "c88c568d-066d-42ae-bfde-5b29c4ae542e"}]} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:46:28.857981 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-dd5f5cb3-922a-4021-b23f-abdca7c3439e req-f91c66be-4407-4560-bec0-a6c859a30108 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:28.858445 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-dd5f5cb3-922a-4021-b23f-abdca7c3439e req-f91c66be-4407-4560-bec0-a6c859a30108 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:28.869961 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.compute.server_external_events [req-dd5f5cb3-922a-4021-b23f-abdca7c3439e req-f91c66be-4407-4560-bec0-a6c859a30108 service nova] Creating event network-vif-plugged:c88c568d-066d-42ae-bfde-5b29c4ae542e for instance 7502fb75-d125-4862-9e46-a19dd4cef13a on hv-cinder-84315 May 24 15:46:28.874986 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [req-dd5f5cb3-922a-4021-b23f-abdca7c3439e req-f91c66be-4407-4560-bec0-a6c859a30108 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030342 May 24 15:46:28.875571 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1471/2950] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:46:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:46:28.901252 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d192f783-2da4-41d9-915a-bfa05380df56 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:28.901871 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d192f783-2da4-41d9-915a-bfa05380df56 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [instance: 7502fb75-d125-4862-9e46-a19dd4cef13a] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:28.908351 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d192f783-2da4-41d9-915a-bfa05380df56 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:28.908799 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d192f783-2da4-41d9-915a-bfa05380df56 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:28.909554 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d192f783-2da4-41d9-915a-bfa05380df56 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:28.909977 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d192f783-2da4-41d9-915a-bfa05380df56 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:29.052552 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-d192f783-2da4-41d9-915a-bfa05380df56 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca179fc319904fcb9b343c9e7de28e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c965241379a45d8b9103af1913791a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:46:29.061845 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d192f783-2da4-41d9-915a-bfa05380df56 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "GET /compute/v2.1/servers/7502fb75-d125-4862-9e46-a19dd4cef13a" status: 200 len: 1368 microversion: 2.1 time: 0.165063 May 24 15:46:29.062792 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1480/2951] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:46:28 2022] GET /compute/v2.1/servers/7502fb75-d125-4862-9e46-a19dd4cef13a => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:46:30.079885 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d639e666-87a4-4179-8e59-6e30c214a802 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:30.080635 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d639e666-87a4-4179-8e59-6e30c214a802 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [instance: 7502fb75-d125-4862-9e46-a19dd4cef13a] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:30.087538 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d639e666-87a4-4179-8e59-6e30c214a802 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:30.087980 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d639e666-87a4-4179-8e59-6e30c214a802 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:30.088754 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d639e666-87a4-4179-8e59-6e30c214a802 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:30.089188 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d639e666-87a4-4179-8e59-6e30c214a802 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:30.224903 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-d639e666-87a4-4179-8e59-6e30c214a802 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca179fc319904fcb9b343c9e7de28e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c965241379a45d8b9103af1913791a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:46:30.232293 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d639e666-87a4-4179-8e59-6e30c214a802 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "GET /compute/v2.1/servers/7502fb75-d125-4862-9e46-a19dd4cef13a" status: 200 len: 1368 microversion: 2.1 time: 0.157031 May 24 15:46:30.232880 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1472/2952] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:46:30 2022] GET /compute/v2.1/servers/7502fb75-d125-4862-9e46-a19dd4cef13a => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:46:31.248738 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-866bc22d-fac4-44a8-bbf1-91e4c99837e7 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:31.249353 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-866bc22d-fac4-44a8-bbf1-91e4c99837e7 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [instance: 7502fb75-d125-4862-9e46-a19dd4cef13a] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:31.251822 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell0:SELECT=2 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:46:31.252503 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell0:SELECT=6 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:46:31.258284 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-866bc22d-fac4-44a8-bbf1-91e4c99837e7 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:31.258728 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-866bc22d-fac4-44a8-bbf1-91e4c99837e7 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:31.259481 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-866bc22d-fac4-44a8-bbf1-91e4c99837e7 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:31.259915 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-866bc22d-fac4-44a8-bbf1-91e4c99837e7 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:31.396067 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-866bc22d-fac4-44a8-bbf1-91e4c99837e7 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca179fc319904fcb9b343c9e7de28e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c965241379a45d8b9103af1913791a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:46:31.403959 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-866bc22d-fac4-44a8-bbf1-91e4c99837e7 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "GET /compute/v2.1/servers/7502fb75-d125-4862-9e46-a19dd4cef13a" status: 200 len: 1557 microversion: 2.1 time: 0.159028 May 24 15:46:31.404548 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1481/2953] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:46:31 2022] GET /compute/v2.1/servers/7502fb75-d125-4862-9e46-a19dd4cef13a => generated 1557 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:46:31.420469 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f8bf07b0-6ff2-41cf-9008-bede03aaeaa2 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:31.420980 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f8bf07b0-6ff2-41cf-9008-bede03aaeaa2 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [instance: 7502fb75-d125-4862-9e46-a19dd4cef13a] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:31.422967 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell0:SELECT=6 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:46:31.428701 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f8bf07b0-6ff2-41cf-9008-bede03aaeaa2 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:31.429147 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f8bf07b0-6ff2-41cf-9008-bede03aaeaa2 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:31.429901 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f8bf07b0-6ff2-41cf-9008-bede03aaeaa2 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:31.430331 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f8bf07b0-6ff2-41cf-9008-bede03aaeaa2 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:31.505661 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f8bf07b0-6ff2-41cf-9008-bede03aaeaa2 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "GET /compute/v2.1/servers/7502fb75-d125-4862-9e46-a19dd4cef13a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088989 May 24 15:46:31.506254 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1473/2954] 10.222.0.45 () {58 vars in 1274 bytes} [Tue May 24 15:46:31 2022] GET /compute/v2.1/servers/7502fb75-d125-4862-9e46-a19dd4cef13a/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:46:32.409647 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [req-9a3b4acc-8fe6-416b-9ba0-61f9c33ac6f2 req-3d3a3b02-775c-4a72-b51d-eb66dfc2a28d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7502fb75-d125-4862-9e46-a19dd4cef13a", "tag": "c88c568d-066d-42ae-bfde-5b29c4ae542e"}]} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:46:32.418601 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-9a3b4acc-8fe6-416b-9ba0-61f9c33ac6f2 req-3d3a3b02-775c-4a72-b51d-eb66dfc2a28d service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:32.419043 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-9a3b4acc-8fe6-416b-9ba0-61f9c33ac6f2 req-3d3a3b02-775c-4a72-b51d-eb66dfc2a28d service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:32.430374 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.compute.server_external_events [req-9a3b4acc-8fe6-416b-9ba0-61f9c33ac6f2 req-3d3a3b02-775c-4a72-b51d-eb66dfc2a28d service nova] Creating event network-changed:c88c568d-066d-42ae-bfde-5b29c4ae542e for instance 7502fb75-d125-4862-9e46-a19dd4cef13a on hv-cinder-84315 May 24 15:46:32.435357 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [req-9a3b4acc-8fe6-416b-9ba0-61f9c33ac6f2 req-3d3a3b02-775c-4a72-b51d-eb66dfc2a28d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029325 May 24 15:46:32.435957 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1482/2955] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:47:08.513049 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:47:08.513840 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=44 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:47:08.517888 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e855dbf0-bc71-40cf-a43a-d8e4571b9caf tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:47:08.518431 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-e855dbf0-bc71-40cf-a43a-d8e4571b9caf tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [instance: 7502fb75-d125-4862-9e46-a19dd4cef13a] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:47:08.525550 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e855dbf0-bc71-40cf-a43a-d8e4571b9caf tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:08.525993 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e855dbf0-bc71-40cf-a43a-d8e4571b9caf tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:08.526739 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e855dbf0-bc71-40cf-a43a-d8e4571b9caf tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:08.527170 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e855dbf0-bc71-40cf-a43a-d8e4571b9caf tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:08.550017 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-e855dbf0-bc71-40cf-a43a-d8e4571b9caf tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "GET /compute/v2.1/servers/7502fb75-d125-4862-9e46-a19dd4cef13a/ips" status: 200 len: 148 microversion: 2.1 time: 0.038347 May 24 15:47:08.550569 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1474/2956] 10.222.0.45 () {58 vars in 1247 bytes} [Tue May 24 15:47:08 2022] GET /compute/v2.1/servers/7502fb75-d125-4862-9e46-a19dd4cef13a/ips => generated 148 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:48:08.621512 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:48:08.622254 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:48:08.626783 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-ab3b8ed5-1067-44b6-ad8c-b15a3ac59107 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:48:08.627365 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-ab3b8ed5-1067-44b6-ad8c-b15a3ac59107 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [instance: 7502fb75-d125-4862-9e46-a19dd4cef13a] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:48:08.636632 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ab3b8ed5-1067-44b6-ad8c-b15a3ac59107 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:08.637085 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ab3b8ed5-1067-44b6-ad8c-b15a3ac59107 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:08.637845 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ab3b8ed5-1067-44b6-ad8c-b15a3ac59107 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:08.638284 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ab3b8ed5-1067-44b6-ad8c-b15a3ac59107 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:08.664125 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-ab3b8ed5-1067-44b6-ad8c-b15a3ac59107 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [instance: 7502fb75-d125-4862-9e46-a19dd4cef13a] Going to try to terminate instance {{(pid=117698) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 15:48:08.737218 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-ab3b8ed5-1067-44b6-ad8c-b15a3ac59107 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "DELETE /compute/v2.1/servers/7502fb75-d125-4862-9e46-a19dd4cef13a" status: 204 len: 0 microversion: 2.1 time: 0.117532 May 24 15:48:08.737898 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1483/2957] 10.222.0.45 () {58 vars in 1238 bytes} [Tue May 24 15:48:08 2022] DELETE /compute/v2.1/servers/7502fb75-d125-4862-9e46-a19dd4cef13a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 15:48:08.748342 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-1f7ad511-25a8-438e-b67a-7fc160a4c62a tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:48:08.748954 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-1f7ad511-25a8-438e-b67a-7fc160a4c62a tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [instance: 7502fb75-d125-4862-9e46-a19dd4cef13a] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:48:08.751060 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_api:SELECT=2 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:48:08.751730 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=4 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:48:08.757953 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1f7ad511-25a8-438e-b67a-7fc160a4c62a tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:08.758397 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1f7ad511-25a8-438e-b67a-7fc160a4c62a tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:08.759789 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1f7ad511-25a8-438e-b67a-7fc160a4c62a tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:08.760224 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1f7ad511-25a8-438e-b67a-7fc160a4c62a tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:08.887541 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-1f7ad511-25a8-438e-b67a-7fc160a4c62a tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca179fc319904fcb9b343c9e7de28e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c965241379a45d8b9103af1913791a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:48:08.894911 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-1f7ad511-25a8-438e-b67a-7fc160a4c62a tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "GET /compute/v2.1/servers/7502fb75-d125-4862-9e46-a19dd4cef13a" status: 200 len: 1681 microversion: 2.1 time: 0.152867 May 24 15:48:08.895464 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1475/2958] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:48:08 2022] GET /compute/v2.1/servers/7502fb75-d125-4862-9e46-a19dd4cef13a => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:48:09.912567 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-680b24c9-fe7f-4f76-82b4-fded0359461e tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:48:09.913261 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-680b24c9-fe7f-4f76-82b4-fded0359461e tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [instance: 7502fb75-d125-4862-9e46-a19dd4cef13a] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:48:09.920164 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-680b24c9-fe7f-4f76-82b4-fded0359461e tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:09.920635 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-680b24c9-fe7f-4f76-82b4-fded0359461e tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:09.921379 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-680b24c9-fe7f-4f76-82b4-fded0359461e tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:09.921807 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-680b24c9-fe7f-4f76-82b4-fded0359461e tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:10.047775 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-680b24c9-fe7f-4f76-82b4-fded0359461e tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca179fc319904fcb9b343c9e7de28e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c965241379a45d8b9103af1913791a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:48:10.055154 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-680b24c9-fe7f-4f76-82b4-fded0359461e tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "GET /compute/v2.1/servers/7502fb75-d125-4862-9e46-a19dd4cef13a" status: 200 len: 1681 microversion: 2.1 time: 0.146820 May 24 15:48:10.055714 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1484/2959] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:48:09 2022] GET /compute/v2.1/servers/7502fb75-d125-4862-9e46-a19dd4cef13a => generated 1681 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:48:11.074085 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e17dca76-4649-4edf-aff2-5e224029a754 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:48:11.074784 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-e17dca76-4649-4edf-aff2-5e224029a754 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [instance: 7502fb75-d125-4862-9e46-a19dd4cef13a] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:48:11.081517 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e17dca76-4649-4edf-aff2-5e224029a754 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:11.081958 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e17dca76-4649-4edf-aff2-5e224029a754 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:11.082719 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e17dca76-4649-4edf-aff2-5e224029a754 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:11.083143 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e17dca76-4649-4edf-aff2-5e224029a754 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:11.218132 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-e17dca76-4649-4edf-aff2-5e224029a754 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca179fc319904fcb9b343c9e7de28e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c965241379a45d8b9103af1913791a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:48:11.225884 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-e17dca76-4649-4edf-aff2-5e224029a754 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "GET /compute/v2.1/servers/7502fb75-d125-4862-9e46-a19dd4cef13a" status: 200 len: 1681 microversion: 2.1 time: 0.156567 May 24 15:48:11.226461 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1476/2960] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:48:11 2022] GET /compute/v2.1/servers/7502fb75-d125-4862-9e46-a19dd4cef13a => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:48:11.646166 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [req-1b561612-f99b-47da-9ca1-01e1f6f99f48 req-dce3822a-6285-47a4-a1e1-e5bff57b21e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7502fb75-d125-4862-9e46-a19dd4cef13a", "name": "network-vif-deleted", "tag": "c88c568d-066d-42ae-bfde-5b29c4ae542e"}]} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:48:11.654624 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-1b561612-f99b-47da-9ca1-01e1f6f99f48 req-dce3822a-6285-47a4-a1e1-e5bff57b21e4 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:11.657771 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-1b561612-f99b-47da-9ca1-01e1f6f99f48 req-dce3822a-6285-47a4-a1e1-e5bff57b21e4 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:11.670431 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.compute.server_external_events [req-1b561612-f99b-47da-9ca1-01e1f6f99f48 req-dce3822a-6285-47a4-a1e1-e5bff57b21e4 service nova] Creating event network-vif-deleted:c88c568d-066d-42ae-bfde-5b29c4ae542e for instance 7502fb75-d125-4862-9e46-a19dd4cef13a on hv-cinder-84315 May 24 15:48:11.675948 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [req-1b561612-f99b-47da-9ca1-01e1f6f99f48 req-dce3822a-6285-47a4-a1e1-e5bff57b21e4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093030 May 24 15:48:11.680424 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1485/2961] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:48:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:48:12.244903 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-9763666f-f7a3-4d51-9e50-c6e05ed3a683 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:48:12.246249 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-9763666f-f7a3-4d51-9e50-c6e05ed3a683 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [instance: 7502fb75-d125-4862-9e46-a19dd4cef13a] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:48:12.254550 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9763666f-f7a3-4d51-9e50-c6e05ed3a683 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:12.255519 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9763666f-f7a3-4d51-9e50-c6e05ed3a683 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:12.256241 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9763666f-f7a3-4d51-9e50-c6e05ed3a683 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:12.256786 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9763666f-f7a3-4d51-9e50-c6e05ed3a683 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:12.271152 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.wsgi [None req-9763666f-f7a3-4d51-9e50-c6e05ed3a683 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] HTTP exception thrown: Instance 7502fb75-d125-4862-9e46-a19dd4cef13a could not be found. May 24 15:48:12.272957 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-9763666f-f7a3-4d51-9e50-c6e05ed3a683 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Request method failure captured: May 24 15:48:12.272957 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: request: GET /compute/v2.1/servers/7502fb75-d125-4862-9e46-a19dd4cef13a HTTP/1.1 May 24 15:48:12.272957 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Accept: application/json May 24 15:48:12.272957 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Accept-Encoding: identity May 24 15:48:12.272957 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Connection: close May 24 15:48:12.272957 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Content-Length: 0 May 24 15:48:12.272957 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Content-Type: application/json May 24 15:48:12.272957 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Host: 10.222.0.45 May 24 15:48:12.272957 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Openstack-System-Scope: None May 24 15:48:12.272957 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: User-Agent: python-urllib3/1.26.9 May 24 15:48:12.272957 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Auth-Token: gAAAAABijP1YsWLVx2yKd3xZ-7AmopHcskG7Py4h3AywsL7wRiF9sIB3K9XWsOPrepBYhkSC0f8H8voqnNxx3PZo2JJP5pt0hxBmzxUX9XPN-nwQNiEbyPhdB9fPTGyUfX_CHqZfTaARTJ_yNKsMculK3yTKaKnStctkbnkIneIg0uj0XmxB5ZU May 24 15:48:12.272957 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Domain-Id: None May 24 15:48:12.272957 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Domain-Name: None May 24 15:48:12.272957 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Identity-Status: Confirmed May 24 15:48:12.272957 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Is-Admin-Project: True May 24 15:48:12.272957 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Domain-Id: default May 24 15:48:12.272957 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Domain-Name: Default May 24 15:48:12.272957 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Id: 3c965241379a45d8b9103af1913791a7 May 24 15:48:12.272957 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Name: tempest-AttachVolumeNegativeTest-2098560824 May 24 15:48:12.272957 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Role: reader,member May 24 15:48:12.272957 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Roles: reader,member May 24 15:48:12.274543 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3c965241379a45d8b9103af1913791a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3c965241379a45d8b9103af1913791a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3c965241379a45d8b9103af1913791a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3c965241379a45d8b9103af1913791a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 24 15:48:12.274543 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant: tempest-AttachVolumeNegativeTest-2098560824 May 24 15:48:12.274543 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant-Id: 3c965241379a45d8b9103af1913791a7 May 24 15:48:12.274543 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2098560824 May 24 15:48:12.274543 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User: tempest-AttachVolumeNegativeTest-2098560824-project May 24 15:48:12.274543 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Domain-Id: default May 24 15:48:12.274543 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Domain-Name: Default May 24 15:48:12.274543 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Id: ca179fc319904fcb9b343c9e7de28e6f May 24 15:48:12.274543 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Name: tempest-AttachVolumeNegativeTest-2098560824-project May 24 15:48:12.274543 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: method: > May 24 15:48:12.274543 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: exception: Instance 7502fb75-d125-4862-9e46-a19dd4cef13a could not be found. May 24 15:48:12.274543 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: action_args: {'id': '7502fb75-d125-4862-9e46-a19dd4cef13a'} May 24 15:48:12.275482 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:48:12.275482 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:48:12.275482 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:48:12.275482 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:48:12.275482 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:48:12.275482 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:48:12.275482 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:48:12.275482 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:48:12.275482 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:48:12.275482 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:48:12.275482 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7502fb75-d125-4862-9e46-a19dd4cef13a could not be found. May 24 15:48:12.275482 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:48:12.275482 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:48:12.275482 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:48:12.275482 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:48:12.275482 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:48:12.275482 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:48:12.275482 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:48:12.275482 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:48:12.275482 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:48:12.276987 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:48:12.276987 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 15:48:12.276987 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 15:48:12.276987 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:48:12.276987 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:48:12.276987 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:48:12.276987 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:48:12.276987 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7502fb75-d125-4862-9e46-a19dd4cef13a could not be found. May 24 15:48:12.276987 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:48:12.276987 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:48:12.276987 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:48:12.276987 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:48:12.276987 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:48:12.276987 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:48:12.276987 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:48:12.276987 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:48:12.276987 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7502fb75-d125-4862-9e46-a19dd4cef13a could not be found. May 24 15:48:12.276987 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:48:12.279639 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-9763666f-f7a3-4d51-9e50-c6e05ed3a683 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Returning 404 to user: Instance 7502fb75-d125-4862-9e46-a19dd4cef13a could not be found. {{(pid=117699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:48:12.280738 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-9763666f-f7a3-4d51-9e50-c6e05ed3a683 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "GET /compute/v2.1/servers/7502fb75-d125-4862-9e46-a19dd4cef13a" status: 404 len: 111 microversion: 2.1 time: 0.041553 May 24 15:48:12.281298 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1477/2962] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:48:12 2022] GET /compute/v2.1/servers/7502fb75-d125-4862-9e46-a19dd4cef13a => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 24 15:48:12.291891 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-5a07b787-a5ca-4adc-9aa8-f9fc66a73176 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Calling method '.version_select at 0x7f2dd8b10790>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:48:12.311671 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-5a07b787-a5ca-4adc-9aa8-f9fc66a73176 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1879487349" status: 202 len: 0 microversion: 2.1 time: 0.024914 May 24 15:48:12.312860 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1486/2963] 10.222.0.45 () {58 vars in 1220 bytes} [Tue May 24 15:48:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1879487349 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 15:48:13.019628 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-6acbc117-99c8-41ed-9f54-d709bdddbd1d tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Action: 'create', calling method: .version_select at 0x7f2dd2bcc4c0>, body: {"keypair": {"name": "tempest-keypair-2047797508", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLpoJfBvUHg0CkQJxOMf4Je1TpAQlBpQrHhZ/hVAGAawMykxPgpyVrEnFkNBHKSFSjgxQpICIKlfaOGHOZDQL93Ix5xUPoQX1cw2Tj212xBIqIe4/VpnKdhR0mBuNDa89w=="}} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:48:13.034259 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.quota [None req-6acbc117-99c8-41ed-9f54-d709bdddbd1d tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Getting quotas for project 3c965241379a45d8b9103af1913791a7. Resources: {'key_pairs'} {{(pid=117699) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 15:48:13.038089 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.quota [None req-6acbc117-99c8-41ed-9f54-d709bdddbd1d tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Getting quotas for user ca179fc319904fcb9b343c9e7de28e6f and project 3c965241379a45d8b9103af1913791a7. Resources: {'key_pairs'} {{(pid=117699) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 15:48:13.059678 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-6acbc117-99c8-41ed-9f54-d709bdddbd1d tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.043986 May 24 15:48:13.060381 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1478/2964] 10.222.0.45 () {60 vars in 1158 bytes} [Tue May 24 15:48:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:48:14.314581 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-f776ccb9-3f5b-4b70-823e-dd896494d6d2 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-548881980", "imageRef": "f921f75e-bbd1-4d99-ab1e-5cce2d895148", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "61d3a675-5b96-4570-966d-358ac466c5d5"}], "security_groups": [{"name": "tempest-securitygroup--953261341"}], "key_name": "tempest-keypair-2047797508", "user_data": "}} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:48:14.416153 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.network.neutron [None req-f776ccb9-3f5b-4b70-823e-dd896494d6d2 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] validate_networks() for [('61d3a675-5b96-4570-966d-358ac466c5d5', None, None, None, None, None)] {{(pid=117698) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 15:48:14.811331 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.virt.hardware [None req-f776ccb9-3f5b-4b70-823e-dd896494d6d2 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Flavor limits 0:0:0 {{(pid=117698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 15:48:14.811752 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.virt.hardware [None req-f776ccb9-3f5b-4b70-823e-dd896494d6d2 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Image limits 0:0:0 {{(pid=117698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 15:48:14.812225 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.virt.hardware [None req-f776ccb9-3f5b-4b70-823e-dd896494d6d2 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Flavor pref 0:0:0 {{(pid=117698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 15:48:14.812664 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.virt.hardware [None req-f776ccb9-3f5b-4b70-823e-dd896494d6d2 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Image pref 0:0:0 {{(pid=117698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 15:48:14.813070 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.virt.hardware [None req-f776ccb9-3f5b-4b70-823e-dd896494d6d2 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 15:48:14.821714 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f776ccb9-3f5b-4b70-823e-dd896494d6d2 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:14.822156 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f776ccb9-3f5b-4b70-823e-dd896494d6d2 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:14.822940 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f776ccb9-3f5b-4b70-823e-dd896494d6d2 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:14.823365 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f776ccb9-3f5b-4b70-823e-dd896494d6d2 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:14.840763 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.quota [None req-f776ccb9-3f5b-4b70-823e-dd896494d6d2 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Getting quotas for project 3c965241379a45d8b9103af1913791a7. Resources: {'instances', 'ram', 'cores'} {{(pid=117698) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 15:48:14.844632 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.quota [None req-f776ccb9-3f5b-4b70-823e-dd896494d6d2 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Getting quotas for user ca179fc319904fcb9b343c9e7de28e6f and project 3c965241379a45d8b9103af1913791a7. Resources: {'instances', 'ram', 'cores'} {{(pid=117698) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 15:48:14.855850 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-f776ccb9-3f5b-4b70-823e-dd896494d6d2 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Going to run 1 instances... {{(pid=117698) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 15:48:14.858187 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-f776ccb9-3f5b-4b70-823e-dd896494d6d2 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [instance: 3e045642-4286-4b5c-8dc4-75208acf078b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f921f75e-bbd1-4d99-ab1e-5cce2d895148',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 15:48:14.903689 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-f776ccb9-3f5b-4b70-823e-dd896494d6d2 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.593868 May 24 15:48:14.904387 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1487/2965] 10.222.0.45 () {60 vars in 1146 bytes} [Tue May 24 15:48:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 15:48:14.914756 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-27b2082a-8352-4443-a469-1f1ed1c6492b tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:48:14.915364 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-27b2082a-8352-4443-a469-1f1ed1c6492b tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [instance: 3e045642-4286-4b5c-8dc4-75208acf078b] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:48:14.974385 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-27b2082a-8352-4443-a469-1f1ed1c6492b tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca179fc319904fcb9b343c9e7de28e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c965241379a45d8b9103af1913791a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:48:14.981314 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-27b2082a-8352-4443-a469-1f1ed1c6492b tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "GET /compute/v2.1/servers/3e045642-4286-4b5c-8dc4-75208acf078b" status: 200 len: 1241 microversion: 2.1 time: 0.070866 May 24 15:48:14.981876 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1479/2966] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:48:14 2022] GET /compute/v2.1/servers/3e045642-4286-4b5c-8dc4-75208acf078b => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:48:15.999200 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-7c81f7dc-7ba2-40a3-a1dd-b3b6c65f6d6a tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:48:15.999940 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-7c81f7dc-7ba2-40a3-a1dd-b3b6c65f6d6a tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [instance: 3e045642-4286-4b5c-8dc4-75208acf078b] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:48:16.006305 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7c81f7dc-7ba2-40a3-a1dd-b3b6c65f6d6a tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:16.006747 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7c81f7dc-7ba2-40a3-a1dd-b3b6c65f6d6a tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:16.007501 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7c81f7dc-7ba2-40a3-a1dd-b3b6c65f6d6a tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:16.007932 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7c81f7dc-7ba2-40a3-a1dd-b3b6c65f6d6a tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:16.078559 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-7c81f7dc-7ba2-40a3-a1dd-b3b6c65f6d6a tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca179fc319904fcb9b343c9e7de28e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c965241379a45d8b9103af1913791a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:48:16.084757 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-7c81f7dc-7ba2-40a3-a1dd-b3b6c65f6d6a tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "GET /compute/v2.1/servers/3e045642-4286-4b5c-8dc4-75208acf078b" status: 200 len: 1301 microversion: 2.1 time: 0.090592 May 24 15:48:16.085343 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1488/2967] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:48:15 2022] GET /compute/v2.1/servers/3e045642-4286-4b5c-8dc4-75208acf078b => generated 1301 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:48:17.102038 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-21743848-c1b5-4fcd-95a5-4c5756ce4d32 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:48:17.102660 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-21743848-c1b5-4fcd-95a5-4c5756ce4d32 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [instance: 3e045642-4286-4b5c-8dc4-75208acf078b] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:48:17.110081 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-21743848-c1b5-4fcd-95a5-4c5756ce4d32 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:17.111102 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-21743848-c1b5-4fcd-95a5-4c5756ce4d32 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:17.111300 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-21743848-c1b5-4fcd-95a5-4c5756ce4d32 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:17.111830 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-21743848-c1b5-4fcd-95a5-4c5756ce4d32 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:17.261441 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-21743848-c1b5-4fcd-95a5-4c5756ce4d32 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca179fc319904fcb9b343c9e7de28e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c965241379a45d8b9103af1913791a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:48:17.268871 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-21743848-c1b5-4fcd-95a5-4c5756ce4d32 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "GET /compute/v2.1/servers/3e045642-4286-4b5c-8dc4-75208acf078b" status: 200 len: 1366 microversion: 2.1 time: 0.170758 May 24 15:48:17.269783 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1480/2968] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:48:17 2022] GET /compute/v2.1/servers/3e045642-4286-4b5c-8dc4-75208acf078b => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:48:17.605947 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [req-f1159d86-e9ca-4549-b977-9f1a59ed9dab req-b588da0d-fa34-4dcd-9f0a-85e8ee8a24be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e045642-4286-4b5c-8dc4-75208acf078b", "tag": "4c46d6cc-b0d8-42a1-8637-56fdb5a2c74e"}]} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:48:17.616559 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-f1159d86-e9ca-4549-b977-9f1a59ed9dab req-b588da0d-fa34-4dcd-9f0a-85e8ee8a24be service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:17.617556 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-f1159d86-e9ca-4549-b977-9f1a59ed9dab req-b588da0d-fa34-4dcd-9f0a-85e8ee8a24be service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:17.631616 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.compute.server_external_events [req-f1159d86-e9ca-4549-b977-9f1a59ed9dab req-b588da0d-fa34-4dcd-9f0a-85e8ee8a24be service nova] Creating event network-changed:4c46d6cc-b0d8-42a1-8637-56fdb5a2c74e for instance 3e045642-4286-4b5c-8dc4-75208acf078b on hv-cinder-84315 May 24 15:48:17.637130 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [req-f1159d86-e9ca-4549-b977-9f1a59ed9dab req-b588da0d-fa34-4dcd-9f0a-85e8ee8a24be service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036384 May 24 15:48:17.637687 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1489/2969] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:48:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:48:18.286408 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-403b4899-8af2-489b-8854-572183b3e3b9 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:48:18.286994 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-403b4899-8af2-489b-8854-572183b3e3b9 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [instance: 3e045642-4286-4b5c-8dc4-75208acf078b] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:48:18.293544 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-403b4899-8af2-489b-8854-572183b3e3b9 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:18.293991 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-403b4899-8af2-489b-8854-572183b3e3b9 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:18.294742 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-403b4899-8af2-489b-8854-572183b3e3b9 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:18.295173 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-403b4899-8af2-489b-8854-572183b3e3b9 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:18.423105 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-403b4899-8af2-489b-8854-572183b3e3b9 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca179fc319904fcb9b343c9e7de28e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c965241379a45d8b9103af1913791a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:48:18.430574 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-403b4899-8af2-489b-8854-572183b3e3b9 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "GET /compute/v2.1/servers/3e045642-4286-4b5c-8dc4-75208acf078b" status: 200 len: 1366 microversion: 2.1 time: 0.148018 May 24 15:48:18.431141 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1481/2970] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:48:18 2022] GET /compute/v2.1/servers/3e045642-4286-4b5c-8dc4-75208acf078b => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:48:19.449231 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-4bf9aedf-d95c-4a18-ba9e-e2d4f7a3b671 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:48:19.449941 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-4bf9aedf-d95c-4a18-ba9e-e2d4f7a3b671 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [instance: 3e045642-4286-4b5c-8dc4-75208acf078b] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:48:19.456040 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4bf9aedf-d95c-4a18-ba9e-e2d4f7a3b671 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:19.456520 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4bf9aedf-d95c-4a18-ba9e-e2d4f7a3b671 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:19.457265 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4bf9aedf-d95c-4a18-ba9e-e2d4f7a3b671 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:19.457690 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4bf9aedf-d95c-4a18-ba9e-e2d4f7a3b671 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:19.654282 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-4bf9aedf-d95c-4a18-ba9e-e2d4f7a3b671 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca179fc319904fcb9b343c9e7de28e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c965241379a45d8b9103af1913791a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:48:19.661778 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-4bf9aedf-d95c-4a18-ba9e-e2d4f7a3b671 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "GET /compute/v2.1/servers/3e045642-4286-4b5c-8dc4-75208acf078b" status: 200 len: 1366 microversion: 2.1 time: 0.217699 May 24 15:48:19.662349 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1490/2971] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:48:19 2022] GET /compute/v2.1/servers/3e045642-4286-4b5c-8dc4-75208acf078b => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:48:20.678280 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a9405097-ee28-473e-b552-d3ec6d1cf988 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:48:20.678927 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a9405097-ee28-473e-b552-d3ec6d1cf988 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [instance: 3e045642-4286-4b5c-8dc4-75208acf078b] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:48:20.686019 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a9405097-ee28-473e-b552-d3ec6d1cf988 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:20.686467 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a9405097-ee28-473e-b552-d3ec6d1cf988 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:20.687221 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a9405097-ee28-473e-b552-d3ec6d1cf988 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:20.687657 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a9405097-ee28-473e-b552-d3ec6d1cf988 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:20.815214 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-a9405097-ee28-473e-b552-d3ec6d1cf988 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca179fc319904fcb9b343c9e7de28e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c965241379a45d8b9103af1913791a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:48:20.823274 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a9405097-ee28-473e-b552-d3ec6d1cf988 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "GET /compute/v2.1/servers/3e045642-4286-4b5c-8dc4-75208acf078b" status: 200 len: 1366 microversion: 2.1 time: 0.148208 May 24 15:48:20.823837 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1482/2972] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:48:20 2022] GET /compute/v2.1/servers/3e045642-4286-4b5c-8dc4-75208acf078b => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:48:21.838878 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-6b6e871e-2179-4adc-b323-94ca90341ce0 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:48:21.840046 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-6b6e871e-2179-4adc-b323-94ca90341ce0 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [instance: 3e045642-4286-4b5c-8dc4-75208acf078b] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:48:21.846511 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6b6e871e-2179-4adc-b323-94ca90341ce0 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:21.846957 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6b6e871e-2179-4adc-b323-94ca90341ce0 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:21.847708 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6b6e871e-2179-4adc-b323-94ca90341ce0 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:21.848140 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6b6e871e-2179-4adc-b323-94ca90341ce0 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:21.979005 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-6b6e871e-2179-4adc-b323-94ca90341ce0 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca179fc319904fcb9b343c9e7de28e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c965241379a45d8b9103af1913791a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:48:21.986585 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-6b6e871e-2179-4adc-b323-94ca90341ce0 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "GET /compute/v2.1/servers/3e045642-4286-4b5c-8dc4-75208acf078b" status: 200 len: 1366 microversion: 2.1 time: 0.151592 May 24 15:48:21.987156 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1491/2973] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:48:21 2022] GET /compute/v2.1/servers/3e045642-4286-4b5c-8dc4-75208acf078b => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:48:23.002745 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d29047a3-24f6-4447-aeba-1b5c1a1bfb49 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:48:23.003360 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d29047a3-24f6-4447-aeba-1b5c1a1bfb49 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [instance: 3e045642-4286-4b5c-8dc4-75208acf078b] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:48:23.009874 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d29047a3-24f6-4447-aeba-1b5c1a1bfb49 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:23.010327 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d29047a3-24f6-4447-aeba-1b5c1a1bfb49 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:23.011087 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d29047a3-24f6-4447-aeba-1b5c1a1bfb49 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:23.011519 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d29047a3-24f6-4447-aeba-1b5c1a1bfb49 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:23.139942 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-d29047a3-24f6-4447-aeba-1b5c1a1bfb49 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca179fc319904fcb9b343c9e7de28e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c965241379a45d8b9103af1913791a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:48:23.147405 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d29047a3-24f6-4447-aeba-1b5c1a1bfb49 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "GET /compute/v2.1/servers/3e045642-4286-4b5c-8dc4-75208acf078b" status: 200 len: 1366 microversion: 2.1 time: 0.148476 May 24 15:48:23.148009 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1483/2974] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:48:22 2022] GET /compute/v2.1/servers/3e045642-4286-4b5c-8dc4-75208acf078b => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:48:23.512767 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [req-424bfaeb-03f9-4cc2-b401-381e879b5a0b req-294fb907-23b7-4ddd-9d86-b2e9e0e9bd74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e045642-4286-4b5c-8dc4-75208acf078b", "name": "network-vif-plugged", "status": "completed", "tag": "4c46d6cc-b0d8-42a1-8637-56fdb5a2c74e"}]} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:48:23.521010 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-424bfaeb-03f9-4cc2-b401-381e879b5a0b req-294fb907-23b7-4ddd-9d86-b2e9e0e9bd74 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:23.521562 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-424bfaeb-03f9-4cc2-b401-381e879b5a0b req-294fb907-23b7-4ddd-9d86-b2e9e0e9bd74 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:23.533212 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.compute.server_external_events [req-424bfaeb-03f9-4cc2-b401-381e879b5a0b req-294fb907-23b7-4ddd-9d86-b2e9e0e9bd74 service nova] Creating event network-vif-plugged:4c46d6cc-b0d8-42a1-8637-56fdb5a2c74e for instance 3e045642-4286-4b5c-8dc4-75208acf078b on hv-cinder-84315 May 24 15:48:23.537949 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [req-424bfaeb-03f9-4cc2-b401-381e879b5a0b req-294fb907-23b7-4ddd-9d86-b2e9e0e9bd74 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084764 May 24 15:48:23.538508 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1492/2975] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:48:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:48:24.164610 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-96dba7df-e623-4920-9647-5d1fb15f2623 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:48:24.165162 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-96dba7df-e623-4920-9647-5d1fb15f2623 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [instance: 3e045642-4286-4b5c-8dc4-75208acf078b] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:48:24.172142 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-96dba7df-e623-4920-9647-5d1fb15f2623 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:24.172617 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-96dba7df-e623-4920-9647-5d1fb15f2623 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:24.173377 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-96dba7df-e623-4920-9647-5d1fb15f2623 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:24.173810 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-96dba7df-e623-4920-9647-5d1fb15f2623 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:24.301398 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-96dba7df-e623-4920-9647-5d1fb15f2623 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca179fc319904fcb9b343c9e7de28e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c965241379a45d8b9103af1913791a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:48:24.308824 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-96dba7df-e623-4920-9647-5d1fb15f2623 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "GET /compute/v2.1/servers/3e045642-4286-4b5c-8dc4-75208acf078b" status: 200 len: 1366 microversion: 2.1 time: 0.148180 May 24 15:48:24.309463 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1484/2976] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:48:24 2022] GET /compute/v2.1/servers/3e045642-4286-4b5c-8dc4-75208acf078b => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:48:25.323006 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell0:SELECT=2 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:48:25.324220 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell0:SELECT=6 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:48:25.328156 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-4fe733df-4252-4401-aa7f-240a4f3f4192 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:48:25.328871 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-4fe733df-4252-4401-aa7f-240a4f3f4192 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [instance: 3e045642-4286-4b5c-8dc4-75208acf078b] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:48:25.335870 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4fe733df-4252-4401-aa7f-240a4f3f4192 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:25.336335 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4fe733df-4252-4401-aa7f-240a4f3f4192 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:25.337076 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4fe733df-4252-4401-aa7f-240a4f3f4192 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:25.337503 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4fe733df-4252-4401-aa7f-240a4f3f4192 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:25.462944 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-4fe733df-4252-4401-aa7f-240a4f3f4192 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca179fc319904fcb9b343c9e7de28e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c965241379a45d8b9103af1913791a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:48:25.470323 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-4fe733df-4252-4401-aa7f-240a4f3f4192 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "GET /compute/v2.1/servers/3e045642-4286-4b5c-8dc4-75208acf078b" status: 200 len: 1366 microversion: 2.1 time: 0.148755 May 24 15:48:25.470893 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1493/2977] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:48:25 2022] GET /compute/v2.1/servers/3e045642-4286-4b5c-8dc4-75208acf078b => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:48:26.486931 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-549bc555-bf14-4143-ba03-73c72664411e tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:48:26.487571 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-549bc555-bf14-4143-ba03-73c72664411e tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [instance: 3e045642-4286-4b5c-8dc4-75208acf078b] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:48:26.489432 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell0:SELECT=6 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:48:26.495419 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-549bc555-bf14-4143-ba03-73c72664411e tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:26.495866 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-549bc555-bf14-4143-ba03-73c72664411e tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:26.496650 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-549bc555-bf14-4143-ba03-73c72664411e tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:26.497087 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-549bc555-bf14-4143-ba03-73c72664411e tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:26.621431 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-549bc555-bf14-4143-ba03-73c72664411e tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca179fc319904fcb9b343c9e7de28e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c965241379a45d8b9103af1913791a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:48:26.628846 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-549bc555-bf14-4143-ba03-73c72664411e tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "GET /compute/v2.1/servers/3e045642-4286-4b5c-8dc4-75208acf078b" status: 200 len: 1555 microversion: 2.1 time: 0.145828 May 24 15:48:26.629406 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1485/2978] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:48:26 2022] GET /compute/v2.1/servers/3e045642-4286-4b5c-8dc4-75208acf078b => generated 1555 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:48:26.645353 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-4739ba9d-31de-4aac-b0ca-3d913d8c9324 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:48:26.645855 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-4739ba9d-31de-4aac-b0ca-3d913d8c9324 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [instance: 3e045642-4286-4b5c-8dc4-75208acf078b] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:48:26.652326 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4739ba9d-31de-4aac-b0ca-3d913d8c9324 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:26.652796 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4739ba9d-31de-4aac-b0ca-3d913d8c9324 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:26.653558 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4739ba9d-31de-4aac-b0ca-3d913d8c9324 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:26.653978 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4739ba9d-31de-4aac-b0ca-3d913d8c9324 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:26.730315 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-4739ba9d-31de-4aac-b0ca-3d913d8c9324 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "GET /compute/v2.1/servers/3e045642-4286-4b5c-8dc4-75208acf078b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088731 May 24 15:48:26.730932 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1494/2979] 10.222.0.45 () {58 vars in 1274 bytes} [Tue May 24 15:48:26 2022] GET /compute/v2.1/servers/3e045642-4286-4b5c-8dc4-75208acf078b/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:48:27.879429 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [req-5b375380-b69a-44bf-9d3b-f69ed1bdcc88 req-92387c4e-98e6-4b12-93bc-03c829545b86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e045642-4286-4b5c-8dc4-75208acf078b", "tag": "4c46d6cc-b0d8-42a1-8637-56fdb5a2c74e"}]} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:48:27.888158 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-5b375380-b69a-44bf-9d3b-f69ed1bdcc88 req-92387c4e-98e6-4b12-93bc-03c829545b86 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:27.888700 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-5b375380-b69a-44bf-9d3b-f69ed1bdcc88 req-92387c4e-98e6-4b12-93bc-03c829545b86 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:27.900004 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.compute.server_external_events [req-5b375380-b69a-44bf-9d3b-f69ed1bdcc88 req-92387c4e-98e6-4b12-93bc-03c829545b86 service nova] Creating event network-changed:4c46d6cc-b0d8-42a1-8637-56fdb5a2c74e for instance 3e045642-4286-4b5c-8dc4-75208acf078b on hv-cinder-84315 May 24 15:48:27.905323 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [req-5b375380-b69a-44bf-9d3b-f69ed1bdcc88 req-92387c4e-98e6-4b12-93bc-03c829545b86 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029556 May 24 15:48:27.905999 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1486/2980] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:48:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:49:04.053005 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:49:04.053942 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:49:04.058770 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-89e255ad-98e5-4c8d-9f2a-05a9f4b6e95e tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:49:04.059272 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-89e255ad-98e5-4c8d-9f2a-05a9f4b6e95e tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [instance: 3e045642-4286-4b5c-8dc4-75208acf078b] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:49:04.067170 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-89e255ad-98e5-4c8d-9f2a-05a9f4b6e95e tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:49:04.067653 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-89e255ad-98e5-4c8d-9f2a-05a9f4b6e95e tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:49:04.068459 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-89e255ad-98e5-4c8d-9f2a-05a9f4b6e95e tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:49:04.068898 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-89e255ad-98e5-4c8d-9f2a-05a9f4b6e95e tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:49:04.098393 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-89e255ad-98e5-4c8d-9f2a-05a9f4b6e95e tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "GET /compute/v2.1/servers/3e045642-4286-4b5c-8dc4-75208acf078b/ips" status: 200 len: 149 microversion: 2.1 time: 0.046357 May 24 15:49:04.099470 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1495/2981] 10.222.0.45 () {58 vars in 1247 bytes} [Tue May 24 15:49:04 2022] GET /compute/v2.1/servers/3e045642-4286-4b5c-8dc4-75208acf078b/ips => generated 149 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:49:59.197271 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 15:49:59.197792 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Tue May 24 15:49:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 15:50:04.175817 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:50:04.176590 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=52 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:50:04.231351 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-6ca9b5db-8c33-43c7-bf8a-393b060860a5 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:50:04.231934 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-6ca9b5db-8c33-43c7-bf8a-393b060860a5 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [instance: 3e045642-4286-4b5c-8dc4-75208acf078b] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:50:04.238162 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6ca9b5db-8c33-43c7-bf8a-393b060860a5 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:50:04.238603 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6ca9b5db-8c33-43c7-bf8a-393b060860a5 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:50:04.239350 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6ca9b5db-8c33-43c7-bf8a-393b060860a5 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:50:04.239786 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6ca9b5db-8c33-43c7-bf8a-393b060860a5 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:50:04.265970 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-6ca9b5db-8c33-43c7-bf8a-393b060860a5 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [instance: 3e045642-4286-4b5c-8dc4-75208acf078b] Going to try to terminate instance {{(pid=117699) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 15:50:04.344712 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-6ca9b5db-8c33-43c7-bf8a-393b060860a5 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "DELETE /compute/v2.1/servers/3e045642-4286-4b5c-8dc4-75208acf078b" status: 204 len: 0 microversion: 2.1 time: 0.170646 May 24 15:50:04.345246 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1487/2982] 10.222.0.45 () {58 vars in 1238 bytes} [Tue May 24 15:50:04 2022] DELETE /compute/v2.1/servers/3e045642-4286-4b5c-8dc4-75208acf078b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 24 15:50:04.351096 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=4 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:50:04.351832 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_api:SELECT=2 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:50:04.356154 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-cd0ef6e9-b0cb-4000-822e-427245f4efce tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:50:04.356798 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-cd0ef6e9-b0cb-4000-822e-427245f4efce tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [instance: 3e045642-4286-4b5c-8dc4-75208acf078b] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:50:04.363754 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cd0ef6e9-b0cb-4000-822e-427245f4efce tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:50:04.364214 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cd0ef6e9-b0cb-4000-822e-427245f4efce tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:50:04.364994 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cd0ef6e9-b0cb-4000-822e-427245f4efce tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:50:04.365424 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cd0ef6e9-b0cb-4000-822e-427245f4efce tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:50:04.493115 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-cd0ef6e9-b0cb-4000-822e-427245f4efce tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca179fc319904fcb9b343c9e7de28e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c965241379a45d8b9103af1913791a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:50:04.500486 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-cd0ef6e9-b0cb-4000-822e-427245f4efce tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "GET /compute/v2.1/servers/3e045642-4286-4b5c-8dc4-75208acf078b" status: 200 len: 1680 microversion: 2.1 time: 0.151069 May 24 15:50:04.501064 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1496/2983] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:50:04 2022] GET /compute/v2.1/servers/3e045642-4286-4b5c-8dc4-75208acf078b => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:50:05.519026 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-cdcac8c4-3e50-4e0b-b691-a799e12e4ccd tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:50:05.519747 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-cdcac8c4-3e50-4e0b-b691-a799e12e4ccd tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [instance: 3e045642-4286-4b5c-8dc4-75208acf078b] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:50:05.526725 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cdcac8c4-3e50-4e0b-b691-a799e12e4ccd tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:50:05.527165 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cdcac8c4-3e50-4e0b-b691-a799e12e4ccd tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:50:05.527910 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cdcac8c4-3e50-4e0b-b691-a799e12e4ccd tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:50:05.528358 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-cdcac8c4-3e50-4e0b-b691-a799e12e4ccd tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:50:05.657946 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-cdcac8c4-3e50-4e0b-b691-a799e12e4ccd tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca179fc319904fcb9b343c9e7de28e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c965241379a45d8b9103af1913791a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:50:05.665356 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-cdcac8c4-3e50-4e0b-b691-a799e12e4ccd tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "GET /compute/v2.1/servers/3e045642-4286-4b5c-8dc4-75208acf078b" status: 200 len: 1680 microversion: 2.1 time: 0.150533 May 24 15:50:05.666523 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1488/2984] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:50:05 2022] GET /compute/v2.1/servers/3e045642-4286-4b5c-8dc4-75208acf078b => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:50:06.683579 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-7b0d57b9-9af1-4175-b686-26e273c94699 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:50:06.684339 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-7b0d57b9-9af1-4175-b686-26e273c94699 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [instance: 3e045642-4286-4b5c-8dc4-75208acf078b] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:50:06.691310 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7b0d57b9-9af1-4175-b686-26e273c94699 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:50:06.691817 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7b0d57b9-9af1-4175-b686-26e273c94699 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:50:06.692612 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7b0d57b9-9af1-4175-b686-26e273c94699 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:50:06.693052 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7b0d57b9-9af1-4175-b686-26e273c94699 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:50:06.761302 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-7b0d57b9-9af1-4175-b686-26e273c94699 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca179fc319904fcb9b343c9e7de28e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c965241379a45d8b9103af1913791a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:50:06.768756 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-7b0d57b9-9af1-4175-b686-26e273c94699 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "GET /compute/v2.1/servers/3e045642-4286-4b5c-8dc4-75208acf078b" status: 200 len: 1613 microversion: 2.1 time: 0.089615 May 24 15:50:06.769795 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1497/2985] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:50:06 2022] GET /compute/v2.1/servers/3e045642-4286-4b5c-8dc4-75208acf078b => generated 1613 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:50:06.930913 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [req-b00e6ef4-6551-4f11-b2c6-da62abc96402 req-abca4de1-ca76-43e2-bdf2-a881dc2118ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e045642-4286-4b5c-8dc4-75208acf078b", "name": "network-vif-deleted", "tag": "4c46d6cc-b0d8-42a1-8637-56fdb5a2c74e"}]} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:50:06.941433 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-b00e6ef4-6551-4f11-b2c6-da62abc96402 req-abca4de1-ca76-43e2-bdf2-a881dc2118ae service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:50:06.942247 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-b00e6ef4-6551-4f11-b2c6-da62abc96402 req-abca4de1-ca76-43e2-bdf2-a881dc2118ae service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:50:06.954592 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.compute.server_external_events [req-b00e6ef4-6551-4f11-b2c6-da62abc96402 req-abca4de1-ca76-43e2-bdf2-a881dc2118ae service nova] Creating event network-vif-deleted:4c46d6cc-b0d8-42a1-8637-56fdb5a2c74e for instance 3e045642-4286-4b5c-8dc4-75208acf078b on hv-cinder-84315 May 24 15:50:06.960120 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [req-b00e6ef4-6551-4f11-b2c6-da62abc96402 req-abca4de1-ca76-43e2-bdf2-a881dc2118ae service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032900 May 24 15:50:06.961191 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1489/2986] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:50:07.786147 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-1b38dde0-254f-40e7-9412-176a63e10fc0 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:50:07.786765 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-1b38dde0-254f-40e7-9412-176a63e10fc0 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [instance: 3e045642-4286-4b5c-8dc4-75208acf078b] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:50:07.793333 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1b38dde0-254f-40e7-9412-176a63e10fc0 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:50:07.793780 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1b38dde0-254f-40e7-9412-176a63e10fc0 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:50:07.794569 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1b38dde0-254f-40e7-9412-176a63e10fc0 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:50:07.795003 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1b38dde0-254f-40e7-9412-176a63e10fc0 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:50:07.808517 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.wsgi [None req-1b38dde0-254f-40e7-9412-176a63e10fc0 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] HTTP exception thrown: Instance 3e045642-4286-4b5c-8dc4-75208acf078b could not be found. May 24 15:50:07.810182 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-1b38dde0-254f-40e7-9412-176a63e10fc0 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Request method failure captured: May 24 15:50:07.810182 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: request: GET /compute/v2.1/servers/3e045642-4286-4b5c-8dc4-75208acf078b HTTP/1.1 May 24 15:50:07.810182 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Accept: application/json May 24 15:50:07.810182 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Accept-Encoding: identity May 24 15:50:07.810182 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Connection: close May 24 15:50:07.810182 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Content-Length: 0 May 24 15:50:07.810182 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Content-Type: application/json May 24 15:50:07.810182 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Host: 10.222.0.45 May 24 15:50:07.810182 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Openstack-System-Scope: None May 24 15:50:07.810182 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: User-Agent: python-urllib3/1.26.9 May 24 15:50:07.810182 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Auth-Token: gAAAAABijP1YsWLVx2yKd3xZ-7AmopHcskG7Py4h3AywsL7wRiF9sIB3K9XWsOPrepBYhkSC0f8H8voqnNxx3PZo2JJP5pt0hxBmzxUX9XPN-nwQNiEbyPhdB9fPTGyUfX_CHqZfTaARTJ_yNKsMculK3yTKaKnStctkbnkIneIg0uj0XmxB5ZU May 24 15:50:07.810182 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Domain-Id: None May 24 15:50:07.810182 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Domain-Name: None May 24 15:50:07.810182 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Identity-Status: Confirmed May 24 15:50:07.810182 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Is-Admin-Project: True May 24 15:50:07.810182 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Domain-Id: default May 24 15:50:07.810182 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Domain-Name: Default May 24 15:50:07.810182 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Id: 3c965241379a45d8b9103af1913791a7 May 24 15:50:07.810182 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Name: tempest-AttachVolumeNegativeTest-2098560824 May 24 15:50:07.810182 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Role: reader,member May 24 15:50:07.810182 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Roles: reader,member May 24 15:50:07.811992 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3c965241379a45d8b9103af1913791a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3c965241379a45d8b9103af1913791a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3c965241379a45d8b9103af1913791a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3c965241379a45d8b9103af1913791a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 24 15:50:07.811992 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Tenant: tempest-AttachVolumeNegativeTest-2098560824 May 24 15:50:07.811992 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Tenant-Id: 3c965241379a45d8b9103af1913791a7 May 24 15:50:07.811992 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2098560824 May 24 15:50:07.811992 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User: tempest-AttachVolumeNegativeTest-2098560824-project May 24 15:50:07.811992 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Domain-Id: default May 24 15:50:07.811992 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Domain-Name: Default May 24 15:50:07.811992 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Id: ca179fc319904fcb9b343c9e7de28e6f May 24 15:50:07.811992 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Name: tempest-AttachVolumeNegativeTest-2098560824-project May 24 15:50:07.811992 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: method: > May 24 15:50:07.811992 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: exception: Instance 3e045642-4286-4b5c-8dc4-75208acf078b could not be found. May 24 15:50:07.811992 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: action_args: {'id': '3e045642-4286-4b5c-8dc4-75208acf078b'} May 24 15:50:07.813083 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:50:07.813083 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:50:07.813083 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:50:07.813083 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:50:07.813083 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:50:07.813083 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:50:07.813083 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:50:07.813083 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:50:07.813083 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:50:07.813083 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:50:07.813083 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e045642-4286-4b5c-8dc4-75208acf078b could not be found. May 24 15:50:07.813083 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:50:07.813083 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:50:07.813083 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:50:07.813083 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:50:07.813083 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:50:07.813083 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:50:07.813083 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:50:07.813083 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:50:07.813083 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:50:07.814819 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:50:07.814819 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 15:50:07.814819 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 15:50:07.814819 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:50:07.814819 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:50:07.814819 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:50:07.814819 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:50:07.814819 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e045642-4286-4b5c-8dc4-75208acf078b could not be found. May 24 15:50:07.814819 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:50:07.814819 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:50:07.814819 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:50:07.814819 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:50:07.814819 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:50:07.814819 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:50:07.814819 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:50:07.814819 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:50:07.814819 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e045642-4286-4b5c-8dc4-75208acf078b could not be found. May 24 15:50:07.814819 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:50:07.816733 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-1b38dde0-254f-40e7-9412-176a63e10fc0 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Returning 404 to user: Instance 3e045642-4286-4b5c-8dc4-75208acf078b could not be found. {{(pid=117698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:50:07.816733 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-1b38dde0-254f-40e7-9412-176a63e10fc0 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "GET /compute/v2.1/servers/3e045642-4286-4b5c-8dc4-75208acf078b" status: 404 len: 111 microversion: 2.1 time: 0.029521 May 24 15:50:07.816733 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1498/2987] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:50:07 2022] GET /compute/v2.1/servers/3e045642-4286-4b5c-8dc4-75208acf078b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:50:07.820909 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-c55d8e43-d74c-4540-81aa-c9391d58ddc6 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Calling method '.version_select at 0x7f2dd2bcc670>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:50:07.839795 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-c55d8e43-d74c-4540-81aa-c9391d58ddc6 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2047797508" status: 202 len: 0 microversion: 2.1 time: 0.023011 May 24 15:50:07.840399 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1490/2988] 10.222.0.45 () {58 vars in 1220 bytes} [Tue May 24 15:50:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2047797508 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 15:50:08.460269 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-a90b4e07-164b-48d4-a590-8ef2035247ae tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:50:08.460783 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-a90b4e07-164b-48d4-a590-8ef2035247ae tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [instance: 3e045642-4286-4b5c-8dc4-75208acf078b] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:50:08.466704 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a90b4e07-164b-48d4-a590-8ef2035247ae tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:50:08.467146 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a90b4e07-164b-48d4-a590-8ef2035247ae tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:50:08.467911 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a90b4e07-164b-48d4-a590-8ef2035247ae tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:50:08.468340 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a90b4e07-164b-48d4-a590-8ef2035247ae tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:50:08.481683 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.wsgi [None req-a90b4e07-164b-48d4-a590-8ef2035247ae tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] HTTP exception thrown: Instance 3e045642-4286-4b5c-8dc4-75208acf078b could not be found. May 24 15:50:08.483219 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-a90b4e07-164b-48d4-a590-8ef2035247ae tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Request method failure captured: May 24 15:50:08.483219 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: request: DELETE /compute/v2.1/servers/3e045642-4286-4b5c-8dc4-75208acf078b HTTP/1.1 May 24 15:50:08.483219 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Accept: application/json May 24 15:50:08.483219 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Accept-Encoding: identity May 24 15:50:08.483219 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Connection: close May 24 15:50:08.483219 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Content-Length: 0 May 24 15:50:08.483219 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Content-Type: application/json May 24 15:50:08.483219 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Host: 10.222.0.45 May 24 15:50:08.483219 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Openstack-System-Scope: None May 24 15:50:08.483219 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: User-Agent: python-urllib3/1.26.9 May 24 15:50:08.483219 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Auth-Token: gAAAAABijP1YsWLVx2yKd3xZ-7AmopHcskG7Py4h3AywsL7wRiF9sIB3K9XWsOPrepBYhkSC0f8H8voqnNxx3PZo2JJP5pt0hxBmzxUX9XPN-nwQNiEbyPhdB9fPTGyUfX_CHqZfTaARTJ_yNKsMculK3yTKaKnStctkbnkIneIg0uj0XmxB5ZU May 24 15:50:08.483219 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Domain-Id: None May 24 15:50:08.483219 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Domain-Name: None May 24 15:50:08.483219 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Identity-Status: Confirmed May 24 15:50:08.483219 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Is-Admin-Project: True May 24 15:50:08.483219 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Domain-Id: default May 24 15:50:08.483219 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Domain-Name: Default May 24 15:50:08.483219 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Id: 3c965241379a45d8b9103af1913791a7 May 24 15:50:08.483219 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Name: tempest-AttachVolumeNegativeTest-2098560824 May 24 15:50:08.483219 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Role: reader,member May 24 15:50:08.483219 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Roles: reader,member May 24 15:50:08.485116 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3c965241379a45d8b9103af1913791a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3c965241379a45d8b9103af1913791a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3c965241379a45d8b9103af1913791a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3c965241379a45d8b9103af1913791a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 24 15:50:08.485116 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Tenant: tempest-AttachVolumeNegativeTest-2098560824 May 24 15:50:08.485116 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Tenant-Id: 3c965241379a45d8b9103af1913791a7 May 24 15:50:08.485116 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2098560824 May 24 15:50:08.485116 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User: tempest-AttachVolumeNegativeTest-2098560824-project May 24 15:50:08.485116 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Domain-Id: default May 24 15:50:08.485116 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Domain-Name: Default May 24 15:50:08.485116 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Id: ca179fc319904fcb9b343c9e7de28e6f May 24 15:50:08.485116 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Name: tempest-AttachVolumeNegativeTest-2098560824-project May 24 15:50:08.485116 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: method: > May 24 15:50:08.485116 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: exception: Instance 3e045642-4286-4b5c-8dc4-75208acf078b could not be found. May 24 15:50:08.485116 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: action_args: {'id': '3e045642-4286-4b5c-8dc4-75208acf078b'} May 24 15:50:08.486104 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:50:08.486104 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:50:08.486104 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:50:08.486104 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:50:08.486104 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:50:08.486104 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:50:08.486104 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:50:08.486104 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:50:08.486104 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:50:08.486104 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:50:08.486104 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e045642-4286-4b5c-8dc4-75208acf078b could not be found. May 24 15:50:08.486104 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:50:08.486104 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:50:08.486104 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:50:08.486104 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:50:08.486104 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:50:08.486104 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:50:08.486104 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:50:08.486104 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:50:08.486104 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:50:08.487732 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:50:08.487732 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 24 15:50:08.487732 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 24 15:50:08.487732 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 24 15:50:08.487732 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 24 15:50:08.487732 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:50:08.487732 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:50:08.487732 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:50:08.487732 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:50:08.487732 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e045642-4286-4b5c-8dc4-75208acf078b could not be found. May 24 15:50:08.487732 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:50:08.487732 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:50:08.487732 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:50:08.487732 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:50:08.487732 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:50:08.487732 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:50:08.487732 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:50:08.487732 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:50:08.487732 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e045642-4286-4b5c-8dc4-75208acf078b could not be found. May 24 15:50:08.487732 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:50:08.489377 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-a90b4e07-164b-48d4-a590-8ef2035247ae tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Returning 404 to user: Instance 3e045642-4286-4b5c-8dc4-75208acf078b could not be found. {{(pid=117698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:50:08.489377 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-a90b4e07-164b-48d4-a590-8ef2035247ae tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "DELETE /compute/v2.1/servers/3e045642-4286-4b5c-8dc4-75208acf078b" status: 404 len: 111 microversion: 2.1 time: 0.028182 May 24 15:50:08.489377 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1499/2989] 10.222.0.45 () {58 vars in 1238 bytes} [Tue May 24 15:50:08 2022] DELETE /compute/v2.1/servers/3e045642-4286-4b5c-8dc4-75208acf078b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 24 15:50:08.498830 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-55e43472-5b10-4568-8277-90a0d66b4fbc tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:50:08.499563 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-55e43472-5b10-4568-8277-90a0d66b4fbc tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [instance: 3e045642-4286-4b5c-8dc4-75208acf078b] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:50:08.505705 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-55e43472-5b10-4568-8277-90a0d66b4fbc tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:50:08.506147 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-55e43472-5b10-4568-8277-90a0d66b4fbc tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:50:08.506896 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-55e43472-5b10-4568-8277-90a0d66b4fbc tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:50:08.507328 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-55e43472-5b10-4568-8277-90a0d66b4fbc tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:50:08.520184 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.wsgi [None req-55e43472-5b10-4568-8277-90a0d66b4fbc tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] HTTP exception thrown: Instance 3e045642-4286-4b5c-8dc4-75208acf078b could not be found. May 24 15:50:08.521808 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-55e43472-5b10-4568-8277-90a0d66b4fbc tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Request method failure captured: May 24 15:50:08.521808 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: request: GET /compute/v2.1/servers/3e045642-4286-4b5c-8dc4-75208acf078b HTTP/1.1 May 24 15:50:08.521808 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Accept: application/json May 24 15:50:08.521808 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Accept-Encoding: identity May 24 15:50:08.521808 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Connection: close May 24 15:50:08.521808 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Content-Length: 0 May 24 15:50:08.521808 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Content-Type: application/json May 24 15:50:08.521808 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Host: 10.222.0.45 May 24 15:50:08.521808 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Openstack-System-Scope: None May 24 15:50:08.521808 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: User-Agent: python-urllib3/1.26.9 May 24 15:50:08.521808 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Auth-Token: gAAAAABijP1YsWLVx2yKd3xZ-7AmopHcskG7Py4h3AywsL7wRiF9sIB3K9XWsOPrepBYhkSC0f8H8voqnNxx3PZo2JJP5pt0hxBmzxUX9XPN-nwQNiEbyPhdB9fPTGyUfX_CHqZfTaARTJ_yNKsMculK3yTKaKnStctkbnkIneIg0uj0XmxB5ZU May 24 15:50:08.521808 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Domain-Id: None May 24 15:50:08.521808 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Domain-Name: None May 24 15:50:08.521808 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Identity-Status: Confirmed May 24 15:50:08.521808 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Is-Admin-Project: True May 24 15:50:08.521808 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Domain-Id: default May 24 15:50:08.521808 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Domain-Name: Default May 24 15:50:08.521808 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Id: 3c965241379a45d8b9103af1913791a7 May 24 15:50:08.521808 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Name: tempest-AttachVolumeNegativeTest-2098560824 May 24 15:50:08.521808 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Role: reader,member May 24 15:50:08.521808 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Roles: reader,member May 24 15:50:08.523549 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3c965241379a45d8b9103af1913791a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3c965241379a45d8b9103af1913791a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3c965241379a45d8b9103af1913791a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3c965241379a45d8b9103af1913791a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 24 15:50:08.523549 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant: tempest-AttachVolumeNegativeTest-2098560824 May 24 15:50:08.523549 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant-Id: 3c965241379a45d8b9103af1913791a7 May 24 15:50:08.523549 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2098560824 May 24 15:50:08.523549 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User: tempest-AttachVolumeNegativeTest-2098560824-project May 24 15:50:08.523549 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Domain-Id: default May 24 15:50:08.523549 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Domain-Name: Default May 24 15:50:08.523549 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Id: ca179fc319904fcb9b343c9e7de28e6f May 24 15:50:08.523549 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Name: tempest-AttachVolumeNegativeTest-2098560824-project May 24 15:50:08.523549 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: method: > May 24 15:50:08.523549 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: exception: Instance 3e045642-4286-4b5c-8dc4-75208acf078b could not be found. May 24 15:50:08.523549 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: action_args: {'id': '3e045642-4286-4b5c-8dc4-75208acf078b'} May 24 15:50:08.524517 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:50:08.524517 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:50:08.524517 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:50:08.524517 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:50:08.524517 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:50:08.524517 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:50:08.524517 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:50:08.524517 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:50:08.524517 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:50:08.524517 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:50:08.524517 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e045642-4286-4b5c-8dc4-75208acf078b could not be found. May 24 15:50:08.524517 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:50:08.524517 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:50:08.524517 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:50:08.524517 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:50:08.524517 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:50:08.524517 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:50:08.524517 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:50:08.524517 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:50:08.524517 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:50:08.526624 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:50:08.526624 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 15:50:08.526624 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 15:50:08.526624 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:50:08.526624 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:50:08.526624 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:50:08.526624 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:50:08.526624 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e045642-4286-4b5c-8dc4-75208acf078b could not be found. May 24 15:50:08.526624 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:50:08.526624 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:50:08.526624 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:50:08.526624 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:50:08.526624 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:50:08.526624 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:50:08.526624 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:50:08.526624 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:50:08.526624 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e045642-4286-4b5c-8dc4-75208acf078b could not be found. May 24 15:50:08.526624 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:50:08.528038 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-55e43472-5b10-4568-8277-90a0d66b4fbc tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Returning 404 to user: Instance 3e045642-4286-4b5c-8dc4-75208acf078b could not be found. {{(pid=117699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:50:08.528038 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-55e43472-5b10-4568-8277-90a0d66b4fbc tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "GET /compute/v2.1/servers/3e045642-4286-4b5c-8dc4-75208acf078b" status: 404 len: 111 microversion: 2.1 time: 0.029220 May 24 15:50:08.528038 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1491/2990] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:50:08 2022] GET /compute/v2.1/servers/3e045642-4286-4b5c-8dc4-75208acf078b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:50:08.533225 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-cf7a949a-8497-42c6-bf07-90984ab3495c tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:50:08.533717 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-cf7a949a-8497-42c6-bf07-90984ab3495c tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [instance: 7502fb75-d125-4862-9e46-a19dd4cef13a] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:50:08.539643 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cf7a949a-8497-42c6-bf07-90984ab3495c tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:50:08.540080 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cf7a949a-8497-42c6-bf07-90984ab3495c tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:50:08.541501 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cf7a949a-8497-42c6-bf07-90984ab3495c tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:50:08.541927 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cf7a949a-8497-42c6-bf07-90984ab3495c tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:50:08.554882 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.wsgi [None req-cf7a949a-8497-42c6-bf07-90984ab3495c tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] HTTP exception thrown: Instance 7502fb75-d125-4862-9e46-a19dd4cef13a could not be found. May 24 15:50:08.556401 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-cf7a949a-8497-42c6-bf07-90984ab3495c tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Request method failure captured: May 24 15:50:08.556401 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: request: DELETE /compute/v2.1/servers/7502fb75-d125-4862-9e46-a19dd4cef13a HTTP/1.1 May 24 15:50:08.556401 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Accept: application/json May 24 15:50:08.556401 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Accept-Encoding: identity May 24 15:50:08.556401 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Connection: close May 24 15:50:08.556401 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Content-Length: 0 May 24 15:50:08.556401 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Content-Type: application/json May 24 15:50:08.556401 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Host: 10.222.0.45 May 24 15:50:08.556401 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Openstack-System-Scope: None May 24 15:50:08.556401 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: User-Agent: python-urllib3/1.26.9 May 24 15:50:08.556401 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Auth-Token: gAAAAABijP1YsWLVx2yKd3xZ-7AmopHcskG7Py4h3AywsL7wRiF9sIB3K9XWsOPrepBYhkSC0f8H8voqnNxx3PZo2JJP5pt0hxBmzxUX9XPN-nwQNiEbyPhdB9fPTGyUfX_CHqZfTaARTJ_yNKsMculK3yTKaKnStctkbnkIneIg0uj0XmxB5ZU May 24 15:50:08.556401 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Domain-Id: None May 24 15:50:08.556401 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Domain-Name: None May 24 15:50:08.556401 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Identity-Status: Confirmed May 24 15:50:08.556401 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Is-Admin-Project: True May 24 15:50:08.556401 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Domain-Id: default May 24 15:50:08.556401 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Domain-Name: Default May 24 15:50:08.556401 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Id: 3c965241379a45d8b9103af1913791a7 May 24 15:50:08.556401 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Name: tempest-AttachVolumeNegativeTest-2098560824 May 24 15:50:08.556401 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Role: reader,member May 24 15:50:08.556401 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Roles: reader,member May 24 15:50:08.558159 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3c965241379a45d8b9103af1913791a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3c965241379a45d8b9103af1913791a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3c965241379a45d8b9103af1913791a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3c965241379a45d8b9103af1913791a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 24 15:50:08.558159 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Tenant: tempest-AttachVolumeNegativeTest-2098560824 May 24 15:50:08.558159 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Tenant-Id: 3c965241379a45d8b9103af1913791a7 May 24 15:50:08.558159 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2098560824 May 24 15:50:08.558159 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User: tempest-AttachVolumeNegativeTest-2098560824-project May 24 15:50:08.558159 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Domain-Id: default May 24 15:50:08.558159 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Domain-Name: Default May 24 15:50:08.558159 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Id: ca179fc319904fcb9b343c9e7de28e6f May 24 15:50:08.558159 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Name: tempest-AttachVolumeNegativeTest-2098560824-project May 24 15:50:08.558159 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: method: > May 24 15:50:08.558159 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: exception: Instance 7502fb75-d125-4862-9e46-a19dd4cef13a could not be found. May 24 15:50:08.558159 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: action_args: {'id': '7502fb75-d125-4862-9e46-a19dd4cef13a'} May 24 15:50:08.559201 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:50:08.559201 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:50:08.559201 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:50:08.559201 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:50:08.559201 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:50:08.559201 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:50:08.559201 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:50:08.559201 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:50:08.559201 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:50:08.559201 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:50:08.559201 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7502fb75-d125-4862-9e46-a19dd4cef13a could not be found. May 24 15:50:08.559201 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:50:08.559201 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:50:08.559201 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:50:08.559201 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:50:08.559201 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:50:08.559201 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:50:08.559201 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:50:08.559201 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:50:08.559201 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:50:08.560902 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:50:08.560902 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 24 15:50:08.560902 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 24 15:50:08.560902 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 24 15:50:08.560902 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 24 15:50:08.560902 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:50:08.560902 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:50:08.560902 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:50:08.560902 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:50:08.560902 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7502fb75-d125-4862-9e46-a19dd4cef13a could not be found. May 24 15:50:08.560902 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:50:08.560902 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:50:08.560902 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:50:08.560902 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:50:08.560902 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:50:08.560902 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:50:08.560902 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:50:08.560902 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:50:08.560902 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7502fb75-d125-4862-9e46-a19dd4cef13a could not be found. May 24 15:50:08.560902 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:50:08.562642 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-cf7a949a-8497-42c6-bf07-90984ab3495c tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Returning 404 to user: Instance 7502fb75-d125-4862-9e46-a19dd4cef13a could not be found. {{(pid=117698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:50:08.562642 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-cf7a949a-8497-42c6-bf07-90984ab3495c tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "DELETE /compute/v2.1/servers/7502fb75-d125-4862-9e46-a19dd4cef13a" status: 404 len: 111 microversion: 2.1 time: 0.028303 May 24 15:50:08.562642 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1500/2991] 10.222.0.45 () {58 vars in 1238 bytes} [Tue May 24 15:50:08 2022] DELETE /compute/v2.1/servers/7502fb75-d125-4862-9e46-a19dd4cef13a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:50:08.566087 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a9e0895e-d21e-422c-a2f0-41644ef05556 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:50:08.566691 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a9e0895e-d21e-422c-a2f0-41644ef05556 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [instance: 7502fb75-d125-4862-9e46-a19dd4cef13a] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:50:08.572597 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a9e0895e-d21e-422c-a2f0-41644ef05556 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:50:08.573058 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a9e0895e-d21e-422c-a2f0-41644ef05556 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:50:08.573781 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a9e0895e-d21e-422c-a2f0-41644ef05556 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:50:08.574204 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a9e0895e-d21e-422c-a2f0-41644ef05556 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:50:08.588168 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.wsgi [None req-a9e0895e-d21e-422c-a2f0-41644ef05556 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] HTTP exception thrown: Instance 7502fb75-d125-4862-9e46-a19dd4cef13a could not be found. May 24 15:50:08.589828 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a9e0895e-d21e-422c-a2f0-41644ef05556 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Request method failure captured: May 24 15:50:08.589828 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: request: GET /compute/v2.1/servers/7502fb75-d125-4862-9e46-a19dd4cef13a HTTP/1.1 May 24 15:50:08.589828 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Accept: application/json May 24 15:50:08.589828 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Accept-Encoding: identity May 24 15:50:08.589828 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Connection: close May 24 15:50:08.589828 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Content-Length: 0 May 24 15:50:08.589828 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Content-Type: application/json May 24 15:50:08.589828 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Host: 10.222.0.45 May 24 15:50:08.589828 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Openstack-System-Scope: None May 24 15:50:08.589828 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: User-Agent: python-urllib3/1.26.9 May 24 15:50:08.589828 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Auth-Token: gAAAAABijP1YsWLVx2yKd3xZ-7AmopHcskG7Py4h3AywsL7wRiF9sIB3K9XWsOPrepBYhkSC0f8H8voqnNxx3PZo2JJP5pt0hxBmzxUX9XPN-nwQNiEbyPhdB9fPTGyUfX_CHqZfTaARTJ_yNKsMculK3yTKaKnStctkbnkIneIg0uj0XmxB5ZU May 24 15:50:08.589828 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Domain-Id: None May 24 15:50:08.589828 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Domain-Name: None May 24 15:50:08.589828 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Identity-Status: Confirmed May 24 15:50:08.589828 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Is-Admin-Project: True May 24 15:50:08.589828 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Domain-Id: default May 24 15:50:08.589828 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Domain-Name: Default May 24 15:50:08.589828 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Id: 3c965241379a45d8b9103af1913791a7 May 24 15:50:08.589828 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Name: tempest-AttachVolumeNegativeTest-2098560824 May 24 15:50:08.589828 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Role: reader,member May 24 15:50:08.589828 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Roles: reader,member May 24 15:50:08.591559 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3c965241379a45d8b9103af1913791a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3c965241379a45d8b9103af1913791a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3c965241379a45d8b9103af1913791a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3c965241379a45d8b9103af1913791a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 24 15:50:08.591559 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant: tempest-AttachVolumeNegativeTest-2098560824 May 24 15:50:08.591559 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant-Id: 3c965241379a45d8b9103af1913791a7 May 24 15:50:08.591559 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2098560824 May 24 15:50:08.591559 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User: tempest-AttachVolumeNegativeTest-2098560824-project May 24 15:50:08.591559 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Domain-Id: default May 24 15:50:08.591559 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Domain-Name: Default May 24 15:50:08.591559 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Id: ca179fc319904fcb9b343c9e7de28e6f May 24 15:50:08.591559 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Name: tempest-AttachVolumeNegativeTest-2098560824-project May 24 15:50:08.591559 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: method: > May 24 15:50:08.591559 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: exception: Instance 7502fb75-d125-4862-9e46-a19dd4cef13a could not be found. May 24 15:50:08.591559 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: action_args: {'id': '7502fb75-d125-4862-9e46-a19dd4cef13a'} May 24 15:50:08.592594 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:50:08.592594 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:50:08.592594 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:50:08.592594 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:50:08.592594 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:50:08.592594 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:50:08.592594 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:50:08.592594 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:50:08.592594 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:50:08.592594 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:50:08.592594 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7502fb75-d125-4862-9e46-a19dd4cef13a could not be found. May 24 15:50:08.592594 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:50:08.592594 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:50:08.592594 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:50:08.592594 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:50:08.592594 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:50:08.592594 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:50:08.592594 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:50:08.592594 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:50:08.592594 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:50:08.594301 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:50:08.594301 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 15:50:08.594301 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 15:50:08.594301 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:50:08.594301 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:50:08.594301 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:50:08.594301 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:50:08.594301 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7502fb75-d125-4862-9e46-a19dd4cef13a could not be found. May 24 15:50:08.594301 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:50:08.594301 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:50:08.594301 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:50:08.594301 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:50:08.594301 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:50:08.594301 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:50:08.594301 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:50:08.594301 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:50:08.594301 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7502fb75-d125-4862-9e46-a19dd4cef13a could not be found. May 24 15:50:08.594301 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:50:08.595829 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a9e0895e-d21e-422c-a2f0-41644ef05556 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Returning 404 to user: Instance 7502fb75-d125-4862-9e46-a19dd4cef13a could not be found. {{(pid=117699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:50:08.595829 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a9e0895e-d21e-422c-a2f0-41644ef05556 tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "GET /compute/v2.1/servers/7502fb75-d125-4862-9e46-a19dd4cef13a" status: 404 len: 111 microversion: 2.1 time: 0.028800 May 24 15:50:08.595829 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1492/2992] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:50:08 2022] GET /compute/v2.1/servers/7502fb75-d125-4862-9e46-a19dd4cef13a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 24 15:50:08.599538 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-2e803b5a-790b-4390-b440-ba8cb709858f tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:50:08.600033 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-2e803b5a-790b-4390-b440-ba8cb709858f tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [instance: 14af50a7-06c8-4c6e-a797-3e3c55b59d65] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:50:08.606901 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2e803b5a-790b-4390-b440-ba8cb709858f tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:50:08.607353 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2e803b5a-790b-4390-b440-ba8cb709858f tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:50:08.608117 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2e803b5a-790b-4390-b440-ba8cb709858f tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:50:08.608594 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2e803b5a-790b-4390-b440-ba8cb709858f tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:50:08.621988 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.wsgi [None req-2e803b5a-790b-4390-b440-ba8cb709858f tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] HTTP exception thrown: Instance 14af50a7-06c8-4c6e-a797-3e3c55b59d65 could not be found. May 24 15:50:08.623510 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-2e803b5a-790b-4390-b440-ba8cb709858f tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Request method failure captured: May 24 15:50:08.623510 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: request: DELETE /compute/v2.1/servers/14af50a7-06c8-4c6e-a797-3e3c55b59d65 HTTP/1.1 May 24 15:50:08.623510 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Accept: application/json May 24 15:50:08.623510 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Accept-Encoding: identity May 24 15:50:08.623510 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Connection: close May 24 15:50:08.623510 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Content-Length: 0 May 24 15:50:08.623510 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Content-Type: application/json May 24 15:50:08.623510 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Host: 10.222.0.45 May 24 15:50:08.623510 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Openstack-System-Scope: None May 24 15:50:08.623510 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: User-Agent: python-urllib3/1.26.9 May 24 15:50:08.623510 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Auth-Token: gAAAAABijP1YsWLVx2yKd3xZ-7AmopHcskG7Py4h3AywsL7wRiF9sIB3K9XWsOPrepBYhkSC0f8H8voqnNxx3PZo2JJP5pt0hxBmzxUX9XPN-nwQNiEbyPhdB9fPTGyUfX_CHqZfTaARTJ_yNKsMculK3yTKaKnStctkbnkIneIg0uj0XmxB5ZU May 24 15:50:08.623510 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Domain-Id: None May 24 15:50:08.623510 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Domain-Name: None May 24 15:50:08.623510 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Identity-Status: Confirmed May 24 15:50:08.623510 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Is-Admin-Project: True May 24 15:50:08.623510 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Domain-Id: default May 24 15:50:08.623510 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Domain-Name: Default May 24 15:50:08.623510 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Id: 3c965241379a45d8b9103af1913791a7 May 24 15:50:08.623510 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Name: tempest-AttachVolumeNegativeTest-2098560824 May 24 15:50:08.623510 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Role: reader,member May 24 15:50:08.623510 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Roles: reader,member May 24 15:50:08.625288 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3c965241379a45d8b9103af1913791a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3c965241379a45d8b9103af1913791a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3c965241379a45d8b9103af1913791a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3c965241379a45d8b9103af1913791a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 24 15:50:08.625288 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Tenant: tempest-AttachVolumeNegativeTest-2098560824 May 24 15:50:08.625288 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Tenant-Id: 3c965241379a45d8b9103af1913791a7 May 24 15:50:08.625288 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2098560824 May 24 15:50:08.625288 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User: tempest-AttachVolumeNegativeTest-2098560824-project May 24 15:50:08.625288 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Domain-Id: default May 24 15:50:08.625288 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Domain-Name: Default May 24 15:50:08.625288 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Id: ca179fc319904fcb9b343c9e7de28e6f May 24 15:50:08.625288 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Name: tempest-AttachVolumeNegativeTest-2098560824-project May 24 15:50:08.625288 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: method: > May 24 15:50:08.625288 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: exception: Instance 14af50a7-06c8-4c6e-a797-3e3c55b59d65 could not be found. May 24 15:50:08.625288 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: action_args: {'id': '14af50a7-06c8-4c6e-a797-3e3c55b59d65'} May 24 15:50:08.626253 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:50:08.626253 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:50:08.626253 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:50:08.626253 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:50:08.626253 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:50:08.626253 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:50:08.626253 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:50:08.626253 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:50:08.626253 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:50:08.626253 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:50:08.626253 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14af50a7-06c8-4c6e-a797-3e3c55b59d65 could not be found. May 24 15:50:08.626253 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:50:08.626253 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:50:08.626253 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:50:08.626253 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:50:08.626253 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:50:08.626253 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:50:08.626253 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:50:08.626253 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:50:08.626253 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:50:08.627608 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:50:08.627608 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 24 15:50:08.627608 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 24 15:50:08.627608 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 24 15:50:08.627608 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 24 15:50:08.627608 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:50:08.627608 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:50:08.627608 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:50:08.627608 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:50:08.627608 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14af50a7-06c8-4c6e-a797-3e3c55b59d65 could not be found. May 24 15:50:08.627608 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:50:08.627608 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:50:08.627608 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:50:08.627608 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:50:08.627608 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:50:08.627608 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:50:08.627608 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:50:08.627608 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:50:08.627608 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14af50a7-06c8-4c6e-a797-3e3c55b59d65 could not be found. May 24 15:50:08.627608 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:50:08.629090 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-2e803b5a-790b-4390-b440-ba8cb709858f tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Returning 404 to user: Instance 14af50a7-06c8-4c6e-a797-3e3c55b59d65 could not be found. {{(pid=117698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:50:08.629090 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-2e803b5a-790b-4390-b440-ba8cb709858f tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "DELETE /compute/v2.1/servers/14af50a7-06c8-4c6e-a797-3e3c55b59d65" status: 404 len: 111 microversion: 2.1 time: 0.029040 May 24 15:50:08.629090 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1501/2993] 10.222.0.45 () {58 vars in 1238 bytes} [Tue May 24 15:50:08 2022] DELETE /compute/v2.1/servers/14af50a7-06c8-4c6e-a797-3e3c55b59d65 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:50:08.632955 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-b429ffb9-c602-4cd8-be8b-306b0ed19b4e tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:50:08.633560 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-b429ffb9-c602-4cd8-be8b-306b0ed19b4e tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] [instance: 14af50a7-06c8-4c6e-a797-3e3c55b59d65] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:50:08.639423 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b429ffb9-c602-4cd8-be8b-306b0ed19b4e tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:50:08.639864 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b429ffb9-c602-4cd8-be8b-306b0ed19b4e tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:50:08.640637 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b429ffb9-c602-4cd8-be8b-306b0ed19b4e tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:50:08.641071 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b429ffb9-c602-4cd8-be8b-306b0ed19b4e tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:50:08.654603 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.wsgi [None req-b429ffb9-c602-4cd8-be8b-306b0ed19b4e tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] HTTP exception thrown: Instance 14af50a7-06c8-4c6e-a797-3e3c55b59d65 could not be found. May 24 15:50:08.656113 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-b429ffb9-c602-4cd8-be8b-306b0ed19b4e tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Request method failure captured: May 24 15:50:08.656113 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: request: GET /compute/v2.1/servers/14af50a7-06c8-4c6e-a797-3e3c55b59d65 HTTP/1.1 May 24 15:50:08.656113 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Accept: application/json May 24 15:50:08.656113 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Accept-Encoding: identity May 24 15:50:08.656113 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Connection: close May 24 15:50:08.656113 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Content-Length: 0 May 24 15:50:08.656113 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Content-Type: application/json May 24 15:50:08.656113 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Host: 10.222.0.45 May 24 15:50:08.656113 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Openstack-System-Scope: None May 24 15:50:08.656113 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: User-Agent: python-urllib3/1.26.9 May 24 15:50:08.656113 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Auth-Token: gAAAAABijP1YsWLVx2yKd3xZ-7AmopHcskG7Py4h3AywsL7wRiF9sIB3K9XWsOPrepBYhkSC0f8H8voqnNxx3PZo2JJP5pt0hxBmzxUX9XPN-nwQNiEbyPhdB9fPTGyUfX_CHqZfTaARTJ_yNKsMculK3yTKaKnStctkbnkIneIg0uj0XmxB5ZU May 24 15:50:08.656113 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Domain-Id: None May 24 15:50:08.656113 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Domain-Name: None May 24 15:50:08.656113 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Identity-Status: Confirmed May 24 15:50:08.656113 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Is-Admin-Project: True May 24 15:50:08.656113 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Domain-Id: default May 24 15:50:08.656113 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Domain-Name: Default May 24 15:50:08.656113 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Id: 3c965241379a45d8b9103af1913791a7 May 24 15:50:08.656113 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Name: tempest-AttachVolumeNegativeTest-2098560824 May 24 15:50:08.656113 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Role: reader,member May 24 15:50:08.656113 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Roles: reader,member May 24 15:50:08.657827 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3c965241379a45d8b9103af1913791a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3c965241379a45d8b9103af1913791a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3c965241379a45d8b9103af1913791a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3c965241379a45d8b9103af1913791a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 24 15:50:08.657827 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant: tempest-AttachVolumeNegativeTest-2098560824 May 24 15:50:08.657827 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant-Id: 3c965241379a45d8b9103af1913791a7 May 24 15:50:08.657827 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2098560824 May 24 15:50:08.657827 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User: tempest-AttachVolumeNegativeTest-2098560824-project May 24 15:50:08.657827 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Domain-Id: default May 24 15:50:08.657827 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Domain-Name: Default May 24 15:50:08.657827 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Id: ca179fc319904fcb9b343c9e7de28e6f May 24 15:50:08.657827 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Name: tempest-AttachVolumeNegativeTest-2098560824-project May 24 15:50:08.657827 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: method: > May 24 15:50:08.657827 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: exception: Instance 14af50a7-06c8-4c6e-a797-3e3c55b59d65 could not be found. May 24 15:50:08.657827 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: action_args: {'id': '14af50a7-06c8-4c6e-a797-3e3c55b59d65'} May 24 15:50:08.658838 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:50:08.658838 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:50:08.658838 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:50:08.658838 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:50:08.658838 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:50:08.658838 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:50:08.658838 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:50:08.658838 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:50:08.658838 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:50:08.658838 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:50:08.658838 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14af50a7-06c8-4c6e-a797-3e3c55b59d65 could not be found. May 24 15:50:08.658838 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:50:08.658838 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:50:08.658838 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:50:08.658838 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:50:08.658838 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:50:08.658838 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:50:08.658838 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:50:08.658838 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:50:08.658838 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:50:08.660556 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:50:08.660556 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 15:50:08.660556 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 15:50:08.660556 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:50:08.660556 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:50:08.660556 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:50:08.660556 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:50:08.660556 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14af50a7-06c8-4c6e-a797-3e3c55b59d65 could not be found. May 24 15:50:08.660556 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:50:08.660556 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:50:08.660556 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:50:08.660556 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:50:08.660556 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:50:08.660556 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:50:08.660556 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:50:08.660556 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:50:08.660556 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14af50a7-06c8-4c6e-a797-3e3c55b59d65 could not be found. May 24 15:50:08.660556 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:50:08.661980 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-b429ffb9-c602-4cd8-be8b-306b0ed19b4e tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] Returning 404 to user: Instance 14af50a7-06c8-4c6e-a797-3e3c55b59d65 could not be found. {{(pid=117699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:50:08.661980 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-b429ffb9-c602-4cd8-be8b-306b0ed19b4e tempest-AttachVolumeNegativeTest-2098560824 tempest-AttachVolumeNegativeTest-2098560824-project] 10.222.0.45 "GET /compute/v2.1/servers/14af50a7-06c8-4c6e-a797-3e3c55b59d65" status: 404 len: 111 microversion: 2.1 time: 0.028260 May 24 15:50:08.661980 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1493/2994] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:50:08 2022] GET /compute/v2.1/servers/14af50a7-06c8-4c6e-a797-3e3c55b59d65 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:50:13.258579 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-70fe2706-ca4b-4730-9105-0b9fbc8be5cb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:50:13.259372 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-70fe2706-ca4b-4730-9105-0b9fbc8be5cb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:50:13.265863 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-70fe2706-ca4b-4730-9105-0b9fbc8be5cb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:50:13.266312 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-70fe2706-ca4b-4730-9105-0b9fbc8be5cb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:50:13.267079 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-70fe2706-ca4b-4730-9105-0b9fbc8be5cb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:50:13.267513 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-70fe2706-ca4b-4730-9105-0b9fbc8be5cb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:50:13.282064 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.wsgi [None req-70fe2706-ca4b-4730-9105-0b9fbc8be5cb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] HTTP exception thrown: Instance 6c54fc3c-070c-4cab-b181-081d80eeb078 could not be found. May 24 15:50:13.283895 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-70fe2706-ca4b-4730-9105-0b9fbc8be5cb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Request method failure captured: May 24 15:50:13.283895 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: request: DELETE /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 HTTP/1.1 May 24 15:50:13.283895 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Accept: application/json May 24 15:50:13.283895 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Accept-Encoding: identity May 24 15:50:13.283895 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Connection: close May 24 15:50:13.283895 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Content-Length: 0 May 24 15:50:13.283895 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Content-Type: application/json May 24 15:50:13.283895 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Host: 10.222.0.45 May 24 15:50:13.283895 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Openstack-System-Scope: None May 24 15:50:13.283895 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: User-Agent: python-urllib3/1.26.9 May 24 15:50:13.283895 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Auth-Token: gAAAAABijPeuaufzab__LW0AXFUD7qP3coXWErtTGwE4hbdoUo03gqoDEHy5CS-BmHgidyoVMWAvp5Uj_iNGcThIDUxA4GGTxU20jlxu0ExSDAc6-x58RvVeGBXOesvIA0pDu8VTfm-9ODH44J9iSDAjfB9glnXGDaB1SAI3dZmmiIY2DodrS1Y May 24 15:50:13.283895 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Domain-Id: None May 24 15:50:13.283895 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Domain-Name: None May 24 15:50:13.283895 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Identity-Status: Confirmed May 24 15:50:13.283895 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Is-Admin-Project: True May 24 15:50:13.283895 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Openstack-Nova-Api-Version: 2.20 May 24 15:50:13.283895 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Domain-Id: default May 24 15:50:13.283895 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Domain-Name: Default May 24 15:50:13.283895 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Id: 0fe1d758c40542e9b237f9d7bcfa5755 May 24 15:50:13.283895 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-467395804 May 24 15:50:13.283895 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Role: reader,member May 24 15:50:13.283895 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Roles: reader,member May 24 15:50:13.285866 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0fe1d758c40542e9b237f9d7bcfa5755"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0fe1d758c40542e9b237f9d7bcfa5755"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0fe1d758c40542e9b237f9d7bcfa5755"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0fe1d758c40542e9b237f9d7bcfa5755"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 24 15:50:13.285866 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Tenant: tempest-AttachVolumeShelveTestJSON-467395804 May 24 15:50:13.285866 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Tenant-Id: 0fe1d758c40542e9b237f9d7bcfa5755 May 24 15:50:13.285866 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-467395804 May 24 15:50:13.285866 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User: tempest-AttachVolumeShelveTestJSON-467395804-project May 24 15:50:13.285866 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Domain-Id: default May 24 15:50:13.285866 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Domain-Name: Default May 24 15:50:13.285866 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Id: 40db5795ce7e4c5bbf06fb81ce404e78 May 24 15:50:13.285866 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Name: tempest-AttachVolumeShelveTestJSON-467395804-project May 24 15:50:13.285866 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: method: > May 24 15:50:13.285866 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: exception: Instance 6c54fc3c-070c-4cab-b181-081d80eeb078 could not be found. May 24 15:50:13.285866 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: action_args: {'id': '6c54fc3c-070c-4cab-b181-081d80eeb078'} May 24 15:50:13.286734 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:50:13.286734 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:50:13.286734 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:50:13.286734 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:50:13.286734 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:50:13.286734 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:50:13.286734 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:50:13.286734 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:50:13.286734 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:50:13.286734 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:50:13.286734 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c54fc3c-070c-4cab-b181-081d80eeb078 could not be found. May 24 15:50:13.286734 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:50:13.286734 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:50:13.286734 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:50:13.286734 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:50:13.286734 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:50:13.286734 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:50:13.286734 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:50:13.286734 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:50:13.286734 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:50:13.288106 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:50:13.288106 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 24 15:50:13.288106 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 24 15:50:13.288106 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 24 15:50:13.288106 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 24 15:50:13.288106 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:50:13.288106 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:50:13.288106 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:50:13.288106 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:50:13.288106 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c54fc3c-070c-4cab-b181-081d80eeb078 could not be found. May 24 15:50:13.288106 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:50:13.288106 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:50:13.288106 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:50:13.288106 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:50:13.288106 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:50:13.288106 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:50:13.288106 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:50:13.288106 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:50:13.288106 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c54fc3c-070c-4cab-b181-081d80eeb078 could not be found. May 24 15:50:13.288106 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:50:13.292259 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-70fe2706-ca4b-4730-9105-0b9fbc8be5cb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Returning 404 to user: Instance 6c54fc3c-070c-4cab-b181-081d80eeb078 could not be found. {{(pid=117698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:50:13.293128 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-70fe2706-ca4b-4730-9105-0b9fbc8be5cb tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "DELETE /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 404 len: 111 microversion: 2.20 time: 0.038638 May 24 15:50:13.293752 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1502/2995] 10.222.0.45 () {60 vars in 1279 bytes} [Tue May 24 15:50:13 2022] DELETE /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 24 15:50:13.310816 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a4552576-bf8f-48c0-b936-b34f8dafa93b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:50:13.312950 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a4552576-bf8f-48c0-b936-b34f8dafa93b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] [instance: 6c54fc3c-070c-4cab-b181-081d80eeb078] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:50:13.318102 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a4552576-bf8f-48c0-b936-b34f8dafa93b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:50:13.318583 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a4552576-bf8f-48c0-b936-b34f8dafa93b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:50:13.319397 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a4552576-bf8f-48c0-b936-b34f8dafa93b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:50:13.320091 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a4552576-bf8f-48c0-b936-b34f8dafa93b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:50:13.342704 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.wsgi [None req-a4552576-bf8f-48c0-b936-b34f8dafa93b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] HTTP exception thrown: Instance 6c54fc3c-070c-4cab-b181-081d80eeb078 could not be found. May 24 15:50:13.344704 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a4552576-bf8f-48c0-b936-b34f8dafa93b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Request method failure captured: May 24 15:50:13.344704 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: request: GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 HTTP/1.1 May 24 15:50:13.344704 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Accept: application/json May 24 15:50:13.344704 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Accept-Encoding: identity May 24 15:50:13.344704 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Connection: close May 24 15:50:13.344704 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Content-Length: 0 May 24 15:50:13.344704 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Content-Type: application/json May 24 15:50:13.344704 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Host: 10.222.0.45 May 24 15:50:13.344704 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Openstack-System-Scope: None May 24 15:50:13.344704 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: User-Agent: python-urllib3/1.26.9 May 24 15:50:13.344704 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Auth-Token: gAAAAABijPeuaufzab__LW0AXFUD7qP3coXWErtTGwE4hbdoUo03gqoDEHy5CS-BmHgidyoVMWAvp5Uj_iNGcThIDUxA4GGTxU20jlxu0ExSDAc6-x58RvVeGBXOesvIA0pDu8VTfm-9ODH44J9iSDAjfB9glnXGDaB1SAI3dZmmiIY2DodrS1Y May 24 15:50:13.344704 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Domain-Id: None May 24 15:50:13.344704 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Domain-Name: None May 24 15:50:13.344704 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Identity-Status: Confirmed May 24 15:50:13.344704 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Is-Admin-Project: True May 24 15:50:13.344704 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Openstack-Nova-Api-Version: 2.20 May 24 15:50:13.344704 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Domain-Id: default May 24 15:50:13.344704 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Domain-Name: Default May 24 15:50:13.344704 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Id: 0fe1d758c40542e9b237f9d7bcfa5755 May 24 15:50:13.344704 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-467395804 May 24 15:50:13.344704 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Role: reader,member May 24 15:50:13.344704 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Roles: reader,member May 24 15:50:13.346343 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0fe1d758c40542e9b237f9d7bcfa5755"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0fe1d758c40542e9b237f9d7bcfa5755"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0fe1d758c40542e9b237f9d7bcfa5755"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0fe1d758c40542e9b237f9d7bcfa5755"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 24 15:50:13.346343 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant: tempest-AttachVolumeShelveTestJSON-467395804 May 24 15:50:13.346343 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant-Id: 0fe1d758c40542e9b237f9d7bcfa5755 May 24 15:50:13.346343 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-467395804 May 24 15:50:13.346343 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User: tempest-AttachVolumeShelveTestJSON-467395804-project May 24 15:50:13.346343 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Domain-Id: default May 24 15:50:13.346343 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Domain-Name: Default May 24 15:50:13.346343 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Id: 40db5795ce7e4c5bbf06fb81ce404e78 May 24 15:50:13.346343 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Name: tempest-AttachVolumeShelveTestJSON-467395804-project May 24 15:50:13.346343 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: method: > May 24 15:50:13.346343 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: exception: Instance 6c54fc3c-070c-4cab-b181-081d80eeb078 could not be found. May 24 15:50:13.346343 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: action_args: {'id': '6c54fc3c-070c-4cab-b181-081d80eeb078'} May 24 15:50:13.347204 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:50:13.347204 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:50:13.347204 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:50:13.347204 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:50:13.347204 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:50:13.347204 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:50:13.347204 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:50:13.347204 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:50:13.347204 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:50:13.347204 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:50:13.347204 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c54fc3c-070c-4cab-b181-081d80eeb078 could not be found. May 24 15:50:13.347204 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:50:13.347204 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:50:13.347204 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:50:13.347204 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:50:13.347204 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:50:13.347204 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:50:13.347204 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:50:13.347204 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:50:13.347204 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:50:13.348782 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:50:13.348782 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 15:50:13.348782 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 15:50:13.348782 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:50:13.348782 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:50:13.348782 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:50:13.348782 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:50:13.348782 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c54fc3c-070c-4cab-b181-081d80eeb078 could not be found. May 24 15:50:13.348782 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:50:13.348782 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:50:13.348782 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:50:13.348782 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:50:13.348782 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:50:13.348782 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:50:13.348782 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:50:13.348782 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:50:13.348782 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c54fc3c-070c-4cab-b181-081d80eeb078 could not be found. May 24 15:50:13.348782 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:50:13.350809 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a4552576-bf8f-48c0-b936-b34f8dafa93b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] Returning 404 to user: Instance 6c54fc3c-070c-4cab-b181-081d80eeb078 could not be found. {{(pid=117699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:50:13.351646 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a4552576-bf8f-48c0-b936-b34f8dafa93b tempest-AttachVolumeShelveTestJSON-467395804 tempest-AttachVolumeShelveTestJSON-467395804-project] 10.222.0.45 "GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078" status: 404 len: 111 microversion: 2.20 time: 0.053408 May 24 15:50:13.352188 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1494/2996] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 15:50:13 2022] GET /compute/v2.1/servers/6c54fc3c-070c-4cab-b181-081d80eeb078 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 24 15:50:26.295320 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 15:50:26.295925 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Tue May 24 15:50:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 15:53:19.205159 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 15:53:19.205731 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Tue May 24 15:53:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 15:53:30.129360 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 15:53:30.129828 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Tue May 24 15:53:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 15:53:41.855543 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 15:53:41.856726 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Tue May 24 15:53:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 15:53:46.303511 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 15:53:46.304139 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Tue May 24 15:53:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 15:54:19.707302 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7e770269-d0e3-4f7f-b076-1dfeee56f131] AMQP server on 10.222.0.45:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 24 15:54:19.707964 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_api:SELECT=14 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:54:19.708582 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=22 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:54:19.897747 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [req-185474a0-3345-40bf-b79c-4961b9c6eb50 req-e5e098df-3c17-461f-bd64-6e1feee48537 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3017990e-8735-4d85-a686-1eebb1484dd3", "name": "network-vif-deleted", "tag": "ca6cef6e-61fd-4449-934f-86f49e0487c0"}]} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:54:19.906803 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-185474a0-3345-40bf-b79c-4961b9c6eb50 req-e5e098df-3c17-461f-bd64-6e1feee48537 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:54:19.907180 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-185474a0-3345-40bf-b79c-4961b9c6eb50 req-e5e098df-3c17-461f-bd64-6e1feee48537 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:54:19.917309 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.compute.server_external_events [req-185474a0-3345-40bf-b79c-4961b9c6eb50 req-e5e098df-3c17-461f-bd64-6e1feee48537 service nova] Creating event network-vif-deleted:ca6cef6e-61fd-4449-934f-86f49e0487c0 for instance 3017990e-8735-4d85-a686-1eebb1484dd3 on hv-cinder-84315 May 24 15:54:19.923612 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [req-185474a0-3345-40bf-b79c-4961b9c6eb50 req-e5e098df-3c17-461f-bd64-6e1feee48537 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.224510 May 24 15:54:19.924185 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1503/2997] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:55:16.220669 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 15:55:16.221282 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Tue May 24 15:55:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 15:55:20.933501 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e630f128-9d86-4e1b-b4c0-e3ee323af13a] AMQP server on 10.222.0.45:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 24 15:55:20.935537 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:55:20.936516 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:55:20.941018 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-6e7eb35e-d746-40f5-95d0-88a52347cdea tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:55:20.944436 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-6e7eb35e-d746-40f5-95d0-88a52347cdea tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: baacc852-cde4-4e1a-ade9-183a97312b6f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:55:20.959033 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6e7eb35e-d746-40f5-95d0-88a52347cdea tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:55:20.960447 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6e7eb35e-d746-40f5-95d0-88a52347cdea tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:55:20.961729 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6e7eb35e-d746-40f5-95d0-88a52347cdea tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:55:20.962395 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6e7eb35e-d746-40f5-95d0-88a52347cdea tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:55:20.996962 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-6e7eb35e-d746-40f5-95d0-88a52347cdea tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: baacc852-cde4-4e1a-ade9-183a97312b6f] Going to try to terminate instance {{(pid=117699) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 15:55:21.076323 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-48e17682-0255-44f6-943d-bd8bc26c65ce tempest-VolumesTestJSON-124297417 tempest-VolumesTestJSON-124297417-project] Calling method '.version_select at 0x7f2ddc0e15e0>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:55:21.087349 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_api:SELECT=2 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:55:21.089141 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=2 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:55:21.097809 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6e7eb35e-d746-40f5-95d0-88a52347cdea tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [51e30540-60e9-43fb-a4fb-499d36635ea7] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 24 15:55:21.104187 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO oslo.messaging._drivers.impl_rabbit [-] [7e770269-d0e3-4f7f-b076-1dfeee56f131] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 56540. May 24 15:55:21.424980 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-48e17682-0255-44f6-943d-bd8bc26c65ce tempest-VolumesTestJSON-124297417 tempest-VolumesTestJSON-124297417-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/afb3bc32-4f8e-42a1-a941-aadf6640d892" status: 200 len: 351 microversion: 2.1 time: 0.353504 May 24 15:55:21.426057 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1504/2998] 10.222.0.45 () {58 vars in 1244 bytes} [Tue May 24 15:55:21 2022] GET /compute/v2.1/os-volumes/afb3bc32-4f8e-42a1-a941-aadf6640d892 => generated 351 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:55:21.942629 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO oslo.messaging._drivers.impl_rabbit [-] [e630f128-9d86-4e1b-b4c0-e3ee323af13a] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 56590. May 24 15:55:22.106646 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO oslo.messaging._drivers.impl_rabbit [None req-6e7eb35e-d746-40f5-95d0-88a52347cdea tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [51e30540-60e9-43fb-a4fb-499d36635ea7] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 56596. May 24 15:55:22.127017 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-6e7eb35e-d746-40f5-95d0-88a52347cdea tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "DELETE /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f" status: 204 len: 0 microversion: 2.1 time: 1.195591 May 24 15:55:22.127604 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1495/2999] 10.222.0.45 () {58 vars in 1238 bytes} [Tue May 24 15:55:20 2022] DELETE /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f => generated 0 bytes in 1197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 15:55:22.137020 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-8b0633bc-a7f2-4b2e-ba55-3c40a7813447 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:55:22.137758 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-8b0633bc-a7f2-4b2e-ba55-3c40a7813447 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: baacc852-cde4-4e1a-ade9-183a97312b6f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:55:22.145240 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8b0633bc-a7f2-4b2e-ba55-3c40a7813447 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:55:22.145689 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8b0633bc-a7f2-4b2e-ba55-3c40a7813447 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:55:22.146573 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8b0633bc-a7f2-4b2e-ba55-3c40a7813447 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:55:22.147040 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-8b0633bc-a7f2-4b2e-ba55-3c40a7813447 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:55:22.284726 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-8b0633bc-a7f2-4b2e-ba55-3c40a7813447 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:55:22.293078 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-8b0633bc-a7f2-4b2e-ba55-3c40a7813447 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f" status: 200 len: 1508 microversion: 2.1 time: 0.161087 May 24 15:55:22.294277 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1505/3000] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:55:22 2022] GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:55:23.311750 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-8e205a05-7fc6-4d9c-8a61-2be98cd1fecb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:55:23.312477 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-8e205a05-7fc6-4d9c-8a61-2be98cd1fecb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: baacc852-cde4-4e1a-ade9-183a97312b6f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:55:23.319666 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8e205a05-7fc6-4d9c-8a61-2be98cd1fecb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:55:23.320111 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8e205a05-7fc6-4d9c-8a61-2be98cd1fecb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:55:23.320909 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8e205a05-7fc6-4d9c-8a61-2be98cd1fecb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:55:23.321342 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8e205a05-7fc6-4d9c-8a61-2be98cd1fecb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:55:23.602462 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-8e205a05-7fc6-4d9c-8a61-2be98cd1fecb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:55:23.610308 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-8e205a05-7fc6-4d9c-8a61-2be98cd1fecb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f" status: 200 len: 1508 microversion: 2.1 time: 0.303360 May 24 15:55:23.610865 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1496/3001] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:55:23 2022] GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f => generated 1508 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:55:24.626869 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-80971c0c-14e1-4956-8b1d-ef1aadb3c635 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:55:24.627487 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-80971c0c-14e1-4956-8b1d-ef1aadb3c635 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: baacc852-cde4-4e1a-ade9-183a97312b6f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:55:24.634372 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-80971c0c-14e1-4956-8b1d-ef1aadb3c635 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:55:24.634762 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-80971c0c-14e1-4956-8b1d-ef1aadb3c635 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:55:24.635525 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-80971c0c-14e1-4956-8b1d-ef1aadb3c635 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:55:24.635965 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-80971c0c-14e1-4956-8b1d-ef1aadb3c635 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:55:24.839781 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-80971c0c-14e1-4956-8b1d-ef1aadb3c635 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:55:24.857209 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-80971c0c-14e1-4956-8b1d-ef1aadb3c635 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f" status: 200 len: 1508 microversion: 2.1 time: 0.234035 May 24 15:55:24.866664 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1506/3002] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:55:24 2022] GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f => generated 1508 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:55:25.228860 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [req-5570bec7-0872-421f-9083-53c16f5c5786 req-90291fa7-e53a-464f-930f-ac4ab9eb5e5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "916e547e-8501-44fe-8429-5f9086c85992", "name": "network-vif-deleted", "tag": "47dec4a5-f4a8-4396-821c-6a9d55b5dde0"}]} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:55:25.240809 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-5570bec7-0872-421f-9083-53c16f5c5786 req-90291fa7-e53a-464f-930f-ac4ab9eb5e5d service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:55:25.243531 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-5570bec7-0872-421f-9083-53c16f5c5786 req-90291fa7-e53a-464f-930f-ac4ab9eb5e5d service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:55:25.258675 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.compute.server_external_events [req-5570bec7-0872-421f-9083-53c16f5c5786 req-90291fa7-e53a-464f-930f-ac4ab9eb5e5d service nova] Creating event network-vif-deleted:47dec4a5-f4a8-4396-821c-6a9d55b5dde0 for instance 916e547e-8501-44fe-8429-5f9086c85992 on hv-cinder-84315 May 24 15:55:25.268177 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [req-5570bec7-0872-421f-9083-53c16f5c5786 req-90291fa7-e53a-464f-930f-ac4ab9eb5e5d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042912 May 24 15:55:25.268828 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1497/3003] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:55:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:55:25.714960 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [req-10c9b10c-26ed-4f50-8496-d97bbab45724 req-39429b96-dcc1-4698-8cfd-ca12d6c7d8f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baacc852-cde4-4e1a-ade9-183a97312b6f", "name": "network-vif-deleted", "tag": "8ddee3e5-269b-490f-9155-2edef63bd8a9"}]} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:55:25.726982 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-10c9b10c-26ed-4f50-8496-d97bbab45724 req-39429b96-dcc1-4698-8cfd-ca12d6c7d8f4 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:55:25.727712 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-10c9b10c-26ed-4f50-8496-d97bbab45724 req-39429b96-dcc1-4698-8cfd-ca12d6c7d8f4 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:55:25.744477 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.compute.server_external_events [req-10c9b10c-26ed-4f50-8496-d97bbab45724 req-39429b96-dcc1-4698-8cfd-ca12d6c7d8f4 service nova] Creating event network-vif-deleted:8ddee3e5-269b-490f-9155-2edef63bd8a9 for instance baacc852-cde4-4e1a-ade9-183a97312b6f on hv-cinder-84315 May 24 15:55:25.751631 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [req-10c9b10c-26ed-4f50-8496-d97bbab45724 req-39429b96-dcc1-4698-8cfd-ca12d6c7d8f4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117103 May 24 15:55:25.752713 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1507/3004] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:55:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:55:25.878349 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-9e42073a-ca3a-4742-8891-603e33e25bdc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:55:25.879341 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-9e42073a-ca3a-4742-8891-603e33e25bdc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: baacc852-cde4-4e1a-ade9-183a97312b6f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:55:25.888507 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9e42073a-ca3a-4742-8891-603e33e25bdc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:55:25.889204 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9e42073a-ca3a-4742-8891-603e33e25bdc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:55:25.890014 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9e42073a-ca3a-4742-8891-603e33e25bdc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:55:25.890453 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9e42073a-ca3a-4742-8891-603e33e25bdc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:55:25.946786 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-f4e6f89a-a15a-4d73-ad94-209f254b062e tempest-VolumesTestJSON-124297417 tempest-VolumesTestJSON-124297417-project] Calling method '.version_select at 0x7f2ddc0e1dc0>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:55:25.980139 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-9e42073a-ca3a-4742-8891-603e33e25bdc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:55:25.990387 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-9e42073a-ca3a-4742-8891-603e33e25bdc tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f" status: 200 len: 1293 microversion: 2.1 time: 0.116295 May 24 15:55:25.990981 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1498/3005] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:55:25 2022] GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f => generated 1293 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:55:26.021050 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-f4e6f89a-a15a-4d73-ad94-209f254b062e tempest-VolumesTestJSON-124297417 tempest-VolumesTestJSON-124297417-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/cb92408a-3fde-4eb6-af9b-52fa905e9864" status: 200 len: 349 microversion: 2.1 time: 0.078448 May 24 15:55:26.021609 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1508/3006] 10.222.0.45 () {58 vars in 1244 bytes} [Tue May 24 15:55:25 2022] GET /compute/v2.1/os-volumes/cb92408a-3fde-4eb6-af9b-52fa905e9864 => generated 349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:55:27.007382 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-7929e4e4-aab3-4963-ae93-9662a8243cb7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:55:27.008089 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-7929e4e4-aab3-4963-ae93-9662a8243cb7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: baacc852-cde4-4e1a-ade9-183a97312b6f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:55:27.016046 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7929e4e4-aab3-4963-ae93-9662a8243cb7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:55:27.017079 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7929e4e4-aab3-4963-ae93-9662a8243cb7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:55:27.018376 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7929e4e4-aab3-4963-ae93-9662a8243cb7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:55:27.019246 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7929e4e4-aab3-4963-ae93-9662a8243cb7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:55:27.037427 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.wsgi [None req-7929e4e4-aab3-4963-ae93-9662a8243cb7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] HTTP exception thrown: Instance baacc852-cde4-4e1a-ade9-183a97312b6f could not be found. May 24 15:55:27.039175 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-7929e4e4-aab3-4963-ae93-9662a8243cb7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Request method failure captured: May 24 15:55:27.039175 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: request: GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f HTTP/1.1 May 24 15:55:27.039175 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Accept: application/json May 24 15:55:27.039175 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Accept-Encoding: identity May 24 15:55:27.039175 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Connection: close May 24 15:55:27.039175 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Content-Length: 0 May 24 15:55:27.039175 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Content-Type: application/json May 24 15:55:27.039175 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Host: 10.222.0.45 May 24 15:55:27.039175 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Openstack-System-Scope: None May 24 15:55:27.039175 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: User-Agent: python-urllib3/1.26.9 May 24 15:55:27.039175 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Auth-Token: gAAAAABijPekO_FEqvEt__l4I8WEGx17L4yqtzpCAeEc3y4CnbJAHyL1DySC4YIlKQDTV1hsPFcvsVRhAbutvBRf9w65KzCkRaS-QYMp5wOBtVk4LwevMnKVJp-p3Ycug9G9UYw2xMBk2TmyRPXhISTuFKrt-_kc3sLkHf7ee14Z1I5hnTaBDlA May 24 15:55:27.039175 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Domain-Id: None May 24 15:55:27.039175 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Domain-Name: None May 24 15:55:27.039175 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Identity-Status: Confirmed May 24 15:55:27.039175 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Is-Admin-Project: True May 24 15:55:27.039175 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Domain-Id: default May 24 15:55:27.039175 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Domain-Name: Default May 24 15:55:27.039175 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Id: e8d86717f1954ab7a59cdef0cf13556c May 24 15:55:27.039175 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1254703915 May 24 15:55:27.039175 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Role: reader,member May 24 15:55:27.039175 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Roles: reader,member May 24 15:55:27.041141 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e8d86717f1954ab7a59cdef0cf13556c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e8d86717f1954ab7a59cdef0cf13556c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e8d86717f1954ab7a59cdef0cf13556c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e8d86717f1954ab7a59cdef0cf13556c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 24 15:55:27.041141 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1254703915 May 24 15:55:27.041141 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant-Id: e8d86717f1954ab7a59cdef0cf13556c May 24 15:55:27.041141 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1254703915 May 24 15:55:27.041141 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User: tempest-ServerRescueNegativeTestJSON-1254703915-project May 24 15:55:27.041141 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Domain-Id: default May 24 15:55:27.041141 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Domain-Name: Default May 24 15:55:27.041141 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Id: 2d8a7414fd254ec981d35b417dc373cd May 24 15:55:27.041141 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1254703915-project May 24 15:55:27.041141 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: method: > May 24 15:55:27.041141 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: exception: Instance baacc852-cde4-4e1a-ade9-183a97312b6f could not be found. May 24 15:55:27.041141 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: action_args: {'id': 'baacc852-cde4-4e1a-ade9-183a97312b6f'} May 24 15:55:27.042199 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:55:27.042199 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:55:27.042199 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:55:27.042199 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:55:27.042199 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:55:27.042199 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:55:27.042199 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:55:27.042199 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:55:27.042199 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:55:27.042199 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:55:27.042199 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance baacc852-cde4-4e1a-ade9-183a97312b6f could not be found. May 24 15:55:27.042199 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:55:27.042199 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:55:27.042199 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:55:27.042199 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:55:27.042199 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:55:27.042199 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:55:27.042199 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:55:27.042199 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:55:27.042199 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:55:27.044700 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:55:27.044700 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 15:55:27.044700 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 15:55:27.044700 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:55:27.044700 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:55:27.044700 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:55:27.044700 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:55:27.044700 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance baacc852-cde4-4e1a-ade9-183a97312b6f could not be found. May 24 15:55:27.044700 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:55:27.044700 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:55:27.044700 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:55:27.044700 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:55:27.044700 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:55:27.044700 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:55:27.044700 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:55:27.044700 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:55:27.044700 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance baacc852-cde4-4e1a-ade9-183a97312b6f could not be found. May 24 15:55:27.044700 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 15:55:27.046475 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-7929e4e4-aab3-4963-ae93-9662a8243cb7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Returning 404 to user: Instance baacc852-cde4-4e1a-ade9-183a97312b6f could not be found. {{(pid=117699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:55:27.046475 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-7929e4e4-aab3-4963-ae93-9662a8243cb7 tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f" status: 404 len: 111 microversion: 2.1 time: 0.039468 May 24 15:55:27.046475 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1499/3007] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:55:27 2022] GET /compute/v2.1/servers/baacc852-cde4-4e1a-ade9-183a97312b6f => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:55:27.054469 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-cd9d8372-91c4-4a0b-8e17-4eb6bdc220fb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:55:27.055042 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-cd9d8372-91c4-4a0b-8e17-4eb6bdc220fb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: d01bc80d-033e-4940-a604-b4f34ee070a9] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:55:27.061528 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cd9d8372-91c4-4a0b-8e17-4eb6bdc220fb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:55:27.062080 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cd9d8372-91c4-4a0b-8e17-4eb6bdc220fb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:55:27.063082 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cd9d8372-91c4-4a0b-8e17-4eb6bdc220fb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:55:27.063623 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-cd9d8372-91c4-4a0b-8e17-4eb6bdc220fb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:55:27.091353 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-cd9d8372-91c4-4a0b-8e17-4eb6bdc220fb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: d01bc80d-033e-4940-a604-b4f34ee070a9] Going to try to terminate instance {{(pid=117698) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 15:55:27.169654 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-cd9d8372-91c4-4a0b-8e17-4eb6bdc220fb tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "DELETE /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9" status: 204 len: 0 microversion: 2.1 time: 0.120102 May 24 15:55:27.170913 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1509/3008] 10.222.0.45 () {58 vars in 1238 bytes} [Tue May 24 15:55:27 2022] DELETE /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 15:55:27.178898 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-a0babf40-5c26-414b-bc46-16789413376f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:55:27.179508 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-a0babf40-5c26-414b-bc46-16789413376f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: d01bc80d-033e-4940-a604-b4f34ee070a9] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:55:27.185836 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a0babf40-5c26-414b-bc46-16789413376f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:55:27.186398 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a0babf40-5c26-414b-bc46-16789413376f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:55:27.187076 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a0babf40-5c26-414b-bc46-16789413376f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:55:27.187801 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-a0babf40-5c26-414b-bc46-16789413376f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:55:27.377328 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-71b85f15-cc44-4400-9a46-996c40a588b8 tempest-VolumesTestJSON-124297417 tempest-VolumesTestJSON-124297417-project] Calling method '.version_select at 0x7f2ddc0e1040>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:55:27.378894 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-a0babf40-5c26-414b-bc46-16789413376f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:55:27.386798 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-a0babf40-5c26-414b-bc46-16789413376f tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9" status: 200 len: 1520 microversion: 2.1 time: 0.211882 May 24 15:55:27.390299 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1500/3009] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:55:27 2022] GET /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9 => generated 1520 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:55:27.432369 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-71b85f15-cc44-4400-9a46-996c40a588b8 tempest-VolumesTestJSON-124297417 tempest-VolumesTestJSON-124297417-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/cff7080f-7a9b-4b42-841a-771c85f6f686" status: 200 len: 350 microversion: 2.1 time: 0.060242 May 24 15:55:27.433487 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1510/3010] 10.222.0.45 () {58 vars in 1244 bytes} [Tue May 24 15:55:27 2022] GET /compute/v2.1/os-volumes/cff7080f-7a9b-4b42-841a-771c85f6f686 => generated 350 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:55:27.447399 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-324b02a9-3081-4884-b972-9322df74a992 tempest-VolumesTestJSON-124297417 tempest-VolumesTestJSON-124297417-project] Calling method '.version_select at 0x7f2dd2bccf70>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:55:27.557443 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-324b02a9-3081-4884-b972-9322df74a992 tempest-VolumesTestJSON-124297417 tempest-VolumesTestJSON-124297417-project] 10.222.0.45 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.114065 May 24 15:55:27.558006 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1501/3011] 10.222.0.45 () {58 vars in 1133 bytes} [Tue May 24 15:55:27 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:55:27.570353 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-5c5d7e2a-dbbc-4dac-baf0-8e32ea16f63e tempest-VolumesTestJSON-124297417 tempest-VolumesTestJSON-124297417-project] Calling method '.version_select at 0x7f2dd25ac310>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:55:27.653940 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-5c5d7e2a-dbbc-4dac-baf0-8e32ea16f63e tempest-VolumesTestJSON-124297417 tempest-VolumesTestJSON-124297417-project] 10.222.0.45 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.087277 May 24 15:55:27.654508 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1511/3012] 10.222.0.45 () {58 vars in 1148 bytes} [Tue May 24 15:55:27 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 692 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:55:27.666299 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-7a88e9ac-b470-4e60-980a-4e7b9ad3840a tempest-VolumesTestJSON-124297417 tempest-VolumesTestJSON-124297417-project] Calling method '.version_select at 0x7f2ddbfd10d0>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:55:27.753497 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-7a88e9ac-b470-4e60-980a-4e7b9ad3840a tempest-VolumesTestJSON-124297417 tempest-VolumesTestJSON-124297417-project] 10.222.0.45 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.091236 May 24 15:55:27.754063 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1502/3013] 10.222.0.45 () {58 vars in 1133 bytes} [Tue May 24 15:55:27 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:55:27.765586 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-490273c9-e78d-4f21-b70c-38f79dde486f tempest-VolumesTestJSON-124297417 tempest-VolumesTestJSON-124297417-project] Calling method '.version_select at 0x7f2dd278d310>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:55:27.847480 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-490273c9-e78d-4f21-b70c-38f79dde486f tempest-VolumesTestJSON-124297417 tempest-VolumesTestJSON-124297417-project] 10.222.0.45 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.086175 May 24 15:55:27.848106 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1512/3014] 10.222.0.45 () {58 vars in 1166 bytes} [Tue May 24 15:55:27 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:55:27.859898 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-b6ef3c71-7aaa-481c-b9bd-35ffd0575562 tempest-VolumesTestJSON-124297417 tempest-VolumesTestJSON-124297417-project] Calling method '.version_select at 0x7f2dd2d44c10>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:55:27.947912 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-b6ef3c71-7aaa-481c-b9bd-35ffd0575562 tempest-VolumesTestJSON-124297417 tempest-VolumesTestJSON-124297417-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.091790 May 24 15:55:27.948504 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1503/3015] 10.222.0.45 () {58 vars in 1169 bytes} [Tue May 24 15:55:27 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 692 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:55:27.960236 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d25dc4ca-f00c-4416-b82d-f6daf69e4d8f tempest-VolumesTestJSON-124297417 tempest-VolumesTestJSON-124297417-project] Calling method '.version_select at 0x7f2ddc0e15e0>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:55:28.045872 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d25dc4ca-f00c-4416-b82d-f6daf69e4d8f tempest-VolumesTestJSON-124297417 tempest-VolumesTestJSON-124297417-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.086777 May 24 15:55:28.045872 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1513/3016] 10.222.0.45 () {58 vars in 1154 bytes} [Tue May 24 15:55:27 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:55:28.058132 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e0fa94e4-ce3b-40ac-8508-16b716ddf378 tempest-VolumesTestJSON-124297417 tempest-VolumesTestJSON-124297417-project] Calling method '.version_select at 0x7f2dd2d44dc0>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:55:28.201328 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-e0fa94e4-ce3b-40ac-8508-16b716ddf378 tempest-VolumesTestJSON-124297417 tempest-VolumesTestJSON-124297417-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.149578 May 24 15:55:28.202219 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1504/3017] 10.222.0.45 () {58 vars in 1187 bytes} [Tue May 24 15:55:28 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 352 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:55:28.220783 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-5f514460-5435-490e-9cd0-70e4081b7d8a tempest-VolumesTestJSON-124297417 tempest-VolumesTestJSON-124297417-project] Calling method '.version_select at 0x7f2dd27e2af0>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:55:28.317693 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-5f514460-5435-490e-9cd0-70e4081b7d8a tempest-VolumesTestJSON-124297417 tempest-VolumesTestJSON-124297417-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.106870 May 24 15:55:28.318430 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1514/3018] 10.222.0.45 () {58 vars in 1154 bytes} [Tue May 24 15:55:28 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:55:28.407671 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-60067191-ab0d-4c06-a61e-13b1b38c62ed tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:55:28.408792 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-60067191-ab0d-4c06-a61e-13b1b38c62ed tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: d01bc80d-033e-4940-a604-b4f34ee070a9] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:55:28.420793 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-60067191-ab0d-4c06-a61e-13b1b38c62ed tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:55:28.421552 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-60067191-ab0d-4c06-a61e-13b1b38c62ed tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:55:28.422505 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-60067191-ab0d-4c06-a61e-13b1b38c62ed tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:55:28.423109 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-60067191-ab0d-4c06-a61e-13b1b38c62ed tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:55:28.848121 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [req-0c3bb2da-e27d-412b-bb26-2b43d8947661 req-2e013ae5-ede1-4e2e-a418-20656d657e90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d01bc80d-033e-4940-a604-b4f34ee070a9", "name": "network-vif-deleted", "tag": "3906dca3-c361-4161-9d8e-61cd5fe92161"}]} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:55:28.859883 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-0c3bb2da-e27d-412b-bb26-2b43d8947661 req-2e013ae5-ede1-4e2e-a418-20656d657e90 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:55:28.860783 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-0c3bb2da-e27d-412b-bb26-2b43d8947661 req-2e013ae5-ede1-4e2e-a418-20656d657e90 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:55:28.885241 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.compute.server_external_events [req-0c3bb2da-e27d-412b-bb26-2b43d8947661 req-2e013ae5-ede1-4e2e-a418-20656d657e90 service nova] Creating event network-vif-deleted:3906dca3-c361-4161-9d8e-61cd5fe92161 for instance d01bc80d-033e-4940-a604-b4f34ee070a9 on hv-cinder-84315 May 24 15:55:28.893512 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [req-0c3bb2da-e27d-412b-bb26-2b43d8947661 req-2e013ae5-ede1-4e2e-a418-20656d657e90 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049212 May 24 15:55:28.894918 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1515/3019] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:55:28.911928 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-60067191-ab0d-4c06-a61e-13b1b38c62ed tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8a7414fd254ec981d35b417dc373cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d86717f1954ab7a59cdef0cf13556c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:55:28.927409 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-60067191-ab0d-4c06-a61e-13b1b38c62ed tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9" status: 200 len: 1520 microversion: 2.1 time: 0.524197 May 24 15:55:28.929694 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1505/3020] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:55:28 2022] GET /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9 => generated 1520 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:55:29.947028 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-0ea52005-e0eb-42ed-aed3-f1a44fcdaa2b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:55:29.947996 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-0ea52005-e0eb-42ed-aed3-f1a44fcdaa2b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] [instance: d01bc80d-033e-4940-a604-b4f34ee070a9] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:55:29.954906 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0ea52005-e0eb-42ed-aed3-f1a44fcdaa2b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:55:29.955379 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0ea52005-e0eb-42ed-aed3-f1a44fcdaa2b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:55:29.956433 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0ea52005-e0eb-42ed-aed3-f1a44fcdaa2b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:55:29.957042 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-0ea52005-e0eb-42ed-aed3-f1a44fcdaa2b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:55:29.972350 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.wsgi [None req-0ea52005-e0eb-42ed-aed3-f1a44fcdaa2b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] HTTP exception thrown: Instance d01bc80d-033e-4940-a604-b4f34ee070a9 could not be found. May 24 15:55:29.974456 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-0ea52005-e0eb-42ed-aed3-f1a44fcdaa2b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Request method failure captured: May 24 15:55:29.974456 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: request: GET /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9 HTTP/1.1 May 24 15:55:29.974456 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Accept: application/json May 24 15:55:29.974456 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Accept-Encoding: identity May 24 15:55:29.974456 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Connection: close May 24 15:55:29.974456 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Content-Length: 0 May 24 15:55:29.974456 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Content-Type: application/json May 24 15:55:29.974456 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Host: 10.222.0.45 May 24 15:55:29.974456 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Openstack-System-Scope: None May 24 15:55:29.974456 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: User-Agent: python-urllib3/1.26.9 May 24 15:55:29.974456 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Auth-Token: gAAAAABijPekO_FEqvEt__l4I8WEGx17L4yqtzpCAeEc3y4CnbJAHyL1DySC4YIlKQDTV1hsPFcvsVRhAbutvBRf9w65KzCkRaS-QYMp5wOBtVk4LwevMnKVJp-p3Ycug9G9UYw2xMBk2TmyRPXhISTuFKrt-_kc3sLkHf7ee14Z1I5hnTaBDlA May 24 15:55:29.974456 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Domain-Id: None May 24 15:55:29.974456 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Domain-Name: None May 24 15:55:29.974456 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Identity-Status: Confirmed May 24 15:55:29.974456 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Is-Admin-Project: True May 24 15:55:29.974456 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Domain-Id: default May 24 15:55:29.974456 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Domain-Name: Default May 24 15:55:29.974456 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Id: e8d86717f1954ab7a59cdef0cf13556c May 24 15:55:29.974456 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1254703915 May 24 15:55:29.974456 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Role: reader,member May 24 15:55:29.974456 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Roles: reader,member May 24 15:55:29.976286 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e8d86717f1954ab7a59cdef0cf13556c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e8d86717f1954ab7a59cdef0cf13556c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e8d86717f1954ab7a59cdef0cf13556c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e8d86717f1954ab7a59cdef0cf13556c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 24 15:55:29.976286 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1254703915 May 24 15:55:29.976286 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Tenant-Id: e8d86717f1954ab7a59cdef0cf13556c May 24 15:55:29.976286 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1254703915 May 24 15:55:29.976286 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User: tempest-ServerRescueNegativeTestJSON-1254703915-project May 24 15:55:29.976286 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Domain-Id: default May 24 15:55:29.976286 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Domain-Name: Default May 24 15:55:29.976286 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Id: 2d8a7414fd254ec981d35b417dc373cd May 24 15:55:29.976286 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1254703915-project May 24 15:55:29.976286 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: method: > May 24 15:55:29.976286 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: exception: Instance d01bc80d-033e-4940-a604-b4f34ee070a9 could not be found. May 24 15:55:29.976286 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: action_args: {'id': 'd01bc80d-033e-4940-a604-b4f34ee070a9'} May 24 15:55:29.977312 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:55:29.977312 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:55:29.977312 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:55:29.977312 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:55:29.977312 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:55:29.977312 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:55:29.977312 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:55:29.977312 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:55:29.977312 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:55:29.977312 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:55:29.977312 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d01bc80d-033e-4940-a604-b4f34ee070a9 could not be found. May 24 15:55:29.977312 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:55:29.977312 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:55:29.977312 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:55:29.977312 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:55:29.977312 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:55:29.977312 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:55:29.977312 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:55:29.977312 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:55:29.977312 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:55:29.979008 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:55:29.979008 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 15:55:29.979008 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 15:55:29.979008 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:55:29.979008 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:55:29.979008 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:55:29.979008 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:55:29.979008 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d01bc80d-033e-4940-a604-b4f34ee070a9 could not be found. May 24 15:55:29.979008 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:55:29.979008 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:55:29.979008 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:55:29.979008 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:55:29.979008 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:55:29.979008 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:55:29.979008 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:55:29.979008 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:55:29.979008 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d01bc80d-033e-4940-a604-b4f34ee070a9 could not be found. May 24 15:55:29.979008 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:55:29.982567 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-0ea52005-e0eb-42ed-aed3-f1a44fcdaa2b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] Returning 404 to user: Instance d01bc80d-033e-4940-a604-b4f34ee070a9 could not be found. {{(pid=117698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:55:29.983433 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-0ea52005-e0eb-42ed-aed3-f1a44fcdaa2b tempest-ServerRescueNegativeTestJSON-1254703915 tempest-ServerRescueNegativeTestJSON-1254703915-project] 10.222.0.45 "GET /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9" status: 404 len: 111 microversion: 2.1 time: 0.041678 May 24 15:55:29.983994 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1516/3021] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:55:29 2022] GET /compute/v2.1/servers/d01bc80d-033e-4940-a604-b4f34ee070a9 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:55:41.932778 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:55:41.933268 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:55:42.157372 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-47ad9655-749e-4061-b64c-573e21b559a3 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Action: 'create', calling method: .version_select at 0x7f2ddbfd1b80>, body: {"keypair": {"name": "tempest-TestShelveInstance-1086846441", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCDrn5xG0+diuIVBwgOGntTHnpOapaK15FM8wFhRY0ZdKQcrOQ12M49IB5EKa2JX0ypT3moGMX5myQQNU45kRthKq8bAsEYz7CS94ngfzT67JttOxyjjFHHwtT4KNJ3TsQ=="}} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:55:42.174891 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.quota [None req-47ad9655-749e-4061-b64c-573e21b559a3 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Getting quotas for project bc1fbb8218ad4da5a2e2ac6d50bf89e0. Resources: {'key_pairs'} {{(pid=117699) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 15:55:42.179048 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.quota [None req-47ad9655-749e-4061-b64c-573e21b559a3 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Getting quotas for user 63d864e3821b4c989b474bd313722f33 and project bc1fbb8218ad4da5a2e2ac6d50bf89e0. Resources: {'key_pairs'} {{(pid=117699) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 15:55:42.205435 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-47ad9655-749e-4061-b64c-573e21b559a3 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.278161 May 24 15:55:42.206051 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1506/3022] 10.222.0.45 () {60 vars in 1158 bytes} [Tue May 24 15:55:41 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:56:11.905748 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-ca4849ab-a3b5-467d-87a0-2ea2cbb3e61e tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-509293071", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1086846441", "security_groups": [{"name": "tempest-secgroup-smoke-89394891"}], "networks": [{"uuid": "4269e8b7-7cad-474f-a5d8-1c40115cdfa4"}], "block_device_mapping_v2": [{"uuid": "abdd85cd-f39d-46d3-8302-b976721911dc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:56:11.914938 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:56:11.915593 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:56:12.021124 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.network.neutron [None req-ca4849ab-a3b5-467d-87a0-2ea2cbb3e61e tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] validate_networks() for [('4269e8b7-7cad-474f-a5d8-1c40115cdfa4', None, None, None, None, None)] {{(pid=117698) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 15:56:12.495015 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.virt.hardware [None req-ca4849ab-a3b5-467d-87a0-2ea2cbb3e61e tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Flavor limits 0:0:0 {{(pid=117698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 15:56:12.495466 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.virt.hardware [None req-ca4849ab-a3b5-467d-87a0-2ea2cbb3e61e tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Image limits 0:0:0 {{(pid=117698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 15:56:12.495943 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.virt.hardware [None req-ca4849ab-a3b5-467d-87a0-2ea2cbb3e61e tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Flavor pref 0:0:0 {{(pid=117698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 15:56:12.496380 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.virt.hardware [None req-ca4849ab-a3b5-467d-87a0-2ea2cbb3e61e tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Image pref 0:0:0 {{(pid=117698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 15:56:12.496820 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.virt.hardware [None req-ca4849ab-a3b5-467d-87a0-2ea2cbb3e61e tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 15:56:12.505766 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ca4849ab-a3b5-467d-87a0-2ea2cbb3e61e tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:56:12.506212 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ca4849ab-a3b5-467d-87a0-2ea2cbb3e61e tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:56:12.507001 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ca4849ab-a3b5-467d-87a0-2ea2cbb3e61e tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:56:12.507436 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ca4849ab-a3b5-467d-87a0-2ea2cbb3e61e tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:56:12.524258 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.quota [None req-ca4849ab-a3b5-467d-87a0-2ea2cbb3e61e tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Getting quotas for project bc1fbb8218ad4da5a2e2ac6d50bf89e0. Resources: {'instances', 'ram', 'cores'} {{(pid=117698) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 15:56:12.533199 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.quota [None req-ca4849ab-a3b5-467d-87a0-2ea2cbb3e61e tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Getting quotas for user 63d864e3821b4c989b474bd313722f33 and project bc1fbb8218ad4da5a2e2ac6d50bf89e0. Resources: {'instances', 'ram', 'cores'} {{(pid=117698) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 15:56:12.589700 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-ca4849ab-a3b5-467d-87a0-2ea2cbb3e61e tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Going to run 1 instances... {{(pid=117698) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 15:56:12.591760 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-ca4849ab-a3b5-467d-87a0-2ea2cbb3e61e tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] [instance: f3cc6e5e-2474-474f-895e-9e149a85f5ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='abdd85cd-f39d-46d3-8302-b976721911dc',volume_size=None,volume_type=None)] {{(pid=117698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 15:56:12.726205 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-ca4849ab-a3b5-467d-87a0-2ea2cbb3e61e tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.825750 May 24 15:56:12.727009 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1517/3023] 10.222.0.45 () {60 vars in 1146 bytes} [Tue May 24 15:56:11 2022] POST /compute/v2.1/servers => generated 404 bytes in 827 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 15:56:12.734096 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell0:SELECT=4 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:56:12.734841 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:56:12.738733 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-ca260523-c7c4-41f0-8dd0-0ddfa499431d tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:56:12.739354 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-ca260523-c7c4-41f0-8dd0-0ddfa499431d tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] [instance: f3cc6e5e-2474-474f-895e-9e149a85f5ec] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:56:12.801313 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-ca260523-c7c4-41f0-8dd0-0ddfa499431d tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d864e3821b4c989b474bd313722f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1fbb8218ad4da5a2e2ac6d50bf89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:56:12.817312 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-ca260523-c7c4-41f0-8dd0-0ddfa499431d tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] 10.222.0.45 "GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec" status: 200 len: 1088 microversion: 2.1 time: 0.084424 May 24 15:56:12.818397 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1507/3024] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:56:12 2022] GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec => generated 1088 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:56:13.835407 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-a93429db-9fe1-4a84-80ed-b2ae92775804 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:56:13.836012 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-a93429db-9fe1-4a84-80ed-b2ae92775804 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] [instance: f3cc6e5e-2474-474f-895e-9e149a85f5ec] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:56:13.843015 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a93429db-9fe1-4a84-80ed-b2ae92775804 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:56:13.843598 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a93429db-9fe1-4a84-80ed-b2ae92775804 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:56:13.844952 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a93429db-9fe1-4a84-80ed-b2ae92775804 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:56:13.845385 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a93429db-9fe1-4a84-80ed-b2ae92775804 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:56:13.911973 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-a93429db-9fe1-4a84-80ed-b2ae92775804 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d864e3821b4c989b474bd313722f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1fbb8218ad4da5a2e2ac6d50bf89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:56:13.919726 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-a93429db-9fe1-4a84-80ed-b2ae92775804 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] 10.222.0.45 "GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec" status: 200 len: 1186 microversion: 2.1 time: 0.088663 May 24 15:56:13.920487 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1518/3025] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:56:13 2022] GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec => generated 1186 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:56:14.937230 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-fb2eced9-b79c-43ba-a73a-4b6da94e73c2 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:56:14.937855 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-fb2eced9-b79c-43ba-a73a-4b6da94e73c2 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] [instance: f3cc6e5e-2474-474f-895e-9e149a85f5ec] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:56:14.944543 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fb2eced9-b79c-43ba-a73a-4b6da94e73c2 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:56:14.944942 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fb2eced9-b79c-43ba-a73a-4b6da94e73c2 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:56:14.945704 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fb2eced9-b79c-43ba-a73a-4b6da94e73c2 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:56:14.946133 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fb2eced9-b79c-43ba-a73a-4b6da94e73c2 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:56:15.145767 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-fb2eced9-b79c-43ba-a73a-4b6da94e73c2 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d864e3821b4c989b474bd313722f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1fbb8218ad4da5a2e2ac6d50bf89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:56:15.153270 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-fb2eced9-b79c-43ba-a73a-4b6da94e73c2 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] 10.222.0.45 "GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec" status: 200 len: 1270 microversion: 2.1 time: 0.220275 May 24 15:56:15.153836 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1508/3026] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:56:14 2022] GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec => generated 1270 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:56:15.522206 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [req-a5df9ca2-f018-417d-94a7-5f381fcb920d req-24f7fc77-1630-4743-8157-13a79333e499 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3cc6e5e-2474-474f-895e-9e149a85f5ec", "tag": "b80e1095-48e1-461e-8be0-658508ca4b89"}]} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:56:15.534909 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-a5df9ca2-f018-417d-94a7-5f381fcb920d req-24f7fc77-1630-4743-8157-13a79333e499 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:56:15.535560 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-a5df9ca2-f018-417d-94a7-5f381fcb920d req-24f7fc77-1630-4743-8157-13a79333e499 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:56:15.556759 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.compute.server_external_events [req-a5df9ca2-f018-417d-94a7-5f381fcb920d req-24f7fc77-1630-4743-8157-13a79333e499 service nova] Creating event network-changed:b80e1095-48e1-461e-8be0-658508ca4b89 for instance f3cc6e5e-2474-474f-895e-9e149a85f5ec on hv-cinder-84315 May 24 15:56:15.562095 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [req-a5df9ca2-f018-417d-94a7-5f381fcb920d req-24f7fc77-1630-4743-8157-13a79333e499 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046258 May 24 15:56:15.562814 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1519/3027] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:56:16.171628 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-6a5078c2-3af4-4e01-b5ad-8dcbacd10037 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:56:16.172547 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-6a5078c2-3af4-4e01-b5ad-8dcbacd10037 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] [instance: f3cc6e5e-2474-474f-895e-9e149a85f5ec] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:56:16.180004 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6a5078c2-3af4-4e01-b5ad-8dcbacd10037 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:56:16.180681 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6a5078c2-3af4-4e01-b5ad-8dcbacd10037 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:56:16.181752 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6a5078c2-3af4-4e01-b5ad-8dcbacd10037 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:56:16.182395 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6a5078c2-3af4-4e01-b5ad-8dcbacd10037 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:56:16.372275 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-6a5078c2-3af4-4e01-b5ad-8dcbacd10037 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d864e3821b4c989b474bd313722f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1fbb8218ad4da5a2e2ac6d50bf89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:56:16.380552 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-6a5078c2-3af4-4e01-b5ad-8dcbacd10037 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] 10.222.0.45 "GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec" status: 200 len: 1258 microversion: 2.1 time: 0.214017 May 24 15:56:16.381122 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1509/3028] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:56:16 2022] GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec => generated 1258 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:56:17.397645 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c7ca3894-b60a-4d9b-a2a7-8272ec1fdae5 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:56:17.398379 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-c7ca3894-b60a-4d9b-a2a7-8272ec1fdae5 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] [instance: f3cc6e5e-2474-474f-895e-9e149a85f5ec] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:56:17.404872 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c7ca3894-b60a-4d9b-a2a7-8272ec1fdae5 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:56:17.405325 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c7ca3894-b60a-4d9b-a2a7-8272ec1fdae5 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:56:17.406571 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c7ca3894-b60a-4d9b-a2a7-8272ec1fdae5 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:56:17.407012 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c7ca3894-b60a-4d9b-a2a7-8272ec1fdae5 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:56:17.544462 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-c7ca3894-b60a-4d9b-a2a7-8272ec1fdae5 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d864e3821b4c989b474bd313722f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1fbb8218ad4da5a2e2ac6d50bf89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:56:17.552619 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-c7ca3894-b60a-4d9b-a2a7-8272ec1fdae5 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] 10.222.0.45 "GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec" status: 200 len: 1258 microversion: 2.1 time: 0.159525 May 24 15:56:17.553185 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1520/3029] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:56:17 2022] GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec => generated 1258 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:56:18.569312 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-48f04038-01df-4836-b98f-9d758415637b tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:56:18.569928 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-48f04038-01df-4836-b98f-9d758415637b tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] [instance: f3cc6e5e-2474-474f-895e-9e149a85f5ec] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:56:18.576453 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-48f04038-01df-4836-b98f-9d758415637b tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:56:18.576900 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-48f04038-01df-4836-b98f-9d758415637b tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:56:18.577665 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-48f04038-01df-4836-b98f-9d758415637b tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:56:18.578099 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-48f04038-01df-4836-b98f-9d758415637b tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:56:18.704013 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-48f04038-01df-4836-b98f-9d758415637b tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d864e3821b4c989b474bd313722f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1fbb8218ad4da5a2e2ac6d50bf89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:56:18.711446 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-48f04038-01df-4836-b98f-9d758415637b tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] 10.222.0.45 "GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec" status: 200 len: 1258 microversion: 2.1 time: 0.146057 May 24 15:56:18.712008 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1510/3030] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:56:18 2022] GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec => generated 1258 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:56:19.728344 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-bc8dbb0d-8ec5-4e91-be85-74a63c3afc3a tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:56:19.728953 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-bc8dbb0d-8ec5-4e91-be85-74a63c3afc3a tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] [instance: f3cc6e5e-2474-474f-895e-9e149a85f5ec] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:56:19.735919 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bc8dbb0d-8ec5-4e91-be85-74a63c3afc3a tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:56:19.736324 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bc8dbb0d-8ec5-4e91-be85-74a63c3afc3a tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:56:19.737087 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bc8dbb0d-8ec5-4e91-be85-74a63c3afc3a tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:56:19.737525 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bc8dbb0d-8ec5-4e91-be85-74a63c3afc3a tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:56:19.870466 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-bc8dbb0d-8ec5-4e91-be85-74a63c3afc3a tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d864e3821b4c989b474bd313722f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1fbb8218ad4da5a2e2ac6d50bf89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:56:19.878727 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-bc8dbb0d-8ec5-4e91-be85-74a63c3afc3a tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] 10.222.0.45 "GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec" status: 200 len: 1258 microversion: 2.1 time: 0.154176 May 24 15:56:19.879294 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1521/3031] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:56:19 2022] GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:56:20.899892 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-238f4cd5-0970-45c1-a6f9-340baa8b3ffb tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:56:20.900552 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-238f4cd5-0970-45c1-a6f9-340baa8b3ffb tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] [instance: f3cc6e5e-2474-474f-895e-9e149a85f5ec] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:56:20.907099 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-238f4cd5-0970-45c1-a6f9-340baa8b3ffb tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:56:20.907543 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-238f4cd5-0970-45c1-a6f9-340baa8b3ffb tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:56:20.908355 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-238f4cd5-0970-45c1-a6f9-340baa8b3ffb tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:56:20.908792 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-238f4cd5-0970-45c1-a6f9-340baa8b3ffb tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:56:21.037534 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-238f4cd5-0970-45c1-a6f9-340baa8b3ffb tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d864e3821b4c989b474bd313722f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1fbb8218ad4da5a2e2ac6d50bf89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:56:21.044996 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-238f4cd5-0970-45c1-a6f9-340baa8b3ffb tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] 10.222.0.45 "GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec" status: 200 len: 1258 microversion: 2.1 time: 0.148973 May 24 15:56:21.045563 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1511/3032] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:56:20 2022] GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec => generated 1258 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:56:22.061636 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c6fa98f1-91d0-4890-b226-818e01454019 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:56:22.062248 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-c6fa98f1-91d0-4890-b226-818e01454019 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] [instance: f3cc6e5e-2474-474f-895e-9e149a85f5ec] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:56:22.068282 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c6fa98f1-91d0-4890-b226-818e01454019 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:56:22.068748 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c6fa98f1-91d0-4890-b226-818e01454019 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:56:22.069495 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c6fa98f1-91d0-4890-b226-818e01454019 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:56:22.069926 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c6fa98f1-91d0-4890-b226-818e01454019 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:56:22.200447 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-c6fa98f1-91d0-4890-b226-818e01454019 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d864e3821b4c989b474bd313722f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1fbb8218ad4da5a2e2ac6d50bf89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:56:22.208348 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-c6fa98f1-91d0-4890-b226-818e01454019 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] 10.222.0.45 "GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec" status: 200 len: 1258 microversion: 2.1 time: 0.150711 May 24 15:56:22.208904 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1522/3033] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:56:22 2022] GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec => generated 1258 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:56:23.225344 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-8a613841-99cb-42e3-a444-c4eba7a4127b tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:56:23.226044 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-8a613841-99cb-42e3-a444-c4eba7a4127b tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] [instance: f3cc6e5e-2474-474f-895e-9e149a85f5ec] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:56:23.228289 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell0:SELECT=2 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:56:23.234022 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8a613841-99cb-42e3-a444-c4eba7a4127b tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:56:23.234556 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8a613841-99cb-42e3-a444-c4eba7a4127b tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:56:23.235395 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8a613841-99cb-42e3-a444-c4eba7a4127b tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:56:23.236514 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8a613841-99cb-42e3-a444-c4eba7a4127b tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:56:23.366358 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-8a613841-99cb-42e3-a444-c4eba7a4127b tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d864e3821b4c989b474bd313722f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1fbb8218ad4da5a2e2ac6d50bf89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:56:23.374018 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-8a613841-99cb-42e3-a444-c4eba7a4127b tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] 10.222.0.45 "GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec" status: 200 len: 1258 microversion: 2.1 time: 0.152467 May 24 15:56:23.374580 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1512/3034] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:56:23 2022] GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:56:24.390376 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d6c75236-f92e-4934-8460-4b0f4b9d03a8 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:56:24.390912 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d6c75236-f92e-4934-8460-4b0f4b9d03a8 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] [instance: f3cc6e5e-2474-474f-895e-9e149a85f5ec] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:56:24.392896 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell0:SELECT=2 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:56:24.393739 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell0:SELECT=6 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:56:24.400044 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d6c75236-f92e-4934-8460-4b0f4b9d03a8 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:56:24.400511 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d6c75236-f92e-4934-8460-4b0f4b9d03a8 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:56:24.401259 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d6c75236-f92e-4934-8460-4b0f4b9d03a8 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:56:24.401688 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d6c75236-f92e-4934-8460-4b0f4b9d03a8 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:56:24.527477 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-d6c75236-f92e-4934-8460-4b0f4b9d03a8 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d864e3821b4c989b474bd313722f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1fbb8218ad4da5a2e2ac6d50bf89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:56:24.535481 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d6c75236-f92e-4934-8460-4b0f4b9d03a8 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] 10.222.0.45 "GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec" status: 200 len: 1258 microversion: 2.1 time: 0.149020 May 24 15:56:24.536050 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1523/3035] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:56:24 2022] GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec => generated 1258 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:56:25.552079 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-59e131fb-8cc0-4bec-b2ff-e98cae1cd699 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:56:25.552745 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-59e131fb-8cc0-4bec-b2ff-e98cae1cd699 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] [instance: f3cc6e5e-2474-474f-895e-9e149a85f5ec] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:56:25.559353 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-59e131fb-8cc0-4bec-b2ff-e98cae1cd699 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:56:25.559794 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-59e131fb-8cc0-4bec-b2ff-e98cae1cd699 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:56:25.560574 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-59e131fb-8cc0-4bec-b2ff-e98cae1cd699 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:56:25.561005 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-59e131fb-8cc0-4bec-b2ff-e98cae1cd699 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:56:25.694433 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-59e131fb-8cc0-4bec-b2ff-e98cae1cd699 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d864e3821b4c989b474bd313722f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1fbb8218ad4da5a2e2ac6d50bf89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:56:25.701882 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-59e131fb-8cc0-4bec-b2ff-e98cae1cd699 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] 10.222.0.45 "GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec" status: 200 len: 1258 microversion: 2.1 time: 0.154238 May 24 15:56:25.702456 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1513/3036] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:56:25 2022] GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:56:26.719414 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d1316a78-4716-471f-af30-965f9041ca32 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:56:26.720020 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d1316a78-4716-471f-af30-965f9041ca32 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] [instance: f3cc6e5e-2474-474f-895e-9e149a85f5ec] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:56:26.726519 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d1316a78-4716-471f-af30-965f9041ca32 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:56:26.726959 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d1316a78-4716-471f-af30-965f9041ca32 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:56:26.727707 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d1316a78-4716-471f-af30-965f9041ca32 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:56:26.728135 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d1316a78-4716-471f-af30-965f9041ca32 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:56:26.859634 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-d1316a78-4716-471f-af30-965f9041ca32 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d864e3821b4c989b474bd313722f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1fbb8218ad4da5a2e2ac6d50bf89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:56:26.867834 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d1316a78-4716-471f-af30-965f9041ca32 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] 10.222.0.45 "GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec" status: 200 len: 1258 microversion: 2.1 time: 0.152188 May 24 15:56:26.868409 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1524/3037] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:56:26 2022] GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:56:27.884715 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d6becb46-eae6-4c74-895b-c2082566841f tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:56:27.885565 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d6becb46-eae6-4c74-895b-c2082566841f tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] [instance: f3cc6e5e-2474-474f-895e-9e149a85f5ec] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:56:27.892086 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d6becb46-eae6-4c74-895b-c2082566841f tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:56:27.892595 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d6becb46-eae6-4c74-895b-c2082566841f tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:56:27.894056 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d6becb46-eae6-4c74-895b-c2082566841f tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:56:27.894732 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d6becb46-eae6-4c74-895b-c2082566841f tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:56:28.024586 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-d6becb46-eae6-4c74-895b-c2082566841f tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d864e3821b4c989b474bd313722f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1fbb8218ad4da5a2e2ac6d50bf89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:56:28.033036 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d6becb46-eae6-4c74-895b-c2082566841f tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] 10.222.0.45 "GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec" status: 200 len: 1258 microversion: 2.1 time: 0.152337 May 24 15:56:28.033761 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1514/3038] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:56:27 2022] GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:56:29.050614 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-44227cf3-9a89-43ae-81f6-574d72f2c63a tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:56:29.051141 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-44227cf3-9a89-43ae-81f6-574d72f2c63a tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] [instance: f3cc6e5e-2474-474f-895e-9e149a85f5ec] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:56:29.057613 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-44227cf3-9a89-43ae-81f6-574d72f2c63a tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:56:29.058054 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-44227cf3-9a89-43ae-81f6-574d72f2c63a tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:56:29.058797 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-44227cf3-9a89-43ae-81f6-574d72f2c63a tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:56:29.059222 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-44227cf3-9a89-43ae-81f6-574d72f2c63a tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:56:29.188928 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-44227cf3-9a89-43ae-81f6-574d72f2c63a tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d864e3821b4c989b474bd313722f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1fbb8218ad4da5a2e2ac6d50bf89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:56:29.196452 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-44227cf3-9a89-43ae-81f6-574d72f2c63a tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] 10.222.0.45 "GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec" status: 200 len: 1258 microversion: 2.1 time: 0.150347 May 24 15:56:29.197014 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1525/3039] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:56:29 2022] GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec => generated 1258 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:56:30.213626 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-ee17184b-2ba4-4b35-85b2-bc73177b880b tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:56:30.214272 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-ee17184b-2ba4-4b35-85b2-bc73177b880b tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] [instance: f3cc6e5e-2474-474f-895e-9e149a85f5ec] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:56:30.223925 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ee17184b-2ba4-4b35-85b2-bc73177b880b tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:56:30.224419 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ee17184b-2ba4-4b35-85b2-bc73177b880b tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:56:30.225277 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ee17184b-2ba4-4b35-85b2-bc73177b880b tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:56:30.225916 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ee17184b-2ba4-4b35-85b2-bc73177b880b tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:56:30.373546 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-ee17184b-2ba4-4b35-85b2-bc73177b880b tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d864e3821b4c989b474bd313722f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1fbb8218ad4da5a2e2ac6d50bf89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:56:30.382636 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-ee17184b-2ba4-4b35-85b2-bc73177b880b tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] 10.222.0.45 "GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec" status: 200 len: 1258 microversion: 2.1 time: 0.173152 May 24 15:56:30.383273 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1515/3040] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:56:30 2022] GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec => generated 1258 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:56:31.226012 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [req-025cf62f-3195-44b8-b507-d97ac07894a9 req-26024713-5582-4955-bae6-e7a2d45abb50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3cc6e5e-2474-474f-895e-9e149a85f5ec", "name": "network-vif-plugged", "status": "completed", "tag": "b80e1095-48e1-461e-8be0-658508ca4b89"}]} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:56:31.234083 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-025cf62f-3195-44b8-b507-d97ac07894a9 req-26024713-5582-4955-bae6-e7a2d45abb50 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:56:31.234688 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-025cf62f-3195-44b8-b507-d97ac07894a9 req-26024713-5582-4955-bae6-e7a2d45abb50 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:56:31.246364 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.compute.server_external_events [req-025cf62f-3195-44b8-b507-d97ac07894a9 req-26024713-5582-4955-bae6-e7a2d45abb50 service nova] Creating event network-vif-plugged:b80e1095-48e1-461e-8be0-658508ca4b89 for instance f3cc6e5e-2474-474f-895e-9e149a85f5ec on hv-cinder-84315 May 24 15:56:31.251998 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [req-025cf62f-3195-44b8-b507-d97ac07894a9 req-26024713-5582-4955-bae6-e7a2d45abb50 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.270217 May 24 15:56:31.253331 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1526/3041] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:56:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:56:31.403373 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d7169055-3070-4440-9518-0986638a35a0 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:56:31.405201 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d7169055-3070-4440-9518-0986638a35a0 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] [instance: f3cc6e5e-2474-474f-895e-9e149a85f5ec] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:56:31.414779 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d7169055-3070-4440-9518-0986638a35a0 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:56:31.415825 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d7169055-3070-4440-9518-0986638a35a0 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:56:31.417102 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d7169055-3070-4440-9518-0986638a35a0 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:56:31.417905 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d7169055-3070-4440-9518-0986638a35a0 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:56:31.713267 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-d7169055-3070-4440-9518-0986638a35a0 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d864e3821b4c989b474bd313722f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1fbb8218ad4da5a2e2ac6d50bf89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:56:31.720781 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d7169055-3070-4440-9518-0986638a35a0 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] 10.222.0.45 "GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec" status: 200 len: 1258 microversion: 2.1 time: 0.325099 May 24 15:56:31.722244 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1516/3042] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:56:31 2022] GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec => generated 1258 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:56:32.740066 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-088e4b68-e94c-4120-9bdc-aa30bbce234d tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:56:32.741371 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-088e4b68-e94c-4120-9bdc-aa30bbce234d tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] [instance: f3cc6e5e-2474-474f-895e-9e149a85f5ec] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:56:32.749338 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-088e4b68-e94c-4120-9bdc-aa30bbce234d tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:56:32.750115 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-088e4b68-e94c-4120-9bdc-aa30bbce234d tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:56:32.751062 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-088e4b68-e94c-4120-9bdc-aa30bbce234d tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:56:32.751674 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-088e4b68-e94c-4120-9bdc-aa30bbce234d tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:56:32.962474 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-088e4b68-e94c-4120-9bdc-aa30bbce234d tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d864e3821b4c989b474bd313722f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1fbb8218ad4da5a2e2ac6d50bf89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:56:32.970157 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-088e4b68-e94c-4120-9bdc-aa30bbce234d tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] 10.222.0.45 "GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec" status: 200 len: 1258 microversion: 2.1 time: 0.235506 May 24 15:56:32.970730 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1527/3043] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:56:32 2022] GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec => generated 1258 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:56:33.987189 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-27aee0eb-10bd-4d13-b594-6d5483f5f9f2 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:56:33.987791 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-27aee0eb-10bd-4d13-b594-6d5483f5f9f2 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] [instance: f3cc6e5e-2474-474f-895e-9e149a85f5ec] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:56:34.000087 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-27aee0eb-10bd-4d13-b594-6d5483f5f9f2 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:56:34.000570 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-27aee0eb-10bd-4d13-b594-6d5483f5f9f2 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:56:34.001350 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-27aee0eb-10bd-4d13-b594-6d5483f5f9f2 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:56:34.001778 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-27aee0eb-10bd-4d13-b594-6d5483f5f9f2 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:56:34.270639 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-27aee0eb-10bd-4d13-b594-6d5483f5f9f2 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d864e3821b4c989b474bd313722f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1fbb8218ad4da5a2e2ac6d50bf89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:56:34.282604 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-27aee0eb-10bd-4d13-b594-6d5483f5f9f2 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] 10.222.0.45 "GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec" status: 200 len: 1442 microversion: 2.1 time: 0.299754 May 24 15:56:34.283708 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1517/3044] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:56:33 2022] GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec => generated 1442 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:56:34.298929 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-2be05615-2886-428e-a07f-c65ae0e9e0df tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:56:34.300004 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-2be05615-2886-428e-a07f-c65ae0e9e0df tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] [instance: f3cc6e5e-2474-474f-895e-9e149a85f5ec] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:56:34.307745 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2be05615-2886-428e-a07f-c65ae0e9e0df tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:56:34.308572 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2be05615-2886-428e-a07f-c65ae0e9e0df tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:56:34.309461 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2be05615-2886-428e-a07f-c65ae0e9e0df tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:56:34.310074 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2be05615-2886-428e-a07f-c65ae0e9e0df tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:56:34.515972 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-2be05615-2886-428e-a07f-c65ae0e9e0df tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d864e3821b4c989b474bd313722f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1fbb8218ad4da5a2e2ac6d50bf89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:56:34.526000 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-2be05615-2886-428e-a07f-c65ae0e9e0df tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] 10.222.0.45 "GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec" status: 200 len: 1442 microversion: 2.1 time: 0.231045 May 24 15:56:34.528728 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1528/3045] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:56:34 2022] GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec => generated 1442 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:56:36.712683 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [req-b95025bf-1c69-4c8d-add4-87798392e5ef req-f39e761b-d0fb-49df-9c32-e398f7453191 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3cc6e5e-2474-474f-895e-9e149a85f5ec", "tag": "b80e1095-48e1-461e-8be0-658508ca4b89"}]} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:56:36.722308 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-b95025bf-1c69-4c8d-add4-87798392e5ef req-f39e761b-d0fb-49df-9c32-e398f7453191 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:56:36.722791 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-b95025bf-1c69-4c8d-add4-87798392e5ef req-f39e761b-d0fb-49df-9c32-e398f7453191 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:56:36.734505 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.compute.server_external_events [req-b95025bf-1c69-4c8d-add4-87798392e5ef req-f39e761b-d0fb-49df-9c32-e398f7453191 service nova] Creating event network-changed:b80e1095-48e1-461e-8be0-658508ca4b89 for instance f3cc6e5e-2474-474f-895e-9e149a85f5ec on hv-cinder-84315 May 24 15:56:36.741249 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [req-b95025bf-1c69-4c8d-add4-87798392e5ef req-f39e761b-d0fb-49df-9c32-e398f7453191 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032423 May 24 15:56:36.741860 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1518/3046] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:56:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:56:39.213499 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 15:56:39.214096 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Tue May 24 15:56:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 15:56:42.330990 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-cf9ee5ff-688b-493c-96af-32f232a883a8 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Action: 'create', calling method: .version_select at 0x7f2dd24ff280>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-134503995", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSIBaWVJphLcr61PQLariHJbihdLTzbnX0fr10rw3oUlH85JIe9eNYHHXpy4cFfmlpZ78YRvhTeA1i4caOGMP4EFPKVQzHLbQ2fEOJtVRHcazJGfFTBhCjH8BkgBY/WAA=="}} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:56:42.335143 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:56:42.347778 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.quota [None req-cf9ee5ff-688b-493c-96af-32f232a883a8 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Getting quotas for project f5b185a216134b4d828add9ebdcf89d2. Resources: {'key_pairs'} {{(pid=117698) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 15:56:42.352610 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.quota [None req-cf9ee5ff-688b-493c-96af-32f232a883a8 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Getting quotas for user 44b73e975868496fb800c68e2d007faa and project f5b185a216134b4d828add9ebdcf89d2. Resources: {'key_pairs'} {{(pid=117698) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 15:56:42.365409 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cf9ee5ff-688b-493c-96af-32f232a883a8 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [5aebd939-39d2-4eea-9422-761c2eb5df8c] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 24 15:56:43.374407 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO oslo.messaging._drivers.impl_rabbit [None req-cf9ee5ff-688b-493c-96af-32f232a883a8 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [5aebd939-39d2-4eea-9422-761c2eb5df8c] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 58088. May 24 15:56:43.397682 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-cf9ee5ff-688b-493c-96af-32f232a883a8 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 1.269668 May 24 15:56:43.397800 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1529/3047] 10.222.0.45 () {60 vars in 1158 bytes} [Tue May 24 15:56:42 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:57:09.468651 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-f2478ad1-3abb-42b6-947a-fa79e0875ad1 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-720308008", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-134503995", "security_groups": [{"name": "tempest-secgroup-smoke-233826205"}], "block_device_mapping_v2": [{"uuid": "12ed1946-1538-4e5a-9c2d-262b7a4db650", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "37f84cbf-d4c2-49c4-ac9f-54724991334c"}]}} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:57:09.477192 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_api:SELECT=26 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:57:09.477832 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=62 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:57:09.583173 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.network.neutron [None req-f2478ad1-3abb-42b6-947a-fa79e0875ad1 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] validate_networks() for [('37f84cbf-d4c2-49c4-ac9f-54724991334c', None, None, None, None, None)] {{(pid=117699) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 15:57:10.060415 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.virt.hardware [None req-f2478ad1-3abb-42b6-947a-fa79e0875ad1 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Flavor limits 0:0:0 {{(pid=117699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 15:57:10.060839 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.virt.hardware [None req-f2478ad1-3abb-42b6-947a-fa79e0875ad1 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Image limits 0:0:0 {{(pid=117699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 15:57:10.061312 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.virt.hardware [None req-f2478ad1-3abb-42b6-947a-fa79e0875ad1 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Flavor pref 0:0:0 {{(pid=117699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 15:57:10.061724 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.virt.hardware [None req-f2478ad1-3abb-42b6-947a-fa79e0875ad1 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Image pref 0:0:0 {{(pid=117699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 15:57:10.062132 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.virt.hardware [None req-f2478ad1-3abb-42b6-947a-fa79e0875ad1 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 15:57:10.072510 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f2478ad1-3abb-42b6-947a-fa79e0875ad1 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:57:10.078140 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f2478ad1-3abb-42b6-947a-fa79e0875ad1 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:57:10.079701 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f2478ad1-3abb-42b6-947a-fa79e0875ad1 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:57:10.080146 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-f2478ad1-3abb-42b6-947a-fa79e0875ad1 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:57:10.102907 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.quota [None req-f2478ad1-3abb-42b6-947a-fa79e0875ad1 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Getting quotas for project f5b185a216134b4d828add9ebdcf89d2. Resources: {'instances', 'ram', 'cores'} {{(pid=117699) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 15:57:10.106818 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.quota [None req-f2478ad1-3abb-42b6-947a-fa79e0875ad1 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Getting quotas for user 44b73e975868496fb800c68e2d007faa and project f5b185a216134b4d828add9ebdcf89d2. Resources: {'instances', 'ram', 'cores'} {{(pid=117699) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 15:57:10.164231 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f2478ad1-3abb-42b6-947a-fa79e0875ad1 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Going to run 1 instances... {{(pid=117699) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 15:57:10.166532 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-f2478ad1-3abb-42b6-947a-fa79e0875ad1 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 449da4bb-d801-4e7d-b677-d375b68062a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='12ed1946-1538-4e5a-9c2d-262b7a4db650',volume_size=None,volume_type=None)] {{(pid=117699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 15:57:10.290523 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-f2478ad1-3abb-42b6-947a-fa79e0875ad1 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.826094 May 24 15:57:10.291160 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1519/3048] 10.222.0.45 () {60 vars in 1146 bytes} [Tue May 24 15:57:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 828 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 15:57:10.301894 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-66e69146-2326-4be8-8d53-ccfa206534d6 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:57:10.302509 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-66e69146-2326-4be8-8d53-ccfa206534d6 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 449da4bb-d801-4e7d-b677-d375b68062a6] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:57:10.305104 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=60 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:57:10.305825 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell0:SELECT=4 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:57:10.306650 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_api:SELECT=10,nova_api:INSERT=1 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:57:10.360163 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-66e69146-2326-4be8-8d53-ccfa206534d6 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:57:10.367527 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-66e69146-2326-4be8-8d53-ccfa206534d6 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/449da4bb-d801-4e7d-b677-d375b68062a6" status: 200 len: 1093 microversion: 2.1 time: 0.070080 May 24 15:57:10.368391 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1530/3049] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:57:10 2022] GET /compute/v2.1/servers/449da4bb-d801-4e7d-b677-d375b68062a6 => generated 1093 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:57:11.385669 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-64e4771e-7b5c-41cd-bac3-62fbfe70ef00 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:57:11.386218 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-64e4771e-7b5c-41cd-bac3-62fbfe70ef00 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 449da4bb-d801-4e7d-b677-d375b68062a6] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:57:11.392949 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-64e4771e-7b5c-41cd-bac3-62fbfe70ef00 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:57:11.393404 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-64e4771e-7b5c-41cd-bac3-62fbfe70ef00 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:57:11.394190 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-64e4771e-7b5c-41cd-bac3-62fbfe70ef00 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:57:11.394643 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-64e4771e-7b5c-41cd-bac3-62fbfe70ef00 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:57:11.459283 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-64e4771e-7b5c-41cd-bac3-62fbfe70ef00 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:57:11.466648 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-64e4771e-7b5c-41cd-bac3-62fbfe70ef00 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/449da4bb-d801-4e7d-b677-d375b68062a6" status: 200 len: 1143 microversion: 2.1 time: 0.085434 May 24 15:57:11.467204 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1520/3050] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:57:11 2022] GET /compute/v2.1/servers/449da4bb-d801-4e7d-b677-d375b68062a6 => generated 1143 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:57:12.483116 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-88a70d8b-9535-4356-9041-869060d6b836 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:57:12.483730 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-88a70d8b-9535-4356-9041-869060d6b836 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 449da4bb-d801-4e7d-b677-d375b68062a6] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:57:12.490288 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-88a70d8b-9535-4356-9041-869060d6b836 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:57:12.490729 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-88a70d8b-9535-4356-9041-869060d6b836 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:57:12.491477 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-88a70d8b-9535-4356-9041-869060d6b836 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:57:12.491908 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-88a70d8b-9535-4356-9041-869060d6b836 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:57:12.554144 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-88a70d8b-9535-4356-9041-869060d6b836 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:57:12.561479 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-88a70d8b-9535-4356-9041-869060d6b836 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/449da4bb-d801-4e7d-b677-d375b68062a6" status: 200 len: 1143 microversion: 2.1 time: 0.082218 May 24 15:57:12.562033 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1531/3051] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:57:12 2022] GET /compute/v2.1/servers/449da4bb-d801-4e7d-b677-d375b68062a6 => generated 1143 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:57:13.578431 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-1e4eff93-e0e0-4aa2-9338-5bce3a62cc5b tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:57:13.579044 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-1e4eff93-e0e0-4aa2-9338-5bce3a62cc5b tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 449da4bb-d801-4e7d-b677-d375b68062a6] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:57:13.586331 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1e4eff93-e0e0-4aa2-9338-5bce3a62cc5b tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:57:13.586781 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1e4eff93-e0e0-4aa2-9338-5bce3a62cc5b tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:57:13.587562 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1e4eff93-e0e0-4aa2-9338-5bce3a62cc5b tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:57:13.588095 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1e4eff93-e0e0-4aa2-9338-5bce3a62cc5b tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:57:13.656688 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-1e4eff93-e0e0-4aa2-9338-5bce3a62cc5b tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:57:13.665267 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-1e4eff93-e0e0-4aa2-9338-5bce3a62cc5b tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/449da4bb-d801-4e7d-b677-d375b68062a6" status: 200 len: 1191 microversion: 2.1 time: 0.090641 May 24 15:57:13.665833 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1521/3052] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:57:13 2022] GET /compute/v2.1/servers/449da4bb-d801-4e7d-b677-d375b68062a6 => generated 1191 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:57:14.682471 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c77bf441-7e4a-49b7-8564-4214e770ca09 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:57:14.683047 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-c77bf441-7e4a-49b7-8564-4214e770ca09 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 449da4bb-d801-4e7d-b677-d375b68062a6] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:57:14.689964 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c77bf441-7e4a-49b7-8564-4214e770ca09 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:57:14.690408 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c77bf441-7e4a-49b7-8564-4214e770ca09 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:57:14.691827 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c77bf441-7e4a-49b7-8564-4214e770ca09 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:57:14.692259 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c77bf441-7e4a-49b7-8564-4214e770ca09 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:57:14.836680 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-c77bf441-7e4a-49b7-8564-4214e770ca09 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:57:14.844481 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-c77bf441-7e4a-49b7-8564-4214e770ca09 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/449da4bb-d801-4e7d-b677-d375b68062a6" status: 200 len: 1276 microversion: 2.1 time: 0.165800 May 24 15:57:14.845138 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1532/3053] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:57:14 2022] GET /compute/v2.1/servers/449da4bb-d801-4e7d-b677-d375b68062a6 => generated 1276 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:57:15.384388 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [req-f5c59318-d3db-46ac-af96-c1c822738070 req-089e1e41-bc75-4384-9e97-f3472dfd8561 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "449da4bb-d801-4e7d-b677-d375b68062a6", "tag": "6dd9e8d8-c7fb-4ea4-8cdf-d8a25cd9803b"}]} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:57:15.398063 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-f5c59318-d3db-46ac-af96-c1c822738070 req-089e1e41-bc75-4384-9e97-f3472dfd8561 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:57:15.398723 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-f5c59318-d3db-46ac-af96-c1c822738070 req-089e1e41-bc75-4384-9e97-f3472dfd8561 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:57:15.420088 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.compute.server_external_events [req-f5c59318-d3db-46ac-af96-c1c822738070 req-089e1e41-bc75-4384-9e97-f3472dfd8561 service nova] Creating event network-changed:6dd9e8d8-c7fb-4ea4-8cdf-d8a25cd9803b for instance 449da4bb-d801-4e7d-b677-d375b68062a6 on hv-cinder-84315 May 24 15:57:15.425779 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [req-f5c59318-d3db-46ac-af96-c1c822738070 req-089e1e41-bc75-4384-9e97-f3472dfd8561 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046619 May 24 15:57:15.426564 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1522/3054] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:57:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:57:15.861557 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-78b1971e-df36-4368-856d-e0afb5752172 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:57:15.862168 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-78b1971e-df36-4368-856d-e0afb5752172 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 449da4bb-d801-4e7d-b677-d375b68062a6] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:57:15.869521 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-78b1971e-df36-4368-856d-e0afb5752172 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:57:15.869966 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-78b1971e-df36-4368-856d-e0afb5752172 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:57:15.870812 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-78b1971e-df36-4368-856d-e0afb5752172 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:57:15.871251 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-78b1971e-df36-4368-856d-e0afb5752172 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:57:15.996180 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-78b1971e-df36-4368-856d-e0afb5752172 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:57:16.004252 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-78b1971e-df36-4368-856d-e0afb5752172 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/449da4bb-d801-4e7d-b677-d375b68062a6" status: 200 len: 1264 microversion: 2.1 time: 0.145892 May 24 15:57:16.004792 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1533/3055] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:57:15 2022] GET /compute/v2.1/servers/449da4bb-d801-4e7d-b677-d375b68062a6 => generated 1264 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:57:17.022715 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-b5977638-453b-498a-882c-b89e704626b1 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:57:17.023417 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-b5977638-453b-498a-882c-b89e704626b1 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 449da4bb-d801-4e7d-b677-d375b68062a6] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:57:17.029633 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b5977638-453b-498a-882c-b89e704626b1 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:57:17.030089 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b5977638-453b-498a-882c-b89e704626b1 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:57:17.030850 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b5977638-453b-498a-882c-b89e704626b1 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:57:17.031287 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b5977638-453b-498a-882c-b89e704626b1 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:57:17.161531 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-b5977638-453b-498a-882c-b89e704626b1 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:57:17.168970 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-b5977638-453b-498a-882c-b89e704626b1 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/449da4bb-d801-4e7d-b677-d375b68062a6" status: 200 len: 1264 microversion: 2.1 time: 0.151710 May 24 15:57:17.169532 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1523/3056] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:57:17 2022] GET /compute/v2.1/servers/449da4bb-d801-4e7d-b677-d375b68062a6 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:57:18.185522 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-9fe13c6e-94d9-422c-9ed6-eafff889a33e tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:57:18.186159 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-9fe13c6e-94d9-422c-9ed6-eafff889a33e tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 449da4bb-d801-4e7d-b677-d375b68062a6] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:57:18.192875 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9fe13c6e-94d9-422c-9ed6-eafff889a33e tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:57:18.193596 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9fe13c6e-94d9-422c-9ed6-eafff889a33e tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:57:18.194387 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9fe13c6e-94d9-422c-9ed6-eafff889a33e tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:57:18.194818 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9fe13c6e-94d9-422c-9ed6-eafff889a33e tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:57:18.324330 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-9fe13c6e-94d9-422c-9ed6-eafff889a33e tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:57:18.332227 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-9fe13c6e-94d9-422c-9ed6-eafff889a33e tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/449da4bb-d801-4e7d-b677-d375b68062a6" status: 200 len: 1264 microversion: 2.1 time: 0.150065 May 24 15:57:18.332813 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1534/3057] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:57:18 2022] GET /compute/v2.1/servers/449da4bb-d801-4e7d-b677-d375b68062a6 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:57:19.349236 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e7af08b2-67ad-40c0-88a7-b07209661d42 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:57:19.349844 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-e7af08b2-67ad-40c0-88a7-b07209661d42 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 449da4bb-d801-4e7d-b677-d375b68062a6] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:57:19.356205 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e7af08b2-67ad-40c0-88a7-b07209661d42 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:57:19.356677 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e7af08b2-67ad-40c0-88a7-b07209661d42 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:57:19.357424 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e7af08b2-67ad-40c0-88a7-b07209661d42 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:57:19.357855 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e7af08b2-67ad-40c0-88a7-b07209661d42 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:57:19.487250 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-e7af08b2-67ad-40c0-88a7-b07209661d42 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:57:19.495584 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-e7af08b2-67ad-40c0-88a7-b07209661d42 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/449da4bb-d801-4e7d-b677-d375b68062a6" status: 200 len: 1264 microversion: 2.1 time: 0.150772 May 24 15:57:19.496152 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1524/3058] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:57:19 2022] GET /compute/v2.1/servers/449da4bb-d801-4e7d-b677-d375b68062a6 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:57:20.511370 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-84b646c1-56f4-4ab9-b850-84327c78893c tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:57:20.511985 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-84b646c1-56f4-4ab9-b850-84327c78893c tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 449da4bb-d801-4e7d-b677-d375b68062a6] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:57:20.514448 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell0:SELECT=2 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:57:20.519843 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-84b646c1-56f4-4ab9-b850-84327c78893c tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:57:20.520810 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-84b646c1-56f4-4ab9-b850-84327c78893c tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:57:20.521565 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-84b646c1-56f4-4ab9-b850-84327c78893c tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:57:20.522002 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-84b646c1-56f4-4ab9-b850-84327c78893c tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:57:20.652623 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-84b646c1-56f4-4ab9-b850-84327c78893c tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:57:20.660006 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-84b646c1-56f4-4ab9-b850-84327c78893c tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/449da4bb-d801-4e7d-b677-d375b68062a6" status: 200 len: 1264 microversion: 2.1 time: 0.152440 May 24 15:57:20.660596 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1535/3059] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:57:20 2022] GET /compute/v2.1/servers/449da4bb-d801-4e7d-b677-d375b68062a6 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:57:21.677260 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-e9f591a7-44fd-4315-9686-e3a7442123eb tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:57:21.677870 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-e9f591a7-44fd-4315-9686-e3a7442123eb tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 449da4bb-d801-4e7d-b677-d375b68062a6] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:57:21.679849 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell0:SELECT=2 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:57:21.680520 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell0:SELECT=6 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:57:21.686774 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e9f591a7-44fd-4315-9686-e3a7442123eb tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:57:21.687216 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e9f591a7-44fd-4315-9686-e3a7442123eb tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:57:21.687999 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e9f591a7-44fd-4315-9686-e3a7442123eb tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:57:21.688467 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-e9f591a7-44fd-4315-9686-e3a7442123eb tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:57:21.819779 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-e9f591a7-44fd-4315-9686-e3a7442123eb tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:57:21.827265 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-e9f591a7-44fd-4315-9686-e3a7442123eb tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/449da4bb-d801-4e7d-b677-d375b68062a6" status: 200 len: 1264 microversion: 2.1 time: 0.153866 May 24 15:57:21.827821 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1525/3060] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:57:21 2022] GET /compute/v2.1/servers/449da4bb-d801-4e7d-b677-d375b68062a6 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:57:22.842873 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-a60fc925-8458-4ae2-befe-50ed63990507 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:57:22.843483 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-a60fc925-8458-4ae2-befe-50ed63990507 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 449da4bb-d801-4e7d-b677-d375b68062a6] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:57:22.850282 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a60fc925-8458-4ae2-befe-50ed63990507 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:57:22.850732 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a60fc925-8458-4ae2-befe-50ed63990507 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:57:22.851483 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a60fc925-8458-4ae2-befe-50ed63990507 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:57:22.851915 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a60fc925-8458-4ae2-befe-50ed63990507 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:57:22.980495 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-a60fc925-8458-4ae2-befe-50ed63990507 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:57:22.987855 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-a60fc925-8458-4ae2-befe-50ed63990507 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/449da4bb-d801-4e7d-b677-d375b68062a6" status: 200 len: 1264 microversion: 2.1 time: 0.148887 May 24 15:57:22.988444 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1536/3061] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:57:22 2022] GET /compute/v2.1/servers/449da4bb-d801-4e7d-b677-d375b68062a6 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:57:24.004762 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-322ab914-8dcd-4a23-950f-bfa021b49d8d tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:57:24.005486 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-322ab914-8dcd-4a23-950f-bfa021b49d8d tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 449da4bb-d801-4e7d-b677-d375b68062a6] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:57:24.013971 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-322ab914-8dcd-4a23-950f-bfa021b49d8d tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:57:24.014797 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-322ab914-8dcd-4a23-950f-bfa021b49d8d tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:57:24.015747 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-322ab914-8dcd-4a23-950f-bfa021b49d8d tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:57:24.016592 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-322ab914-8dcd-4a23-950f-bfa021b49d8d tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:57:24.152951 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-322ab914-8dcd-4a23-950f-bfa021b49d8d tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:57:24.161341 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-322ab914-8dcd-4a23-950f-bfa021b49d8d tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/449da4bb-d801-4e7d-b677-d375b68062a6" status: 200 len: 1264 microversion: 2.1 time: 0.159778 May 24 15:57:24.170791 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1526/3062] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:57:23 2022] GET /compute/v2.1/servers/449da4bb-d801-4e7d-b677-d375b68062a6 => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:57:25.178400 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-a32e8e66-9a34-4e1e-ad85-998d3233d4d1 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:57:25.179012 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-a32e8e66-9a34-4e1e-ad85-998d3233d4d1 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 449da4bb-d801-4e7d-b677-d375b68062a6] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:57:25.185495 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a32e8e66-9a34-4e1e-ad85-998d3233d4d1 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:57:25.185945 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a32e8e66-9a34-4e1e-ad85-998d3233d4d1 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:57:25.186706 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a32e8e66-9a34-4e1e-ad85-998d3233d4d1 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:57:25.187139 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-a32e8e66-9a34-4e1e-ad85-998d3233d4d1 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:57:25.323351 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-a32e8e66-9a34-4e1e-ad85-998d3233d4d1 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:57:25.330766 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-a32e8e66-9a34-4e1e-ad85-998d3233d4d1 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/449da4bb-d801-4e7d-b677-d375b68062a6" status: 200 len: 1264 microversion: 2.1 time: 0.156362 May 24 15:57:25.331320 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1537/3063] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:57:25 2022] GET /compute/v2.1/servers/449da4bb-d801-4e7d-b677-d375b68062a6 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:57:26.347997 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-8b4a1886-b7bb-46fe-8fba-52ad2d169be8 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:57:26.348641 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-8b4a1886-b7bb-46fe-8fba-52ad2d169be8 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 449da4bb-d801-4e7d-b677-d375b68062a6] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:57:26.355459 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8b4a1886-b7bb-46fe-8fba-52ad2d169be8 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:57:26.355907 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8b4a1886-b7bb-46fe-8fba-52ad2d169be8 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:57:26.356728 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8b4a1886-b7bb-46fe-8fba-52ad2d169be8 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:57:26.357167 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8b4a1886-b7bb-46fe-8fba-52ad2d169be8 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:57:26.486323 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-8b4a1886-b7bb-46fe-8fba-52ad2d169be8 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:57:26.494603 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-8b4a1886-b7bb-46fe-8fba-52ad2d169be8 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/449da4bb-d801-4e7d-b677-d375b68062a6" status: 200 len: 1264 microversion: 2.1 time: 0.150443 May 24 15:57:26.495117 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1527/3064] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:57:26 2022] GET /compute/v2.1/servers/449da4bb-d801-4e7d-b677-d375b68062a6 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:57:27.511297 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e36cf3be-16f7-4a62-83a8-85d3cb714e21 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:57:27.512559 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e36cf3be-16f7-4a62-83a8-85d3cb714e21 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 449da4bb-d801-4e7d-b677-d375b68062a6] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:57:27.518982 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e36cf3be-16f7-4a62-83a8-85d3cb714e21 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:57:27.519601 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e36cf3be-16f7-4a62-83a8-85d3cb714e21 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:57:27.520995 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e36cf3be-16f7-4a62-83a8-85d3cb714e21 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:57:27.521753 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e36cf3be-16f7-4a62-83a8-85d3cb714e21 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:57:27.679615 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e36cf3be-16f7-4a62-83a8-85d3cb714e21 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:57:27.687277 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e36cf3be-16f7-4a62-83a8-85d3cb714e21 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/449da4bb-d801-4e7d-b677-d375b68062a6" status: 200 len: 1264 microversion: 2.1 time: 0.179662 May 24 15:57:27.687843 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1538/3065] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:57:27 2022] GET /compute/v2.1/servers/449da4bb-d801-4e7d-b677-d375b68062a6 => generated 1264 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:57:28.703619 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-c6c1bb99-d415-488f-8647-357d3c97cdf1 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:57:28.704398 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-c6c1bb99-d415-488f-8647-357d3c97cdf1 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 449da4bb-d801-4e7d-b677-d375b68062a6] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:57:28.711779 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c6c1bb99-d415-488f-8647-357d3c97cdf1 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:57:28.712331 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c6c1bb99-d415-488f-8647-357d3c97cdf1 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:57:28.713175 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c6c1bb99-d415-488f-8647-357d3c97cdf1 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:57:28.713680 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c6c1bb99-d415-488f-8647-357d3c97cdf1 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:57:28.851251 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-c6c1bb99-d415-488f-8647-357d3c97cdf1 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:57:28.859237 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-c6c1bb99-d415-488f-8647-357d3c97cdf1 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/449da4bb-d801-4e7d-b677-d375b68062a6" status: 200 len: 1264 microversion: 2.1 time: 0.159451 May 24 15:57:28.859789 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1528/3066] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:57:28 2022] GET /compute/v2.1/servers/449da4bb-d801-4e7d-b677-d375b68062a6 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:57:29.419454 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [req-f211ba97-61cf-405f-9cdc-dbde3841b85f req-3b00644f-bc5f-401d-a907-92606365f0eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "449da4bb-d801-4e7d-b677-d375b68062a6", "name": "network-vif-plugged", "status": "completed", "tag": "6dd9e8d8-c7fb-4ea4-8cdf-d8a25cd9803b"}]} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:57:29.429214 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-f211ba97-61cf-405f-9cdc-dbde3841b85f req-3b00644f-bc5f-401d-a907-92606365f0eb service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:57:29.429899 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-f211ba97-61cf-405f-9cdc-dbde3841b85f req-3b00644f-bc5f-401d-a907-92606365f0eb service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:57:29.441703 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.compute.server_external_events [req-f211ba97-61cf-405f-9cdc-dbde3841b85f req-3b00644f-bc5f-401d-a907-92606365f0eb service nova] Creating event network-vif-plugged:6dd9e8d8-c7fb-4ea4-8cdf-d8a25cd9803b for instance 449da4bb-d801-4e7d-b677-d375b68062a6 on hv-cinder-84315 May 24 15:57:29.447536 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [req-f211ba97-61cf-405f-9cdc-dbde3841b85f req-3b00644f-bc5f-401d-a907-92606365f0eb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031755 May 24 15:57:29.448121 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1539/3067] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:57:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:57:29.875744 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-953ae5e9-1467-4e1e-bef7-4c42bdeaff34 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:57:29.876451 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-953ae5e9-1467-4e1e-bef7-4c42bdeaff34 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 449da4bb-d801-4e7d-b677-d375b68062a6] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:57:29.883126 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-953ae5e9-1467-4e1e-bef7-4c42bdeaff34 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:57:29.883578 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-953ae5e9-1467-4e1e-bef7-4c42bdeaff34 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:57:29.884372 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-953ae5e9-1467-4e1e-bef7-4c42bdeaff34 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:57:29.884817 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-953ae5e9-1467-4e1e-bef7-4c42bdeaff34 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:57:30.025984 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-953ae5e9-1467-4e1e-bef7-4c42bdeaff34 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:57:30.034041 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-953ae5e9-1467-4e1e-bef7-4c42bdeaff34 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/449da4bb-d801-4e7d-b677-d375b68062a6" status: 200 len: 1264 microversion: 2.1 time: 0.162088 May 24 15:57:30.034629 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1529/3068] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:57:29 2022] GET /compute/v2.1/servers/449da4bb-d801-4e7d-b677-d375b68062a6 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:57:31.052666 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-bb8e726b-4e2d-4cf2-8756-c9b675686576 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:57:31.053877 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-bb8e726b-4e2d-4cf2-8756-c9b675686576 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 449da4bb-d801-4e7d-b677-d375b68062a6] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:57:31.061067 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bb8e726b-4e2d-4cf2-8756-c9b675686576 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:57:31.061529 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bb8e726b-4e2d-4cf2-8756-c9b675686576 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:57:31.062362 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bb8e726b-4e2d-4cf2-8756-c9b675686576 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:57:31.062881 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bb8e726b-4e2d-4cf2-8756-c9b675686576 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:57:31.205427 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-bb8e726b-4e2d-4cf2-8756-c9b675686576 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:57:31.213141 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-bb8e726b-4e2d-4cf2-8756-c9b675686576 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/449da4bb-d801-4e7d-b677-d375b68062a6" status: 200 len: 1264 microversion: 2.1 time: 0.165873 May 24 15:57:31.213787 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1540/3069] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:57:31 2022] GET /compute/v2.1/servers/449da4bb-d801-4e7d-b677-d375b68062a6 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:57:32.229410 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-140d383b-486e-4889-865b-a2fb1140f0ba tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:57:32.240155 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-140d383b-486e-4889-865b-a2fb1140f0ba tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 449da4bb-d801-4e7d-b677-d375b68062a6] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:57:32.247918 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-140d383b-486e-4889-865b-a2fb1140f0ba tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:57:32.248471 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-140d383b-486e-4889-865b-a2fb1140f0ba tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:57:32.249260 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-140d383b-486e-4889-865b-a2fb1140f0ba tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:57:32.249874 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-140d383b-486e-4889-865b-a2fb1140f0ba tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:57:32.395934 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-140d383b-486e-4889-865b-a2fb1140f0ba tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:57:32.403453 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-140d383b-486e-4889-865b-a2fb1140f0ba tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/449da4bb-d801-4e7d-b677-d375b68062a6" status: 200 len: 1451 microversion: 2.1 time: 0.178040 May 24 15:57:32.404188 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1530/3070] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:57:32 2022] GET /compute/v2.1/servers/449da4bb-d801-4e7d-b677-d375b68062a6 => generated 1451 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:57:32.419246 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c620554b-0634-445d-88e3-abc183c93e53 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:57:32.419867 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-c620554b-0634-445d-88e3-abc183c93e53 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 449da4bb-d801-4e7d-b677-d375b68062a6] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:57:32.427330 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c620554b-0634-445d-88e3-abc183c93e53 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:57:32.427462 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c620554b-0634-445d-88e3-abc183c93e53 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:57:32.428195 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c620554b-0634-445d-88e3-abc183c93e53 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:57:32.428652 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c620554b-0634-445d-88e3-abc183c93e53 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:57:32.875972 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-c620554b-0634-445d-88e3-abc183c93e53 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:57:32.889683 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-c620554b-0634-445d-88e3-abc183c93e53 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/449da4bb-d801-4e7d-b677-d375b68062a6" status: 200 len: 1451 microversion: 2.1 time: 0.474147 May 24 15:57:32.890534 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1541/3071] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:57:32 2022] GET /compute/v2.1/servers/449da4bb-d801-4e7d-b677-d375b68062a6 => generated 1451 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:57:34.715323 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [req-b3dd37ec-5677-477e-bea2-4465f20cc9a0 req-ca3f5440-0517-49ad-93fb-7ce94dbb8fc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "449da4bb-d801-4e7d-b677-d375b68062a6", "tag": "6dd9e8d8-c7fb-4ea4-8cdf-d8a25cd9803b"}]} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:57:34.724283 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-b3dd37ec-5677-477e-bea2-4465f20cc9a0 req-ca3f5440-0517-49ad-93fb-7ce94dbb8fc4 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:57:34.724858 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-b3dd37ec-5677-477e-bea2-4465f20cc9a0 req-ca3f5440-0517-49ad-93fb-7ce94dbb8fc4 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:57:34.735613 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.compute.server_external_events [req-b3dd37ec-5677-477e-bea2-4465f20cc9a0 req-ca3f5440-0517-49ad-93fb-7ce94dbb8fc4 service nova] Creating event network-changed:6dd9e8d8-c7fb-4ea4-8cdf-d8a25cd9803b for instance 449da4bb-d801-4e7d-b677-d375b68062a6 on hv-cinder-84315 May 24 15:57:34.740701 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [req-b3dd37ec-5677-477e-bea2-4465f20cc9a0 req-ca3f5440-0517-49ad-93fb-7ce94dbb8fc4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028935 May 24 15:57:34.741286 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1531/3072] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:58:36.228462 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 15:58:36.229134 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Tue May 24 15:58:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 15:58:53.657909 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_api:SELECT=26 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:58:53.658641 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=62 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:58:53.662913 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-9b02acfd-31f5-4555-8510-f4f5435d240b tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:58:53.663439 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-9b02acfd-31f5-4555-8510-f4f5435d240b tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] [instance: f3cc6e5e-2474-474f-895e-9e149a85f5ec] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:58:53.670068 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9b02acfd-31f5-4555-8510-f4f5435d240b tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:58:53.670508 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9b02acfd-31f5-4555-8510-f4f5435d240b tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:58:53.671252 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9b02acfd-31f5-4555-8510-f4f5435d240b tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:58:53.671715 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-9b02acfd-31f5-4555-8510-f4f5435d240b tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:58:53.693664 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.objects.instance [None req-9b02acfd-31f5-4555-8510-f4f5435d240b tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lazy-loading 'flavor' on Instance uuid f3cc6e5e-2474-474f-895e-9e149a85f5ec {{(pid=117698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 15:58:53.762611 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-9b02acfd-31f5-4555-8510-f4f5435d240b tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] 10.222.0.45 "POST /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec/action" status: 202 len: 0 microversion: 2.1 time: 0.106463 May 24 15:58:53.763153 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1542/3073] 10.222.0.45 () {60 vars in 1277 bytes} [Tue May 24 15:58:53 2022] POST /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 15:58:53.771007 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:58:53.772001 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=66 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:58:53.777108 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-6058c547-4a0c-40d8-b91f-69edcba27ed1 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:58:53.777820 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-6058c547-4a0c-40d8-b91f-69edcba27ed1 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] [instance: f3cc6e5e-2474-474f-895e-9e149a85f5ec] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:58:53.787547 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6058c547-4a0c-40d8-b91f-69edcba27ed1 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:58:53.788015 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6058c547-4a0c-40d8-b91f-69edcba27ed1 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:58:53.788806 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6058c547-4a0c-40d8-b91f-69edcba27ed1 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:58:53.789240 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-6058c547-4a0c-40d8-b91f-69edcba27ed1 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:58:53.918743 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-6058c547-4a0c-40d8-b91f-69edcba27ed1 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d864e3821b4c989b474bd313722f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1fbb8218ad4da5a2e2ac6d50bf89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:58:53.926180 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-6058c547-4a0c-40d8-b91f-69edcba27ed1 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] 10.222.0.45 "GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec" status: 200 len: 1567 microversion: 2.1 time: 0.158632 May 24 15:58:53.926732 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1532/3074] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:58:53 2022] GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:58:54.944555 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-f09ed98c-fcf8-4273-a5f2-43ed4d013b28 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:58:54.945243 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-f09ed98c-fcf8-4273-a5f2-43ed4d013b28 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] [instance: f3cc6e5e-2474-474f-895e-9e149a85f5ec] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:58:54.951413 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f09ed98c-fcf8-4273-a5f2-43ed4d013b28 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:58:54.951856 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f09ed98c-fcf8-4273-a5f2-43ed4d013b28 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:58:54.952630 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f09ed98c-fcf8-4273-a5f2-43ed4d013b28 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:58:54.953060 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f09ed98c-fcf8-4273-a5f2-43ed4d013b28 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:58:55.084650 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-f09ed98c-fcf8-4273-a5f2-43ed4d013b28 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d864e3821b4c989b474bd313722f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1fbb8218ad4da5a2e2ac6d50bf89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:58:55.092239 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-f09ed98c-fcf8-4273-a5f2-43ed4d013b28 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] 10.222.0.45 "GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec" status: 200 len: 1567 microversion: 2.1 time: 0.152724 May 24 15:58:55.092834 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1543/3075] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:58:54 2022] GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:58:56.109735 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-ae891491-e813-41b4-8114-5b5caeb890e0 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:58:56.110462 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-ae891491-e813-41b4-8114-5b5caeb890e0 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] [instance: f3cc6e5e-2474-474f-895e-9e149a85f5ec] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:58:56.117861 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ae891491-e813-41b4-8114-5b5caeb890e0 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:58:56.118318 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ae891491-e813-41b4-8114-5b5caeb890e0 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:58:56.119078 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ae891491-e813-41b4-8114-5b5caeb890e0 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:58:56.119509 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ae891491-e813-41b4-8114-5b5caeb890e0 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:58:56.249681 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-ae891491-e813-41b4-8114-5b5caeb890e0 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d864e3821b4c989b474bd313722f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1fbb8218ad4da5a2e2ac6d50bf89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:58:56.257246 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-ae891491-e813-41b4-8114-5b5caeb890e0 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] 10.222.0.45 "GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec" status: 200 len: 1567 microversion: 2.1 time: 0.151368 May 24 15:58:56.257815 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1533/3076] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:58:56 2022] GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:58:57.274017 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-1a174563-88c6-41a1-b20e-93c71d2b705a tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:58:57.274618 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-1a174563-88c6-41a1-b20e-93c71d2b705a tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] [instance: f3cc6e5e-2474-474f-895e-9e149a85f5ec] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:58:57.281217 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1a174563-88c6-41a1-b20e-93c71d2b705a tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:58:57.281657 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1a174563-88c6-41a1-b20e-93c71d2b705a tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:58:57.282400 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1a174563-88c6-41a1-b20e-93c71d2b705a tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:58:57.282824 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-1a174563-88c6-41a1-b20e-93c71d2b705a tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:58:57.410153 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-1a174563-88c6-41a1-b20e-93c71d2b705a tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d864e3821b4c989b474bd313722f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1fbb8218ad4da5a2e2ac6d50bf89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:58:57.417552 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-1a174563-88c6-41a1-b20e-93c71d2b705a tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] 10.222.0.45 "GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec" status: 200 len: 1567 microversion: 2.1 time: 0.147913 May 24 15:58:57.418105 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1544/3077] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:58:57 2022] GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:58:58.434503 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-34268700-8941-40b1-8316-33ffb9fb51cc tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:58:58.435016 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-34268700-8941-40b1-8316-33ffb9fb51cc tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] [instance: f3cc6e5e-2474-474f-895e-9e149a85f5ec] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:58:58.442433 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-34268700-8941-40b1-8316-33ffb9fb51cc tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:58:58.442872 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-34268700-8941-40b1-8316-33ffb9fb51cc tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:58:58.443620 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-34268700-8941-40b1-8316-33ffb9fb51cc tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:58:58.444045 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-34268700-8941-40b1-8316-33ffb9fb51cc tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:58:58.572824 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-34268700-8941-40b1-8316-33ffb9fb51cc tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d864e3821b4c989b474bd313722f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1fbb8218ad4da5a2e2ac6d50bf89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:58:58.580340 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-34268700-8941-40b1-8316-33ffb9fb51cc tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] 10.222.0.45 "GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec" status: 200 len: 1567 microversion: 2.1 time: 0.149781 May 24 15:58:58.580896 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1534/3078] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:58:58 2022] GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:58:59.597614 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-ae51ccea-589b-46e2-8ad8-e48844bbdef2 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:58:59.598264 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-ae51ccea-589b-46e2-8ad8-e48844bbdef2 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] [instance: f3cc6e5e-2474-474f-895e-9e149a85f5ec] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:58:59.604770 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ae51ccea-589b-46e2-8ad8-e48844bbdef2 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:58:59.605220 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ae51ccea-589b-46e2-8ad8-e48844bbdef2 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:58:59.605979 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ae51ccea-589b-46e2-8ad8-e48844bbdef2 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:58:59.606417 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ae51ccea-589b-46e2-8ad8-e48844bbdef2 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:58:59.737695 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ae51ccea-589b-46e2-8ad8-e48844bbdef2 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d864e3821b4c989b474bd313722f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1fbb8218ad4da5a2e2ac6d50bf89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:58:59.745987 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-ae51ccea-589b-46e2-8ad8-e48844bbdef2 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] 10.222.0.45 "GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec" status: 200 len: 1567 microversion: 2.1 time: 0.152218 May 24 15:58:59.746548 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1545/3079] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:58:59 2022] GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:59:00.762811 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-13198d92-903d-4257-94a1-4e437a11c8e8 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:59:00.763426 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-13198d92-903d-4257-94a1-4e437a11c8e8 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] [instance: f3cc6e5e-2474-474f-895e-9e149a85f5ec] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:59:00.770471 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-13198d92-903d-4257-94a1-4e437a11c8e8 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:00.770917 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-13198d92-903d-4257-94a1-4e437a11c8e8 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:00.771672 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-13198d92-903d-4257-94a1-4e437a11c8e8 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:00.772104 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-13198d92-903d-4257-94a1-4e437a11c8e8 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:00.904769 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-13198d92-903d-4257-94a1-4e437a11c8e8 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d864e3821b4c989b474bd313722f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1fbb8218ad4da5a2e2ac6d50bf89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:59:00.912245 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-13198d92-903d-4257-94a1-4e437a11c8e8 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] 10.222.0.45 "GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec" status: 200 len: 1567 microversion: 2.1 time: 0.153396 May 24 15:59:00.912829 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1535/3080] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:59:00 2022] GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:59:01.928919 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-7b76c9e3-bc01-4d79-99fb-5df9d79adff2 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:59:01.929460 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-7b76c9e3-bc01-4d79-99fb-5df9d79adff2 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] [instance: f3cc6e5e-2474-474f-895e-9e149a85f5ec] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:59:01.935853 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7b76c9e3-bc01-4d79-99fb-5df9d79adff2 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:01.936319 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7b76c9e3-bc01-4d79-99fb-5df9d79adff2 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:01.937082 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7b76c9e3-bc01-4d79-99fb-5df9d79adff2 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:01.937514 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7b76c9e3-bc01-4d79-99fb-5df9d79adff2 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:02.063087 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-7b76c9e3-bc01-4d79-99fb-5df9d79adff2 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d864e3821b4c989b474bd313722f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1fbb8218ad4da5a2e2ac6d50bf89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:59:02.071197 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-7b76c9e3-bc01-4d79-99fb-5df9d79adff2 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] 10.222.0.45 "GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec" status: 200 len: 1567 microversion: 2.1 time: 0.146093 May 24 15:59:02.071759 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1546/3081] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:59:01 2022] GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec => generated 1567 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:59:03.087350 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-9f1cf265-a142-4f49-89e5-27016cbc1a1d tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:59:03.087956 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-9f1cf265-a142-4f49-89e5-27016cbc1a1d tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] [instance: f3cc6e5e-2474-474f-895e-9e149a85f5ec] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:59:03.094458 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9f1cf265-a142-4f49-89e5-27016cbc1a1d tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:03.094899 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9f1cf265-a142-4f49-89e5-27016cbc1a1d tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:03.095658 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9f1cf265-a142-4f49-89e5-27016cbc1a1d tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:03.096088 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9f1cf265-a142-4f49-89e5-27016cbc1a1d tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:03.221304 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-9f1cf265-a142-4f49-89e5-27016cbc1a1d tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d864e3821b4c989b474bd313722f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1fbb8218ad4da5a2e2ac6d50bf89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:59:03.229330 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-9f1cf265-a142-4f49-89e5-27016cbc1a1d tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] 10.222.0.45 "GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec" status: 200 len: 1567 microversion: 2.1 time: 0.145831 May 24 15:59:03.229883 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1536/3082] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:59:03 2022] GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec => generated 1567 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:59:04.246225 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-49268dbd-c62a-4838-9f1c-2e175a10a029 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:59:04.246846 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-49268dbd-c62a-4838-9f1c-2e175a10a029 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] [instance: f3cc6e5e-2474-474f-895e-9e149a85f5ec] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:59:04.253409 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-49268dbd-c62a-4838-9f1c-2e175a10a029 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:04.253885 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-49268dbd-c62a-4838-9f1c-2e175a10a029 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:04.254649 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-49268dbd-c62a-4838-9f1c-2e175a10a029 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:04.255088 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-49268dbd-c62a-4838-9f1c-2e175a10a029 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:04.387103 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-49268dbd-c62a-4838-9f1c-2e175a10a029 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d864e3821b4c989b474bd313722f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1fbb8218ad4da5a2e2ac6d50bf89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:59:04.394738 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-49268dbd-c62a-4838-9f1c-2e175a10a029 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] 10.222.0.45 "GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec" status: 200 len: 1567 microversion: 2.1 time: 0.152572 May 24 15:59:04.395300 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1547/3083] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:59:04 2022] GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:59:05.411582 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-1bb9b1c3-8fb0-4cf0-8cb0-5feec163154d tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:59:05.412138 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-1bb9b1c3-8fb0-4cf0-8cb0-5feec163154d tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] [instance: f3cc6e5e-2474-474f-895e-9e149a85f5ec] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:59:05.418725 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1bb9b1c3-8fb0-4cf0-8cb0-5feec163154d tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:05.419165 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1bb9b1c3-8fb0-4cf0-8cb0-5feec163154d tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:05.419912 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1bb9b1c3-8fb0-4cf0-8cb0-5feec163154d tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:05.420385 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-1bb9b1c3-8fb0-4cf0-8cb0-5feec163154d tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:05.548854 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-1bb9b1c3-8fb0-4cf0-8cb0-5feec163154d tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d864e3821b4c989b474bd313722f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1fbb8218ad4da5a2e2ac6d50bf89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:59:05.556754 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-1bb9b1c3-8fb0-4cf0-8cb0-5feec163154d tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] 10.222.0.45 "GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec" status: 200 len: 1567 microversion: 2.1 time: 0.149056 May 24 15:59:05.557307 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1537/3084] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:59:05 2022] GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:59:06.574730 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-93748640-79d5-4bfe-8110-c6fe1fedf7d5 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:59:06.575364 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-93748640-79d5-4bfe-8110-c6fe1fedf7d5 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] [instance: f3cc6e5e-2474-474f-895e-9e149a85f5ec] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:59:06.581805 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-93748640-79d5-4bfe-8110-c6fe1fedf7d5 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:06.582247 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-93748640-79d5-4bfe-8110-c6fe1fedf7d5 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:06.583003 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-93748640-79d5-4bfe-8110-c6fe1fedf7d5 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:06.583805 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-93748640-79d5-4bfe-8110-c6fe1fedf7d5 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:06.712795 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-93748640-79d5-4bfe-8110-c6fe1fedf7d5 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d864e3821b4c989b474bd313722f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1fbb8218ad4da5a2e2ac6d50bf89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:59:06.720148 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-93748640-79d5-4bfe-8110-c6fe1fedf7d5 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] 10.222.0.45 "GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec" status: 200 len: 1567 microversion: 2.1 time: 0.149224 May 24 15:59:06.720735 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1548/3085] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:59:06 2022] GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:59:07.737517 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-2d2a1875-3c63-4369-be3f-620074f3d590 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:59:07.738122 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-2d2a1875-3c63-4369-be3f-620074f3d590 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] [instance: f3cc6e5e-2474-474f-895e-9e149a85f5ec] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:59:07.745373 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2d2a1875-3c63-4369-be3f-620074f3d590 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:07.745817 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2d2a1875-3c63-4369-be3f-620074f3d590 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:07.746566 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2d2a1875-3c63-4369-be3f-620074f3d590 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:07.747011 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2d2a1875-3c63-4369-be3f-620074f3d590 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:07.877001 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-2d2a1875-3c63-4369-be3f-620074f3d590 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d864e3821b4c989b474bd313722f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1fbb8218ad4da5a2e2ac6d50bf89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:59:07.884497 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-2d2a1875-3c63-4369-be3f-620074f3d590 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] 10.222.0.45 "GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec" status: 200 len: 1508 microversion: 2.1 time: 0.150851 May 24 15:59:07.885051 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1538/3086] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:59:07 2022] GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:59:07.900145 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-6cbe48aa-7075-4474-a58e-a4201dd86e56 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:59:07.900733 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-6cbe48aa-7075-4474-a58e-a4201dd86e56 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] [instance: f3cc6e5e-2474-474f-895e-9e149a85f5ec] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:59:07.907064 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6cbe48aa-7075-4474-a58e-a4201dd86e56 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:07.907506 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6cbe48aa-7075-4474-a58e-a4201dd86e56 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:07.908252 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6cbe48aa-7075-4474-a58e-a4201dd86e56 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:07.908700 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-6cbe48aa-7075-4474-a58e-a4201dd86e56 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:07.992286 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-6cbe48aa-7075-4474-a58e-a4201dd86e56 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] 10.222.0.45 "POST /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec/action" status: 202 len: 0 microversion: 2.1 time: 0.095867 May 24 15:59:07.993174 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1549/3087] 10.222.0.45 () {60 vars in 1277 bytes} [Tue May 24 15:59:07 2022] POST /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 24 15:59:08.001242 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-eb82957f-f7a4-4cbf-8df9-255d5778cb07 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:59:08.001851 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-eb82957f-f7a4-4cbf-8df9-255d5778cb07 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] [instance: f3cc6e5e-2474-474f-895e-9e149a85f5ec] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:59:08.007786 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-eb82957f-f7a4-4cbf-8df9-255d5778cb07 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:08.008227 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-eb82957f-f7a4-4cbf-8df9-255d5778cb07 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:08.009127 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-eb82957f-f7a4-4cbf-8df9-255d5778cb07 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:08.009562 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-eb82957f-f7a4-4cbf-8df9-255d5778cb07 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:08.143507 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-eb82957f-f7a4-4cbf-8df9-255d5778cb07 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d864e3821b4c989b474bd313722f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1fbb8218ad4da5a2e2ac6d50bf89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:59:08.151101 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-eb82957f-f7a4-4cbf-8df9-255d5778cb07 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] 10.222.0.45 "GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec" status: 200 len: 1516 microversion: 2.1 time: 0.153678 May 24 15:59:08.151670 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1539/3088] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:59:07 2022] GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:59:09.169407 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-7b6107fe-3daa-49ff-a8aa-1a1357130cc1 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:59:09.170056 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-7b6107fe-3daa-49ff-a8aa-1a1357130cc1 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] [instance: f3cc6e5e-2474-474f-895e-9e149a85f5ec] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:59:09.176054 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7b6107fe-3daa-49ff-a8aa-1a1357130cc1 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:09.176547 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7b6107fe-3daa-49ff-a8aa-1a1357130cc1 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:09.177315 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7b6107fe-3daa-49ff-a8aa-1a1357130cc1 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:09.177753 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-7b6107fe-3daa-49ff-a8aa-1a1357130cc1 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:09.311025 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-7b6107fe-3daa-49ff-a8aa-1a1357130cc1 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d864e3821b4c989b474bd313722f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1fbb8218ad4da5a2e2ac6d50bf89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:59:09.318724 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-7b6107fe-3daa-49ff-a8aa-1a1357130cc1 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] 10.222.0.45 "GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec" status: 200 len: 1518 microversion: 2.1 time: 0.153644 May 24 15:59:09.319778 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1550/3089] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:59:09 2022] GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:59:09.869547 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [req-7f7f84ab-cbc6-4272-8d4d-61057f559111 req-cb7cb0c4-db1d-41a4-92c9-9915b5dd7386 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3cc6e5e-2474-474f-895e-9e149a85f5ec", "name": "network-vif-unplugged", "status": "completed", "tag": "b80e1095-48e1-461e-8be0-658508ca4b89"}]} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:59:09.878465 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-7f7f84ab-cbc6-4272-8d4d-61057f559111 req-cb7cb0c4-db1d-41a4-92c9-9915b5dd7386 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:09.878888 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-7f7f84ab-cbc6-4272-8d4d-61057f559111 req-cb7cb0c4-db1d-41a4-92c9-9915b5dd7386 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:09.890352 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.compute.server_external_events [req-7f7f84ab-cbc6-4272-8d4d-61057f559111 req-cb7cb0c4-db1d-41a4-92c9-9915b5dd7386 service nova] Creating event network-vif-unplugged:b80e1095-48e1-461e-8be0-658508ca4b89 for instance f3cc6e5e-2474-474f-895e-9e149a85f5ec on hv-cinder-84315 May 24 15:59:09.895300 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [req-7f7f84ab-cbc6-4272-8d4d-61057f559111 req-cb7cb0c4-db1d-41a4-92c9-9915b5dd7386 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029711 May 24 15:59:09.901918 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1540/3090] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:59:10.337198 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-05c14754-1124-433f-b223-23690c92d458 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:59:10.337815 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-05c14754-1124-433f-b223-23690c92d458 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] [instance: f3cc6e5e-2474-474f-895e-9e149a85f5ec] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:59:10.344380 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-05c14754-1124-433f-b223-23690c92d458 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:10.344832 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-05c14754-1124-433f-b223-23690c92d458 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:10.345597 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-05c14754-1124-433f-b223-23690c92d458 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:10.346043 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-05c14754-1124-433f-b223-23690c92d458 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:10.484713 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-05c14754-1124-433f-b223-23690c92d458 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d864e3821b4c989b474bd313722f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1fbb8218ad4da5a2e2ac6d50bf89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:59:10.492930 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-05c14754-1124-433f-b223-23690c92d458 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] 10.222.0.45 "GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec" status: 200 len: 1574 microversion: 2.1 time: 0.160043 May 24 15:59:10.493692 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1551/3091] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:59:10 2022] GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:59:11.510480 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-12a3b3d9-69c2-46c2-a2fa-6a63fdf6a7c8 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:59:11.511170 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-12a3b3d9-69c2-46c2-a2fa-6a63fdf6a7c8 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] [instance: f3cc6e5e-2474-474f-895e-9e149a85f5ec] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:59:11.517309 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-12a3b3d9-69c2-46c2-a2fa-6a63fdf6a7c8 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:11.517747 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-12a3b3d9-69c2-46c2-a2fa-6a63fdf6a7c8 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:11.518491 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-12a3b3d9-69c2-46c2-a2fa-6a63fdf6a7c8 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:11.518921 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-12a3b3d9-69c2-46c2-a2fa-6a63fdf6a7c8 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:11.646846 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-12a3b3d9-69c2-46c2-a2fa-6a63fdf6a7c8 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d864e3821b4c989b474bd313722f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1fbb8218ad4da5a2e2ac6d50bf89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:59:11.654951 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-12a3b3d9-69c2-46c2-a2fa-6a63fdf6a7c8 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] 10.222.0.45 "GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec" status: 200 len: 1574 microversion: 2.1 time: 0.149111 May 24 15:59:11.655516 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1541/3092] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:59:11 2022] GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec => generated 1574 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:59:12.671587 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-bb32f893-6790-46ed-9fc7-cbdfeda36a4e tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:59:12.672207 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-bb32f893-6790-46ed-9fc7-cbdfeda36a4e tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] [instance: f3cc6e5e-2474-474f-895e-9e149a85f5ec] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:59:12.679342 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bb32f893-6790-46ed-9fc7-cbdfeda36a4e tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:12.679784 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bb32f893-6790-46ed-9fc7-cbdfeda36a4e tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:12.680562 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bb32f893-6790-46ed-9fc7-cbdfeda36a4e tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:12.680998 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bb32f893-6790-46ed-9fc7-cbdfeda36a4e tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:12.812248 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-bb32f893-6790-46ed-9fc7-cbdfeda36a4e tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d864e3821b4c989b474bd313722f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1fbb8218ad4da5a2e2ac6d50bf89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:59:12.819757 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-bb32f893-6790-46ed-9fc7-cbdfeda36a4e tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] 10.222.0.45 "GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec" status: 200 len: 1574 microversion: 2.1 time: 0.152021 May 24 15:59:12.820340 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1552/3093] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:59:12 2022] GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:59:13.837197 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-2917dc8b-2b80-4f24-befd-32a50e7216d3 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:59:13.837745 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-2917dc8b-2b80-4f24-befd-32a50e7216d3 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] [instance: f3cc6e5e-2474-474f-895e-9e149a85f5ec] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:59:13.844213 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2917dc8b-2b80-4f24-befd-32a50e7216d3 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:13.844682 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2917dc8b-2b80-4f24-befd-32a50e7216d3 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:13.845430 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2917dc8b-2b80-4f24-befd-32a50e7216d3 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:13.845860 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2917dc8b-2b80-4f24-befd-32a50e7216d3 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:13.975280 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-2917dc8b-2b80-4f24-befd-32a50e7216d3 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d864e3821b4c989b474bd313722f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1fbb8218ad4da5a2e2ac6d50bf89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:59:13.982739 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-2917dc8b-2b80-4f24-befd-32a50e7216d3 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] 10.222.0.45 "GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec" status: 200 len: 1574 microversion: 2.1 time: 0.150149 May 24 15:59:13.983296 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1542/3094] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:59:13 2022] GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:59:14.999320 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d46fe222-4af3-43ac-a18d-cf51838c56ad tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:59:14.999922 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d46fe222-4af3-43ac-a18d-cf51838c56ad tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] [instance: f3cc6e5e-2474-474f-895e-9e149a85f5ec] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:59:15.006435 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d46fe222-4af3-43ac-a18d-cf51838c56ad tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:15.006876 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d46fe222-4af3-43ac-a18d-cf51838c56ad tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:15.007622 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d46fe222-4af3-43ac-a18d-cf51838c56ad tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:15.008721 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d46fe222-4af3-43ac-a18d-cf51838c56ad tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:15.136680 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-d46fe222-4af3-43ac-a18d-cf51838c56ad tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d864e3821b4c989b474bd313722f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1fbb8218ad4da5a2e2ac6d50bf89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:59:15.144043 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d46fe222-4af3-43ac-a18d-cf51838c56ad tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] 10.222.0.45 "GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec" status: 200 len: 1574 microversion: 2.1 time: 0.148666 May 24 15:59:15.144638 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1553/3095] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:59:14 2022] GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec => generated 1574 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:59:16.161458 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-76f10b87-d550-46a0-b1f6-0bb977ef5f7e tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:59:16.162070 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-76f10b87-d550-46a0-b1f6-0bb977ef5f7e tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] [instance: f3cc6e5e-2474-474f-895e-9e149a85f5ec] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:59:16.169199 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-76f10b87-d550-46a0-b1f6-0bb977ef5f7e tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:16.169649 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-76f10b87-d550-46a0-b1f6-0bb977ef5f7e tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:16.170408 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-76f10b87-d550-46a0-b1f6-0bb977ef5f7e tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:16.170842 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-76f10b87-d550-46a0-b1f6-0bb977ef5f7e tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:16.297609 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-76f10b87-d550-46a0-b1f6-0bb977ef5f7e tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d864e3821b4c989b474bd313722f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1fbb8218ad4da5a2e2ac6d50bf89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:59:16.305694 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-76f10b87-d550-46a0-b1f6-0bb977ef5f7e tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] 10.222.0.45 "GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec" status: 200 len: 1574 microversion: 2.1 time: 0.148120 May 24 15:59:16.306257 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1543/3096] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:59:16 2022] GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec => generated 1574 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:59:17.322463 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-f878ffa1-603f-4c11-a62f-598a5fd987aa tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:59:17.323006 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-f878ffa1-603f-4c11-a62f-598a5fd987aa tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] [instance: f3cc6e5e-2474-474f-895e-9e149a85f5ec] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:59:17.329498 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f878ffa1-603f-4c11-a62f-598a5fd987aa tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:17.329944 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f878ffa1-603f-4c11-a62f-598a5fd987aa tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:17.330685 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f878ffa1-603f-4c11-a62f-598a5fd987aa tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:17.331111 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-f878ffa1-603f-4c11-a62f-598a5fd987aa tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:17.464367 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-f878ffa1-603f-4c11-a62f-598a5fd987aa tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d864e3821b4c989b474bd313722f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1fbb8218ad4da5a2e2ac6d50bf89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:59:17.471748 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-f878ffa1-603f-4c11-a62f-598a5fd987aa tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] 10.222.0.45 "GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec" status: 200 len: 1574 microversion: 2.1 time: 0.153203 May 24 15:59:17.472326 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1554/3097] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:59:17 2022] GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:59:18.494894 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-29c68ba5-b6d1-45d1-93c7-0140ea6bd276 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:59:18.495506 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-29c68ba5-b6d1-45d1-93c7-0140ea6bd276 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] [instance: f3cc6e5e-2474-474f-895e-9e149a85f5ec] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:59:18.502107 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-29c68ba5-b6d1-45d1-93c7-0140ea6bd276 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:18.502558 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-29c68ba5-b6d1-45d1-93c7-0140ea6bd276 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:18.503328 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-29c68ba5-b6d1-45d1-93c7-0140ea6bd276 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:18.503763 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-29c68ba5-b6d1-45d1-93c7-0140ea6bd276 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:18.643509 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-29c68ba5-b6d1-45d1-93c7-0140ea6bd276 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d864e3821b4c989b474bd313722f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1fbb8218ad4da5a2e2ac6d50bf89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:59:18.652468 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-29c68ba5-b6d1-45d1-93c7-0140ea6bd276 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] 10.222.0.45 "GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec" status: 200 len: 1574 microversion: 2.1 time: 0.161595 May 24 15:59:18.653107 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1544/3098] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:59:18 2022] GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:59:19.668768 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-00b3eed5-908a-4ff8-9649-f5309aed485e tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:59:19.669313 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-00b3eed5-908a-4ff8-9649-f5309aed485e tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] [instance: f3cc6e5e-2474-474f-895e-9e149a85f5ec] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:59:19.675748 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-00b3eed5-908a-4ff8-9649-f5309aed485e tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:19.676193 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-00b3eed5-908a-4ff8-9649-f5309aed485e tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:19.676964 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-00b3eed5-908a-4ff8-9649-f5309aed485e tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:19.677394 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-00b3eed5-908a-4ff8-9649-f5309aed485e tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:19.695703 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:59:19.807572 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-00b3eed5-908a-4ff8-9649-f5309aed485e tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d864e3821b4c989b474bd313722f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1fbb8218ad4da5a2e2ac6d50bf89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:59:19.815057 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-00b3eed5-908a-4ff8-9649-f5309aed485e tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] 10.222.0.45 "GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec" status: 200 len: 1574 microversion: 2.1 time: 0.150114 May 24 15:59:19.815618 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1555/3099] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:59:19 2022] GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:59:19.965764 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [req-820ab31d-dddc-4b35-817a-63db8c7f89e0 req-ba4e2f7d-14a7-430e-ab7d-70f65f26d408 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3cc6e5e-2474-474f-895e-9e149a85f5ec", "name": "network-vif-plugged", "status": "completed", "tag": "b80e1095-48e1-461e-8be0-658508ca4b89"}]} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:59:19.974319 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-820ab31d-dddc-4b35-817a-63db8c7f89e0 req-ba4e2f7d-14a7-430e-ab7d-70f65f26d408 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:19.975332 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-820ab31d-dddc-4b35-817a-63db8c7f89e0 req-ba4e2f7d-14a7-430e-ab7d-70f65f26d408 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:19.986448 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.compute.server_external_events [req-820ab31d-dddc-4b35-817a-63db8c7f89e0 req-ba4e2f7d-14a7-430e-ab7d-70f65f26d408 service nova] Creating event network-vif-plugged:b80e1095-48e1-461e-8be0-658508ca4b89 for instance f3cc6e5e-2474-474f-895e-9e149a85f5ec on hv-cinder-84315 May 24 15:59:19.991342 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [req-820ab31d-dddc-4b35-817a-63db8c7f89e0 req-ba4e2f7d-14a7-430e-ab7d-70f65f26d408 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029313 May 24 15:59:19.992863 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1545/3100] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:59:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:59:20.831832 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-eb52a38c-65fb-4694-9433-36de910b4052 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:59:20.832470 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-eb52a38c-65fb-4694-9433-36de910b4052 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] [instance: f3cc6e5e-2474-474f-895e-9e149a85f5ec] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:59:20.839493 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-eb52a38c-65fb-4694-9433-36de910b4052 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:20.839940 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-eb52a38c-65fb-4694-9433-36de910b4052 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:20.840716 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-eb52a38c-65fb-4694-9433-36de910b4052 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:20.841149 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-eb52a38c-65fb-4694-9433-36de910b4052 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:20.967360 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-eb52a38c-65fb-4694-9433-36de910b4052 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d864e3821b4c989b474bd313722f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1fbb8218ad4da5a2e2ac6d50bf89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:59:20.974726 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-eb52a38c-65fb-4694-9433-36de910b4052 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] 10.222.0.45 "GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec" status: 200 len: 1574 microversion: 2.1 time: 0.146792 May 24 15:59:20.975289 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1556/3101] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:59:20 2022] GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec => generated 1574 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:59:21.991982 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-ab6efa04-5146-417e-a9bc-062556bd38d4 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:59:21.992969 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-ab6efa04-5146-417e-a9bc-062556bd38d4 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] [instance: f3cc6e5e-2474-474f-895e-9e149a85f5ec] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:59:21.999201 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ab6efa04-5146-417e-a9bc-062556bd38d4 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:21.999648 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ab6efa04-5146-417e-a9bc-062556bd38d4 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:22.000466 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ab6efa04-5146-417e-a9bc-062556bd38d4 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:22.000905 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-ab6efa04-5146-417e-a9bc-062556bd38d4 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:22.129268 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-ab6efa04-5146-417e-a9bc-062556bd38d4 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d864e3821b4c989b474bd313722f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1fbb8218ad4da5a2e2ac6d50bf89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:59:22.137258 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-ab6efa04-5146-417e-a9bc-062556bd38d4 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] 10.222.0.45 "GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec" status: 200 len: 1561 microversion: 2.1 time: 0.150105 May 24 15:59:22.137833 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1546/3102] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:59:21 2022] GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:59:32.655814 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-920484f2-06b2-463f-a756-fa870a4c87a0 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:59:32.656350 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-920484f2-06b2-463f-a756-fa870a4c87a0 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 449da4bb-d801-4e7d-b677-d375b68062a6] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:59:32.658371 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_api:SELECT=32 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:59:32.659024 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=8 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:59:32.665233 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-920484f2-06b2-463f-a756-fa870a4c87a0 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:32.665686 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-920484f2-06b2-463f-a756-fa870a4c87a0 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:32.666444 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-920484f2-06b2-463f-a756-fa870a4c87a0 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:32.666878 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-920484f2-06b2-463f-a756-fa870a4c87a0 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:32.690653 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-920484f2-06b2-463f-a756-fa870a4c87a0 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 449da4bb-d801-4e7d-b677-d375b68062a6] Going to try to terminate instance {{(pid=117698) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 15:59:32.771007 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-920484f2-06b2-463f-a756-fa870a4c87a0 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "DELETE /compute/v2.1/servers/449da4bb-d801-4e7d-b677-d375b68062a6" status: 204 len: 0 microversion: 2.1 time: 0.118798 May 24 15:59:32.771635 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1557/3103] 10.222.0.45 () {58 vars in 1238 bytes} [Tue May 24 15:59:32 2022] DELETE /compute/v2.1/servers/449da4bb-d801-4e7d-b677-d375b68062a6 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 15:59:32.780258 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-c6b3b8ef-e74c-4311-b02f-65be6eb526f3 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:59:32.780946 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-c6b3b8ef-e74c-4311-b02f-65be6eb526f3 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 449da4bb-d801-4e7d-b677-d375b68062a6] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:59:32.783498 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_api:SELECT=30 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:59:32.784132 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=82 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:59:32.789347 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c6b3b8ef-e74c-4311-b02f-65be6eb526f3 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:32.789803 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c6b3b8ef-e74c-4311-b02f-65be6eb526f3 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:32.790564 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c6b3b8ef-e74c-4311-b02f-65be6eb526f3 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:32.790995 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c6b3b8ef-e74c-4311-b02f-65be6eb526f3 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:32.921878 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-c6b3b8ef-e74c-4311-b02f-65be6eb526f3 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:59:32.929361 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-c6b3b8ef-e74c-4311-b02f-65be6eb526f3 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/449da4bb-d801-4e7d-b677-d375b68062a6" status: 200 len: 1576 microversion: 2.1 time: 0.153100 May 24 15:59:32.930427 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1547/3104] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:59:32 2022] GET /compute/v2.1/servers/449da4bb-d801-4e7d-b677-d375b68062a6 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:59:33.946943 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-5462ead0-1dde-4449-977e-a25b0936c1f2 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:59:33.947577 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-5462ead0-1dde-4449-977e-a25b0936c1f2 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 449da4bb-d801-4e7d-b677-d375b68062a6] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:59:33.954063 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5462ead0-1dde-4449-977e-a25b0936c1f2 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:33.954510 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5462ead0-1dde-4449-977e-a25b0936c1f2 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:33.955263 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5462ead0-1dde-4449-977e-a25b0936c1f2 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:33.955695 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5462ead0-1dde-4449-977e-a25b0936c1f2 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:34.086681 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-5462ead0-1dde-4449-977e-a25b0936c1f2 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:59:34.094817 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-5462ead0-1dde-4449-977e-a25b0936c1f2 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/449da4bb-d801-4e7d-b677-d375b68062a6" status: 200 len: 1576 microversion: 2.1 time: 0.152133 May 24 15:59:34.095382 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1558/3105] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:59:33 2022] GET /compute/v2.1/servers/449da4bb-d801-4e7d-b677-d375b68062a6 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:59:35.111929 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-c10e6685-d567-4f7f-a066-97006bfc7163 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:59:35.112566 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-c10e6685-d567-4f7f-a066-97006bfc7163 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 449da4bb-d801-4e7d-b677-d375b68062a6] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:59:35.120068 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c10e6685-d567-4f7f-a066-97006bfc7163 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:35.120550 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c10e6685-d567-4f7f-a066-97006bfc7163 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:35.121316 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c10e6685-d567-4f7f-a066-97006bfc7163 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:35.121751 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c10e6685-d567-4f7f-a066-97006bfc7163 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:35.348975 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-c10e6685-d567-4f7f-a066-97006bfc7163 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:59:35.361137 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-c10e6685-d567-4f7f-a066-97006bfc7163 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/449da4bb-d801-4e7d-b677-d375b68062a6" status: 200 len: 1576 microversion: 2.1 time: 0.253163 May 24 15:59:35.361736 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1548/3106] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:59:35 2022] GET /compute/v2.1/servers/449da4bb-d801-4e7d-b677-d375b68062a6 => generated 1576 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:59:35.802536 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [req-a031ed7d-81b1-4e1f-9e8c-a01098f7eac1 req-8a8db152-f933-4d54-b710-decb7385b837 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "449da4bb-d801-4e7d-b677-d375b68062a6", "name": "network-vif-deleted", "tag": "6dd9e8d8-c7fb-4ea4-8cdf-d8a25cd9803b"}]} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:59:35.814011 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-a031ed7d-81b1-4e1f-9e8c-a01098f7eac1 req-8a8db152-f933-4d54-b710-decb7385b837 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:35.814588 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-a031ed7d-81b1-4e1f-9e8c-a01098f7eac1 req-8a8db152-f933-4d54-b710-decb7385b837 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:35.827446 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.compute.server_external_events [req-a031ed7d-81b1-4e1f-9e8c-a01098f7eac1 req-8a8db152-f933-4d54-b710-decb7385b837 service nova] Creating event network-vif-deleted:6dd9e8d8-c7fb-4ea4-8cdf-d8a25cd9803b for instance 449da4bb-d801-4e7d-b677-d375b68062a6 on hv-cinder-84315 May 24 15:59:35.834331 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [req-a031ed7d-81b1-4e1f-9e8c-a01098f7eac1 req-8a8db152-f933-4d54-b710-decb7385b837 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035020 May 24 15:59:35.835256 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1559/3107] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:59:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:59:36.378327 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-fd4cef1f-59e4-4c4a-ae4b-8e0dbddf25b7 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:59:36.378854 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-fd4cef1f-59e4-4c4a-ae4b-8e0dbddf25b7 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 449da4bb-d801-4e7d-b677-d375b68062a6] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:59:36.385446 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fd4cef1f-59e4-4c4a-ae4b-8e0dbddf25b7 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:36.385923 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fd4cef1f-59e4-4c4a-ae4b-8e0dbddf25b7 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:36.386685 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fd4cef1f-59e4-4c4a-ae4b-8e0dbddf25b7 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:36.387117 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fd4cef1f-59e4-4c4a-ae4b-8e0dbddf25b7 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:36.417718 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fd4cef1f-59e4-4c4a-ae4b-8e0dbddf25b7 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:36.418163 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-fd4cef1f-59e4-4c4a-ae4b-8e0dbddf25b7 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:36.418613 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.objects.instance [None req-fd4cef1f-59e4-4c4a-ae4b-8e0dbddf25b7 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lazy-loading 'fault' on Instance uuid 449da4bb-d801-4e7d-b677-d375b68062a6 {{(pid=117699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 15:59:36.459990 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-fd4cef1f-59e4-4c4a-ae4b-8e0dbddf25b7 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:59:36.467542 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-fd4cef1f-59e4-4c4a-ae4b-8e0dbddf25b7 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/449da4bb-d801-4e7d-b677-d375b68062a6" status: 200 len: 1229 microversion: 2.1 time: 0.093280 May 24 15:59:36.468112 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1549/3108] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:59:36 2022] GET /compute/v2.1/servers/449da4bb-d801-4e7d-b677-d375b68062a6 => generated 1229 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:59:37.484994 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-534f8884-94bd-458c-8aaf-91207f285f80 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:59:37.485689 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-534f8884-94bd-458c-8aaf-91207f285f80 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 449da4bb-d801-4e7d-b677-d375b68062a6] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:59:37.492378 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-534f8884-94bd-458c-8aaf-91207f285f80 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:37.493568 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-534f8884-94bd-458c-8aaf-91207f285f80 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:37.494318 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-534f8884-94bd-458c-8aaf-91207f285f80 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:37.494751 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-534f8884-94bd-458c-8aaf-91207f285f80 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:37.507612 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.wsgi [None req-534f8884-94bd-458c-8aaf-91207f285f80 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] HTTP exception thrown: Instance 449da4bb-d801-4e7d-b677-d375b68062a6 could not be found. May 24 15:59:37.509878 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-534f8884-94bd-458c-8aaf-91207f285f80 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Request method failure captured: May 24 15:59:37.509878 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: request: GET /compute/v2.1/servers/449da4bb-d801-4e7d-b677-d375b68062a6 HTTP/1.1 May 24 15:59:37.509878 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Accept: application/json May 24 15:59:37.509878 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Accept-Encoding: identity May 24 15:59:37.509878 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Connection: close May 24 15:59:37.509878 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Content-Length: 0 May 24 15:59:37.509878 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Content-Type: application/json May 24 15:59:37.509878 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Host: 10.222.0.45 May 24 15:59:37.509878 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Openstack-System-Scope: None May 24 15:59:37.509878 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: User-Agent: python-urllib3/1.26.9 May 24 15:59:37.509878 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Auth-Token: gAAAAABijQA0nb7kn_QyIsYfbbxxLfmqpFmi4xm6J04GUDFrN1mcfIP3hwvMyDM0VEHMa1BaJ9iedqnptd9UFn7k3Az__2jwtNGmvANjC9AE07eNbnj69WHR9mmTBIwa3n4PH3VdwZu0jD8bMcic0058__Vb5hKGjXkz12j3saF0PWsZNvHsjFE May 24 15:59:37.509878 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Domain-Id: None May 24 15:59:37.509878 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Domain-Name: None May 24 15:59:37.509878 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Identity-Status: Confirmed May 24 15:59:37.509878 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Is-Admin-Project: True May 24 15:59:37.509878 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Domain-Id: default May 24 15:59:37.509878 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Domain-Name: Default May 24 15:59:37.509878 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Id: f5b185a216134b4d828add9ebdcf89d2 May 24 15:59:37.509878 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Name: tempest-TestVolumeBootPattern-1195006381 May 24 15:59:37.509878 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Role: reader,member May 24 15:59:37.509878 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Roles: reader,member May 24 15:59:37.511305 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f5b185a216134b4d828add9ebdcf89d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f5b185a216134b4d828add9ebdcf89d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f5b185a216134b4d828add9ebdcf89d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f5b185a216134b4d828add9ebdcf89d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 24 15:59:37.511305 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Tenant: tempest-TestVolumeBootPattern-1195006381 May 24 15:59:37.511305 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Tenant-Id: f5b185a216134b4d828add9ebdcf89d2 May 24 15:59:37.511305 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Tenant-Name: tempest-TestVolumeBootPattern-1195006381 May 24 15:59:37.511305 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User: tempest-TestVolumeBootPattern-1195006381-project May 24 15:59:37.511305 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Domain-Id: default May 24 15:59:37.511305 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Domain-Name: Default May 24 15:59:37.511305 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Id: 44b73e975868496fb800c68e2d007faa May 24 15:59:37.511305 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Name: tempest-TestVolumeBootPattern-1195006381-project May 24 15:59:37.511305 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: method: > May 24 15:59:37.511305 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: exception: Instance 449da4bb-d801-4e7d-b677-d375b68062a6 could not be found. May 24 15:59:37.511305 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: action_args: {'id': '449da4bb-d801-4e7d-b677-d375b68062a6'} May 24 15:59:37.512096 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:59:37.512096 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:59:37.512096 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:59:37.512096 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:59:37.512096 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:59:37.512096 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:59:37.512096 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:59:37.512096 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:59:37.512096 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:59:37.512096 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:59:37.512096 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 449da4bb-d801-4e7d-b677-d375b68062a6 could not be found. May 24 15:59:37.512096 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:59:37.512096 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:59:37.512096 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:59:37.512096 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:59:37.512096 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:59:37.512096 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:59:37.512096 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:59:37.512096 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:59:37.512096 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:59:37.513314 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:59:37.513314 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 15:59:37.513314 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 15:59:37.513314 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:59:37.513314 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:59:37.513314 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:59:37.513314 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:59:37.513314 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 449da4bb-d801-4e7d-b677-d375b68062a6 could not be found. May 24 15:59:37.513314 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:59:37.513314 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:59:37.513314 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:59:37.513314 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:59:37.513314 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:59:37.513314 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:59:37.513314 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:59:37.513314 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:59:37.513314 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 449da4bb-d801-4e7d-b677-d375b68062a6 could not be found. May 24 15:59:37.513314 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 15:59:37.514475 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-534f8884-94bd-458c-8aaf-91207f285f80 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Returning 404 to user: Instance 449da4bb-d801-4e7d-b677-d375b68062a6 could not be found. {{(pid=117698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:59:37.514475 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-534f8884-94bd-458c-8aaf-91207f285f80 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/449da4bb-d801-4e7d-b677-d375b68062a6" status: 404 len: 111 microversion: 2.1 time: 0.030446 May 24 15:59:37.514475 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1560/3109] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:59:37 2022] GET /compute/v2.1/servers/449da4bb-d801-4e7d-b677-d375b68062a6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:59:37.605613 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-97eb3ff3-cfb2-4fcf-aae4-649f10e8230f tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-84420304", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-134503995", "security_groups": [{"name": "tempest-secgroup-smoke-233826205"}], "block_device_mapping_v2": [{"uuid": "12ed1946-1538-4e5a-9c2d-262b7a4db650", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "37f84cbf-d4c2-49c4-ac9f-54724991334c"}]}} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:59:37.715051 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.network.neutron [None req-97eb3ff3-cfb2-4fcf-aae4-649f10e8230f tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] validate_networks() for [('37f84cbf-d4c2-49c4-ac9f-54724991334c', None, None, None, None, None)] {{(pid=117699) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 15:59:38.071716 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.virt.hardware [None req-97eb3ff3-cfb2-4fcf-aae4-649f10e8230f tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Flavor limits 0:0:0 {{(pid=117699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 15:59:38.072083 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.virt.hardware [None req-97eb3ff3-cfb2-4fcf-aae4-649f10e8230f tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Image limits 0:0:0 {{(pid=117699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 15:59:38.072626 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.virt.hardware [None req-97eb3ff3-cfb2-4fcf-aae4-649f10e8230f tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Flavor pref 0:0:0 {{(pid=117699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 15:59:38.073034 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.virt.hardware [None req-97eb3ff3-cfb2-4fcf-aae4-649f10e8230f tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Image pref 0:0:0 {{(pid=117699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 15:59:38.073442 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.virt.hardware [None req-97eb3ff3-cfb2-4fcf-aae4-649f10e8230f tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 15:59:38.082268 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-97eb3ff3-cfb2-4fcf-aae4-649f10e8230f tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:38.082712 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-97eb3ff3-cfb2-4fcf-aae4-649f10e8230f tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:38.083502 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-97eb3ff3-cfb2-4fcf-aae4-649f10e8230f tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:38.083935 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-97eb3ff3-cfb2-4fcf-aae4-649f10e8230f tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:38.100202 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.quota [None req-97eb3ff3-cfb2-4fcf-aae4-649f10e8230f tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Getting quotas for project f5b185a216134b4d828add9ebdcf89d2. Resources: {'instances', 'ram', 'cores'} {{(pid=117699) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 15:59:38.104672 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.quota [None req-97eb3ff3-cfb2-4fcf-aae4-649f10e8230f tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Getting quotas for user 44b73e975868496fb800c68e2d007faa and project f5b185a216134b4d828add9ebdcf89d2. Resources: {'instances', 'ram', 'cores'} {{(pid=117699) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 15:59:38.161715 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-97eb3ff3-cfb2-4fcf-aae4-649f10e8230f tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Going to run 1 instances... {{(pid=117699) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 15:59:38.163773 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-97eb3ff3-cfb2-4fcf-aae4-649f10e8230f tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 40d5900f-06cc-46a0-bb7e-58a4359e777f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='12ed1946-1538-4e5a-9c2d-262b7a4db650',volume_size=None,volume_type=None)] {{(pid=117699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 15:59:38.287440 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-97eb3ff3-cfb2-4fcf-aae4-649f10e8230f tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.685573 May 24 15:59:38.288068 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1550/3110] 10.222.0.45 () {60 vars in 1146 bytes} [Tue May 24 15:59:37 2022] POST /compute/v2.1/servers => generated 405 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 15:59:38.298628 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-de6ed7b5-95d0-4c0c-bdda-db19e91bffa6 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:59:38.299364 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-de6ed7b5-95d0-4c0c-bdda-db19e91bffa6 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 40d5900f-06cc-46a0-bb7e-58a4359e777f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:59:38.351344 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-de6ed7b5-95d0-4c0c-bdda-db19e91bffa6 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:59:38.358678 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-de6ed7b5-95d0-4c0c-bdda-db19e91bffa6 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/40d5900f-06cc-46a0-bb7e-58a4359e777f" status: 200 len: 1092 microversion: 2.1 time: 0.063884 May 24 15:59:38.359184 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1561/3111] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:59:38 2022] GET /compute/v2.1/servers/40d5900f-06cc-46a0-bb7e-58a4359e777f => generated 1092 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:59:39.375771 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-62d71b43-fa3a-4e9a-a0f0-f850130bacec tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:59:39.376422 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-62d71b43-fa3a-4e9a-a0f0-f850130bacec tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 40d5900f-06cc-46a0-bb7e-58a4359e777f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:59:39.386514 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-62d71b43-fa3a-4e9a-a0f0-f850130bacec tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:39.387553 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-62d71b43-fa3a-4e9a-a0f0-f850130bacec tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:39.388599 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-62d71b43-fa3a-4e9a-a0f0-f850130bacec tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:39.389166 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-62d71b43-fa3a-4e9a-a0f0-f850130bacec tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:39.479157 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-62d71b43-fa3a-4e9a-a0f0-f850130bacec tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:59:39.487082 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-62d71b43-fa3a-4e9a-a0f0-f850130bacec tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/40d5900f-06cc-46a0-bb7e-58a4359e777f" status: 200 len: 1208 microversion: 2.1 time: 0.115695 May 24 15:59:39.487864 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1551/3112] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:59:39 2022] GET /compute/v2.1/servers/40d5900f-06cc-46a0-bb7e-58a4359e777f => generated 1208 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:59:40.505435 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-376f4d95-a05b-4f28-b802-1fc3c977ab59 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:59:40.506049 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-376f4d95-a05b-4f28-b802-1fc3c977ab59 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 40d5900f-06cc-46a0-bb7e-58a4359e777f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:59:40.514183 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-376f4d95-a05b-4f28-b802-1fc3c977ab59 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:40.514638 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-376f4d95-a05b-4f28-b802-1fc3c977ab59 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:40.515838 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-376f4d95-a05b-4f28-b802-1fc3c977ab59 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:40.516551 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-376f4d95-a05b-4f28-b802-1fc3c977ab59 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:40.728439 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-376f4d95-a05b-4f28-b802-1fc3c977ab59 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:59:40.736424 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-376f4d95-a05b-4f28-b802-1fc3c977ab59 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/40d5900f-06cc-46a0-bb7e-58a4359e777f" status: 200 len: 1263 microversion: 2.1 time: 0.235263 May 24 15:59:40.736992 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1562/3113] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:59:40 2022] GET /compute/v2.1/servers/40d5900f-06cc-46a0-bb7e-58a4359e777f => generated 1263 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:59:41.130571 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [req-cbb649e2-fc9c-4cc4-83fd-6b28eaba103e req-1e9082b0-b52b-4f2d-8767-05ed953f666a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40d5900f-06cc-46a0-bb7e-58a4359e777f", "tag": "35e770cc-bb73-4d65-95f9-dfd950c7e216"}]} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:59:41.143468 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-cbb649e2-fc9c-4cc4-83fd-6b28eaba103e req-1e9082b0-b52b-4f2d-8767-05ed953f666a service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:41.143908 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-cbb649e2-fc9c-4cc4-83fd-6b28eaba103e req-1e9082b0-b52b-4f2d-8767-05ed953f666a service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:41.157042 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.compute.server_external_events [req-cbb649e2-fc9c-4cc4-83fd-6b28eaba103e req-1e9082b0-b52b-4f2d-8767-05ed953f666a service nova] Creating event network-changed:35e770cc-bb73-4d65-95f9-dfd950c7e216 for instance 40d5900f-06cc-46a0-bb7e-58a4359e777f on hv-cinder-84315 May 24 15:59:41.163133 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [req-cbb649e2-fc9c-4cc4-83fd-6b28eaba103e req-1e9082b0-b52b-4f2d-8767-05ed953f666a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100819 May 24 15:59:41.164078 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1552/3114] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:59:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:59:41.753618 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-14e2625a-e44c-4c39-bf7c-634a79a54a7c tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:59:41.754233 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-14e2625a-e44c-4c39-bf7c-634a79a54a7c tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 40d5900f-06cc-46a0-bb7e-58a4359e777f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:59:41.761288 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-14e2625a-e44c-4c39-bf7c-634a79a54a7c tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:41.761735 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-14e2625a-e44c-4c39-bf7c-634a79a54a7c tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:41.762489 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-14e2625a-e44c-4c39-bf7c-634a79a54a7c tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:41.762923 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-14e2625a-e44c-4c39-bf7c-634a79a54a7c tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:41.987451 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-14e2625a-e44c-4c39-bf7c-634a79a54a7c tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:59:41.995722 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-14e2625a-e44c-4c39-bf7c-634a79a54a7c tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/40d5900f-06cc-46a0-bb7e-58a4359e777f" status: 200 len: 1263 microversion: 2.1 time: 0.245919 May 24 15:59:41.996277 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1563/3115] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:59:41 2022] GET /compute/v2.1/servers/40d5900f-06cc-46a0-bb7e-58a4359e777f => generated 1263 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:59:43.013338 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-57d34554-ef39-426c-8203-b5b165e8924a tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:59:43.014038 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-57d34554-ef39-426c-8203-b5b165e8924a tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 40d5900f-06cc-46a0-bb7e-58a4359e777f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:59:43.020842 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-57d34554-ef39-426c-8203-b5b165e8924a tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:43.021293 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-57d34554-ef39-426c-8203-b5b165e8924a tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:43.022050 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-57d34554-ef39-426c-8203-b5b165e8924a tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:43.022482 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-57d34554-ef39-426c-8203-b5b165e8924a tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:43.166603 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-57d34554-ef39-426c-8203-b5b165e8924a tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:59:43.174067 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-57d34554-ef39-426c-8203-b5b165e8924a tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/40d5900f-06cc-46a0-bb7e-58a4359e777f" status: 200 len: 1263 microversion: 2.1 time: 0.165452 May 24 15:59:43.174619 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1553/3116] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:59:43 2022] GET /compute/v2.1/servers/40d5900f-06cc-46a0-bb7e-58a4359e777f => generated 1263 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:59:44.190285 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d232c2c3-f4c1-47a0-bece-a00a6ea96c8d tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:59:44.190902 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d232c2c3-f4c1-47a0-bece-a00a6ea96c8d tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 40d5900f-06cc-46a0-bb7e-58a4359e777f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:59:44.197560 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d232c2c3-f4c1-47a0-bece-a00a6ea96c8d tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:44.198008 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d232c2c3-f4c1-47a0-bece-a00a6ea96c8d tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:44.198761 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d232c2c3-f4c1-47a0-bece-a00a6ea96c8d tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:44.199195 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d232c2c3-f4c1-47a0-bece-a00a6ea96c8d tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:44.328668 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-d232c2c3-f4c1-47a0-bece-a00a6ea96c8d tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:59:44.336069 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d232c2c3-f4c1-47a0-bece-a00a6ea96c8d tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/40d5900f-06cc-46a0-bb7e-58a4359e777f" status: 200 len: 1263 microversion: 2.1 time: 0.149535 May 24 15:59:44.337194 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1564/3117] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:59:44 2022] GET /compute/v2.1/servers/40d5900f-06cc-46a0-bb7e-58a4359e777f => generated 1263 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:59:45.353435 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-5e9970f2-c535-464b-8c77-52a99775c481 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:59:45.353980 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-5e9970f2-c535-464b-8c77-52a99775c481 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 40d5900f-06cc-46a0-bb7e-58a4359e777f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:59:45.360450 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5e9970f2-c535-464b-8c77-52a99775c481 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:45.360890 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5e9970f2-c535-464b-8c77-52a99775c481 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:45.361627 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5e9970f2-c535-464b-8c77-52a99775c481 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:45.362059 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5e9970f2-c535-464b-8c77-52a99775c481 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:45.489024 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-5e9970f2-c535-464b-8c77-52a99775c481 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:59:45.497286 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-5e9970f2-c535-464b-8c77-52a99775c481 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/40d5900f-06cc-46a0-bb7e-58a4359e777f" status: 200 len: 1263 microversion: 2.1 time: 0.148341 May 24 15:59:45.497854 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1554/3118] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:59:45 2022] GET /compute/v2.1/servers/40d5900f-06cc-46a0-bb7e-58a4359e777f => generated 1263 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:59:46.513928 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-07848e06-b5c2-4aa4-9621-3adf12acb019 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:59:46.514542 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-07848e06-b5c2-4aa4-9621-3adf12acb019 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 40d5900f-06cc-46a0-bb7e-58a4359e777f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:59:46.521055 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-07848e06-b5c2-4aa4-9621-3adf12acb019 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:46.521502 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-07848e06-b5c2-4aa4-9621-3adf12acb019 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:46.522260 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-07848e06-b5c2-4aa4-9621-3adf12acb019 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:46.522696 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-07848e06-b5c2-4aa4-9621-3adf12acb019 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:46.648674 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-07848e06-b5c2-4aa4-9621-3adf12acb019 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:59:46.656590 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-07848e06-b5c2-4aa4-9621-3adf12acb019 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/40d5900f-06cc-46a0-bb7e-58a4359e777f" status: 200 len: 1263 microversion: 2.1 time: 0.146608 May 24 15:59:46.657150 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1565/3119] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:59:46 2022] GET /compute/v2.1/servers/40d5900f-06cc-46a0-bb7e-58a4359e777f => generated 1263 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:59:47.674409 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-7dc892d5-c2cf-4878-8738-3c090aa2c882 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:59:47.675023 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-7dc892d5-c2cf-4878-8738-3c090aa2c882 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 40d5900f-06cc-46a0-bb7e-58a4359e777f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:59:47.682325 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7dc892d5-c2cf-4878-8738-3c090aa2c882 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:47.682768 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7dc892d5-c2cf-4878-8738-3c090aa2c882 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:47.683516 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7dc892d5-c2cf-4878-8738-3c090aa2c882 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:47.683943 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7dc892d5-c2cf-4878-8738-3c090aa2c882 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:47.809496 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-7dc892d5-c2cf-4878-8738-3c090aa2c882 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:59:47.816866 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-7dc892d5-c2cf-4878-8738-3c090aa2c882 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/40d5900f-06cc-46a0-bb7e-58a4359e777f" status: 200 len: 1263 microversion: 2.1 time: 0.147065 May 24 15:59:47.817423 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1555/3120] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:59:47 2022] GET /compute/v2.1/servers/40d5900f-06cc-46a0-bb7e-58a4359e777f => generated 1263 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:59:48.833722 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-dc11b5b3-b337-47be-84ea-83f48c31f121 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:59:48.834329 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-dc11b5b3-b337-47be-84ea-83f48c31f121 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 40d5900f-06cc-46a0-bb7e-58a4359e777f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:59:48.836791 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell0:SELECT=2 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:59:48.843262 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dc11b5b3-b337-47be-84ea-83f48c31f121 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:48.843710 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dc11b5b3-b337-47be-84ea-83f48c31f121 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:48.844495 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dc11b5b3-b337-47be-84ea-83f48c31f121 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:48.844928 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-dc11b5b3-b337-47be-84ea-83f48c31f121 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:48.987978 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-dc11b5b3-b337-47be-84ea-83f48c31f121 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:59:48.996233 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-dc11b5b3-b337-47be-84ea-83f48c31f121 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/40d5900f-06cc-46a0-bb7e-58a4359e777f" status: 200 len: 1263 microversion: 2.1 time: 0.166898 May 24 15:59:48.996817 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1566/3121] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:59:48 2022] GET /compute/v2.1/servers/40d5900f-06cc-46a0-bb7e-58a4359e777f => generated 1263 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:59:50.012619 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-9121ff14-0864-45ce-8463-92e7124533dd tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:59:50.013310 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-9121ff14-0864-45ce-8463-92e7124533dd tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 40d5900f-06cc-46a0-bb7e-58a4359e777f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:59:50.015368 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell0:SELECT=2 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:59:50.016128 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell0:SELECT=6 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:59:50.022296 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9121ff14-0864-45ce-8463-92e7124533dd tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:50.022756 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9121ff14-0864-45ce-8463-92e7124533dd tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:50.023585 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9121ff14-0864-45ce-8463-92e7124533dd tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:50.024754 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-9121ff14-0864-45ce-8463-92e7124533dd tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:50.165190 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-9121ff14-0864-45ce-8463-92e7124533dd tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:59:50.173202 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-9121ff14-0864-45ce-8463-92e7124533dd tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/40d5900f-06cc-46a0-bb7e-58a4359e777f" status: 200 len: 1263 microversion: 2.1 time: 0.165041 May 24 15:59:50.174274 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1556/3122] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:59:50 2022] GET /compute/v2.1/servers/40d5900f-06cc-46a0-bb7e-58a4359e777f => generated 1263 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:59:51.190982 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-2de0670c-0d4e-4706-9d09-fe02cd363753 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:59:51.191514 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-2de0670c-0d4e-4706-9d09-fe02cd363753 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 40d5900f-06cc-46a0-bb7e-58a4359e777f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:59:51.198127 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2de0670c-0d4e-4706-9d09-fe02cd363753 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:51.198577 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2de0670c-0d4e-4706-9d09-fe02cd363753 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:51.199323 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2de0670c-0d4e-4706-9d09-fe02cd363753 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:51.199753 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-2de0670c-0d4e-4706-9d09-fe02cd363753 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:51.325071 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-2de0670c-0d4e-4706-9d09-fe02cd363753 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:59:51.332564 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-2de0670c-0d4e-4706-9d09-fe02cd363753 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/40d5900f-06cc-46a0-bb7e-58a4359e777f" status: 200 len: 1263 microversion: 2.1 time: 0.145584 May 24 15:59:51.333133 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1567/3123] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:59:51 2022] GET /compute/v2.1/servers/40d5900f-06cc-46a0-bb7e-58a4359e777f => generated 1263 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:59:52.137270 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [req-2aa7dd28-7d8e-4e20-a106-604b8f557a12 req-b7f3490f-7545-4ee5-a948-36a11a9e05c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40d5900f-06cc-46a0-bb7e-58a4359e777f", "name": "network-vif-plugged", "status": "completed", "tag": "35e770cc-bb73-4d65-95f9-dfd950c7e216"}]} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:59:52.146093 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-2aa7dd28-7d8e-4e20-a106-604b8f557a12 req-b7f3490f-7545-4ee5-a948-36a11a9e05c9 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:52.146565 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-2aa7dd28-7d8e-4e20-a106-604b8f557a12 req-b7f3490f-7545-4ee5-a948-36a11a9e05c9 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:52.159211 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.compute.server_external_events [req-2aa7dd28-7d8e-4e20-a106-604b8f557a12 req-b7f3490f-7545-4ee5-a948-36a11a9e05c9 service nova] Creating event network-vif-plugged:35e770cc-bb73-4d65-95f9-dfd950c7e216 for instance 40d5900f-06cc-46a0-bb7e-58a4359e777f on hv-cinder-84315 May 24 15:59:52.164279 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [req-2aa7dd28-7d8e-4e20-a106-604b8f557a12 req-b7f3490f-7545-4ee5-a948-36a11a9e05c9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031264 May 24 15:59:52.164958 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1557/3124] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:59:52.349388 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-798bbb1a-5fa9-4d3c-bcd3-ac13e5ce7e2f tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:59:52.349920 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-798bbb1a-5fa9-4d3c-bcd3-ac13e5ce7e2f tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 40d5900f-06cc-46a0-bb7e-58a4359e777f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:59:52.357232 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-798bbb1a-5fa9-4d3c-bcd3-ac13e5ce7e2f tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:52.357681 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-798bbb1a-5fa9-4d3c-bcd3-ac13e5ce7e2f tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:52.358439 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-798bbb1a-5fa9-4d3c-bcd3-ac13e5ce7e2f tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:52.358872 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-798bbb1a-5fa9-4d3c-bcd3-ac13e5ce7e2f tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:52.541473 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-798bbb1a-5fa9-4d3c-bcd3-ac13e5ce7e2f tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:59:52.548958 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-798bbb1a-5fa9-4d3c-bcd3-ac13e5ce7e2f tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/40d5900f-06cc-46a0-bb7e-58a4359e777f" status: 200 len: 1263 microversion: 2.1 time: 0.203470 May 24 15:59:52.549529 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1568/3125] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:59:52 2022] GET /compute/v2.1/servers/40d5900f-06cc-46a0-bb7e-58a4359e777f => generated 1263 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:59:53.566075 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-488c5fe4-8025-4bcd-b02f-b223c5f476dc tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:59:53.566767 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-488c5fe4-8025-4bcd-b02f-b223c5f476dc tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 40d5900f-06cc-46a0-bb7e-58a4359e777f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:59:53.573945 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-488c5fe4-8025-4bcd-b02f-b223c5f476dc tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:53.574387 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-488c5fe4-8025-4bcd-b02f-b223c5f476dc tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:53.575134 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-488c5fe4-8025-4bcd-b02f-b223c5f476dc tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:53.575560 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-488c5fe4-8025-4bcd-b02f-b223c5f476dc tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:53.709292 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-488c5fe4-8025-4bcd-b02f-b223c5f476dc tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:59:53.717324 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-488c5fe4-8025-4bcd-b02f-b223c5f476dc tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/40d5900f-06cc-46a0-bb7e-58a4359e777f" status: 200 len: 1263 microversion: 2.1 time: 0.155462 May 24 15:59:53.717886 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1558/3126] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:59:53 2022] GET /compute/v2.1/servers/40d5900f-06cc-46a0-bb7e-58a4359e777f => generated 1263 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:59:54.733107 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-317a8b60-7b57-496a-acb8-6cf57ad99620 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:59:54.733717 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-317a8b60-7b57-496a-acb8-6cf57ad99620 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 40d5900f-06cc-46a0-bb7e-58a4359e777f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:59:54.740220 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-317a8b60-7b57-496a-acb8-6cf57ad99620 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:54.740697 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-317a8b60-7b57-496a-acb8-6cf57ad99620 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:54.741450 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-317a8b60-7b57-496a-acb8-6cf57ad99620 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:54.741918 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-317a8b60-7b57-496a-acb8-6cf57ad99620 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:54.869177 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-317a8b60-7b57-496a-acb8-6cf57ad99620 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:59:54.876653 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-317a8b60-7b57-496a-acb8-6cf57ad99620 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/40d5900f-06cc-46a0-bb7e-58a4359e777f" status: 200 len: 1449 microversion: 2.1 time: 0.147347 May 24 15:59:54.877216 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1569/3127] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:59:54 2022] GET /compute/v2.1/servers/40d5900f-06cc-46a0-bb7e-58a4359e777f => generated 1449 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:59:54.894356 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-5b6cac06-ce8e-46e9-a03d-1f8a5f72c534 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:59:54.894957 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-5b6cac06-ce8e-46e9-a03d-1f8a5f72c534 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 40d5900f-06cc-46a0-bb7e-58a4359e777f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:59:54.901481 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5b6cac06-ce8e-46e9-a03d-1f8a5f72c534 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:54.901930 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5b6cac06-ce8e-46e9-a03d-1f8a5f72c534 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:54.902688 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5b6cac06-ce8e-46e9-a03d-1f8a5f72c534 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:54.903120 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-5b6cac06-ce8e-46e9-a03d-1f8a5f72c534 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:55.035695 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-5b6cac06-ce8e-46e9-a03d-1f8a5f72c534 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:59:55.043762 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-5b6cac06-ce8e-46e9-a03d-1f8a5f72c534 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/40d5900f-06cc-46a0-bb7e-58a4359e777f" status: 200 len: 1449 microversion: 2.1 time: 0.153222 May 24 15:59:55.044340 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1559/3128] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 15:59:54 2022] GET /compute/v2.1/servers/40d5900f-06cc-46a0-bb7e-58a4359e777f => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:59:56.625265 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [req-c8cf8b40-9c11-418b-a8ce-e3905b93ab72 req-2b96f4b8-8a69-46d9-8be9-e09f1c183967 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40d5900f-06cc-46a0-bb7e-58a4359e777f", "tag": "35e770cc-bb73-4d65-95f9-dfd950c7e216"}]} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:59:56.633676 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-c8cf8b40-9c11-418b-a8ce-e3905b93ab72 req-2b96f4b8-8a69-46d9-8be9-e09f1c183967 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:59:56.634116 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-c8cf8b40-9c11-418b-a8ce-e3905b93ab72 req-2b96f4b8-8a69-46d9-8be9-e09f1c183967 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:59:56.644967 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.compute.server_external_events [req-c8cf8b40-9c11-418b-a8ce-e3905b93ab72 req-2b96f4b8-8a69-46d9-8be9-e09f1c183967 service nova] Creating event network-changed:35e770cc-bb73-4d65-95f9-dfd950c7e216 for instance 40d5900f-06cc-46a0-bb7e-58a4359e777f on hv-cinder-84315 May 24 15:59:56.650058 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [req-c8cf8b40-9c11-418b-a8ce-e3905b93ab72 req-2b96f4b8-8a69-46d9-8be9-e09f1c183967 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028426 May 24 15:59:56.650710 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1570/3129] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 15:59:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 16:00:39.868322 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-b0beb08b-3129-430f-b4be-02010f9d882d tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 16:00:39.871192 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 16:00:39.876669 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 16:00:39.879977 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-b0beb08b-3129-430f-b4be-02010f9d882d tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] [instance: f3cc6e5e-2474-474f-895e-9e149a85f5ec] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 16:00:39.888430 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 16:00:39.889132 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=68 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 16:00:39.890851 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b0beb08b-3129-430f-b4be-02010f9d882d tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:00:39.891220 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b0beb08b-3129-430f-b4be-02010f9d882d tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:00:39.892014 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b0beb08b-3129-430f-b4be-02010f9d882d tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:00:39.892470 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-b0beb08b-3129-430f-b4be-02010f9d882d tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:00:39.923041 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-b0beb08b-3129-430f-b4be-02010f9d882d tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] [instance: f3cc6e5e-2474-474f-895e-9e149a85f5ec] Going to try to terminate instance {{(pid=117699) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 16:00:39.955580 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [req-68694821-4d63-423c-a4af-2c6a9737fcdd req-5ad465a0-5687-4845-afaa-e956a60713b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3cc6e5e-2474-474f-895e-9e149a85f5ec", "tag": "b80e1095-48e1-461e-8be0-658508ca4b89"}]} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 16:00:39.966372 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-68694821-4d63-423c-a4af-2c6a9737fcdd req-5ad465a0-5687-4845-afaa-e956a60713b9 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:00:39.966910 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-68694821-4d63-423c-a4af-2c6a9737fcdd req-5ad465a0-5687-4845-afaa-e956a60713b9 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:00:39.981131 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.compute.server_external_events [req-68694821-4d63-423c-a4af-2c6a9737fcdd req-5ad465a0-5687-4845-afaa-e956a60713b9 service nova] Creating event network-changed:b80e1095-48e1-461e-8be0-658508ca4b89 for instance f3cc6e5e-2474-474f-895e-9e149a85f5ec on hv-cinder-84315 May 24 16:00:39.987472 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [req-68694821-4d63-423c-a4af-2c6a9737fcdd req-5ad465a0-5687-4845-afaa-e956a60713b9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117682 May 24 16:00:39.988268 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1571/3130] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 16:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 16:00:40.013819 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-b0beb08b-3129-430f-b4be-02010f9d882d tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec" status: 204 len: 0 microversion: 2.1 time: 0.149820 May 24 16:00:40.014410 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1560/3131] 10.222.0.45 () {58 vars in 1238 bytes} [Tue May 24 16:00:39 2022] DELETE /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 16:00:40.023472 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-ccdc6b53-8c82-4b0c-a270-d62c8053cbaf tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 16:00:40.024256 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-ccdc6b53-8c82-4b0c-a270-d62c8053cbaf tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] [instance: f3cc6e5e-2474-474f-895e-9e149a85f5ec] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 16:00:40.031090 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ccdc6b53-8c82-4b0c-a270-d62c8053cbaf tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:00:40.031625 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ccdc6b53-8c82-4b0c-a270-d62c8053cbaf tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:00:40.032527 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ccdc6b53-8c82-4b0c-a270-d62c8053cbaf tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:00:40.033038 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-ccdc6b53-8c82-4b0c-a270-d62c8053cbaf tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:00:40.220804 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-ccdc6b53-8c82-4b0c-a270-d62c8053cbaf tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d864e3821b4c989b474bd313722f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1fbb8218ad4da5a2e2ac6d50bf89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 16:00:40.228658 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-ccdc6b53-8c82-4b0c-a270-d62c8053cbaf tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] 10.222.0.45 "GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec" status: 200 len: 1567 microversion: 2.1 time: 0.209360 May 24 16:00:40.229373 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1572/3132] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 16:00:40 2022] GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec => generated 1567 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 16:00:41.246802 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-7b113322-8e2b-440f-9f55-23cad6004d55 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 16:00:41.247504 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-7b113322-8e2b-440f-9f55-23cad6004d55 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] [instance: f3cc6e5e-2474-474f-895e-9e149a85f5ec] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 16:00:41.255313 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7b113322-8e2b-440f-9f55-23cad6004d55 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:00:41.255761 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7b113322-8e2b-440f-9f55-23cad6004d55 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:00:41.256563 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7b113322-8e2b-440f-9f55-23cad6004d55 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:00:41.257002 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7b113322-8e2b-440f-9f55-23cad6004d55 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:00:41.447394 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-7b113322-8e2b-440f-9f55-23cad6004d55 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d864e3821b4c989b474bd313722f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1fbb8218ad4da5a2e2ac6d50bf89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 16:00:41.455549 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-7b113322-8e2b-440f-9f55-23cad6004d55 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] 10.222.0.45 "GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec" status: 200 len: 1567 microversion: 2.1 time: 0.213253 May 24 16:00:41.456111 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1561/3133] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 16:00:41 2022] GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec => generated 1567 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 16:00:42.472438 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-b0ec1c9a-b68d-4fda-a405-1cc369f7ab40 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 16:00:42.473041 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-b0ec1c9a-b68d-4fda-a405-1cc369f7ab40 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] [instance: f3cc6e5e-2474-474f-895e-9e149a85f5ec] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 16:00:42.479420 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b0ec1c9a-b68d-4fda-a405-1cc369f7ab40 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:00:42.479859 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b0ec1c9a-b68d-4fda-a405-1cc369f7ab40 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:00:42.481217 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b0ec1c9a-b68d-4fda-a405-1cc369f7ab40 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:00:42.481217 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-b0ec1c9a-b68d-4fda-a405-1cc369f7ab40 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:00:42.628459 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-b0ec1c9a-b68d-4fda-a405-1cc369f7ab40 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d864e3821b4c989b474bd313722f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1fbb8218ad4da5a2e2ac6d50bf89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 16:00:42.636606 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-b0ec1c9a-b68d-4fda-a405-1cc369f7ab40 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] 10.222.0.45 "GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec" status: 200 len: 1448 microversion: 2.1 time: 0.167967 May 24 16:00:42.637174 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1573/3134] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 16:00:42 2022] GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec => generated 1448 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 16:00:42.713277 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [req-6748385d-7167-4621-9c80-5bbee9470cfa req-8a8efa8e-6fe4-4f20-b5b9-7d0c680d079a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3cc6e5e-2474-474f-895e-9e149a85f5ec", "name": "network-vif-deleted", "tag": "b80e1095-48e1-461e-8be0-658508ca4b89"}]} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 16:00:42.722566 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-6748385d-7167-4621-9c80-5bbee9470cfa req-8a8efa8e-6fe4-4f20-b5b9-7d0c680d079a service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:00:42.723484 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-6748385d-7167-4621-9c80-5bbee9470cfa req-8a8efa8e-6fe4-4f20-b5b9-7d0c680d079a service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:00:42.735075 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.compute.server_external_events [req-6748385d-7167-4621-9c80-5bbee9470cfa req-8a8efa8e-6fe4-4f20-b5b9-7d0c680d079a service nova] Creating event network-vif-deleted:b80e1095-48e1-461e-8be0-658508ca4b89 for instance f3cc6e5e-2474-474f-895e-9e149a85f5ec on hv-cinder-84315 May 24 16:00:42.740055 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [req-6748385d-7167-4621-9c80-5bbee9470cfa req-8a8efa8e-6fe4-4f20-b5b9-7d0c680d079a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030815 May 24 16:00:42.740689 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1562/3135] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 16:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 16:00:43.657896 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-08f3a661-42fc-47ac-ae7d-bd398a4612a0 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 16:00:43.659900 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-08f3a661-42fc-47ac-ae7d-bd398a4612a0 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] [instance: f3cc6e5e-2474-474f-895e-9e149a85f5ec] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 16:00:43.668592 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-08f3a661-42fc-47ac-ae7d-bd398a4612a0 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:00:43.669686 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-08f3a661-42fc-47ac-ae7d-bd398a4612a0 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:00:43.670463 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-08f3a661-42fc-47ac-ae7d-bd398a4612a0 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:00:43.670894 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-08f3a661-42fc-47ac-ae7d-bd398a4612a0 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:00:43.704026 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-08f3a661-42fc-47ac-ae7d-bd398a4612a0 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:00:43.704526 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-08f3a661-42fc-47ac-ae7d-bd398a4612a0 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:00:43.704964 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.objects.instance [None req-08f3a661-42fc-47ac-ae7d-bd398a4612a0 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lazy-loading 'fault' on Instance uuid f3cc6e5e-2474-474f-895e-9e149a85f5ec {{(pid=117698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 16:00:43.746802 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-08f3a661-42fc-47ac-ae7d-bd398a4612a0 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d864e3821b4c989b474bd313722f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1fbb8218ad4da5a2e2ac6d50bf89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 16:00:43.754931 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-08f3a661-42fc-47ac-ae7d-bd398a4612a0 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] 10.222.0.45 "GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec" status: 200 len: 1178 microversion: 2.1 time: 0.103740 May 24 16:00:43.755530 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1574/3136] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 16:00:43 2022] GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec => generated 1178 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 16:00:44.773465 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-52681e84-935c-4c38-9bbb-5a0cefa5a138 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 16:00:44.774164 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-52681e84-935c-4c38-9bbb-5a0cefa5a138 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] [instance: f3cc6e5e-2474-474f-895e-9e149a85f5ec] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 16:00:44.781133 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-52681e84-935c-4c38-9bbb-5a0cefa5a138 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:00:44.781582 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-52681e84-935c-4c38-9bbb-5a0cefa5a138 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:00:44.782343 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-52681e84-935c-4c38-9bbb-5a0cefa5a138 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:00:44.782778 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-52681e84-935c-4c38-9bbb-5a0cefa5a138 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:00:44.795691 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.wsgi [None req-52681e84-935c-4c38-9bbb-5a0cefa5a138 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] HTTP exception thrown: Instance f3cc6e5e-2474-474f-895e-9e149a85f5ec could not be found. May 24 16:00:44.797358 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-52681e84-935c-4c38-9bbb-5a0cefa5a138 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Request method failure captured: May 24 16:00:44.797358 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: request: GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec HTTP/1.1 May 24 16:00:44.797358 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Accept: application/json May 24 16:00:44.797358 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Accept-Encoding: identity May 24 16:00:44.797358 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Connection: close May 24 16:00:44.797358 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Content-Length: 0 May 24 16:00:44.797358 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Content-Type: application/json May 24 16:00:44.797358 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Host: 10.222.0.45 May 24 16:00:44.797358 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Openstack-System-Scope: None May 24 16:00:44.797358 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: User-Agent: python-urllib3/1.26.9 May 24 16:00:44.797358 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Auth-Token: gAAAAABijP_2QL-6M7CKdsVatfi1WGuR24KC6UrFFz5PYrjiFAUgiKHmIjPJ0ViV5nlIexlkqhVnH-853E5BmxExbwGOv3OHH_Lfr8iBTu883cAP7Iy1kiMd8-o9jkt2NaBWVGgJyLatmv665HQ09BKA0gXljiWZthg34C5dPRV1jKtdMQIg6mE May 24 16:00:44.797358 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Domain-Id: None May 24 16:00:44.797358 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Domain-Name: None May 24 16:00:44.797358 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Identity-Status: Confirmed May 24 16:00:44.797358 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Is-Admin-Project: True May 24 16:00:44.797358 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Domain-Id: default May 24 16:00:44.797358 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Domain-Name: Default May 24 16:00:44.797358 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Id: bc1fbb8218ad4da5a2e2ac6d50bf89e0 May 24 16:00:44.797358 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Name: tempest-TestShelveInstance-616833701 May 24 16:00:44.797358 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Role: reader,member May 24 16:00:44.797358 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Roles: reader,member May 24 16:00:44.798760 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bc1fbb8218ad4da5a2e2ac6d50bf89e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bc1fbb8218ad4da5a2e2ac6d50bf89e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/bc1fbb8218ad4da5a2e2ac6d50bf89e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_bc1fbb8218ad4da5a2e2ac6d50bf89e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 24 16:00:44.798760 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant: tempest-TestShelveInstance-616833701 May 24 16:00:44.798760 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant-Id: bc1fbb8218ad4da5a2e2ac6d50bf89e0 May 24 16:00:44.798760 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant-Name: tempest-TestShelveInstance-616833701 May 24 16:00:44.798760 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User: tempest-TestShelveInstance-616833701-project May 24 16:00:44.798760 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Domain-Id: default May 24 16:00:44.798760 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Domain-Name: Default May 24 16:00:44.798760 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Id: 63d864e3821b4c989b474bd313722f33 May 24 16:00:44.798760 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Name: tempest-TestShelveInstance-616833701-project May 24 16:00:44.798760 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: method: > May 24 16:00:44.798760 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: exception: Instance f3cc6e5e-2474-474f-895e-9e149a85f5ec could not be found. May 24 16:00:44.798760 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: action_args: {'id': 'f3cc6e5e-2474-474f-895e-9e149a85f5ec'} May 24 16:00:44.799591 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 16:00:44.799591 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 16:00:44.799591 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 16:00:44.799591 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 16:00:44.799591 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 16:00:44.799591 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 16:00:44.799591 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 16:00:44.799591 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 16:00:44.799591 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 16:00:44.799591 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 16:00:44.799591 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3cc6e5e-2474-474f-895e-9e149a85f5ec could not be found. May 24 16:00:44.799591 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 16:00:44.799591 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 16:00:44.799591 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 16:00:44.799591 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 16:00:44.799591 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 16:00:44.799591 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 16:00:44.799591 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 16:00:44.799591 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 16:00:44.799591 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 16:00:44.800904 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 16:00:44.800904 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 16:00:44.800904 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 16:00:44.800904 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 16:00:44.800904 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 16:00:44.800904 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 16:00:44.800904 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 16:00:44.800904 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3cc6e5e-2474-474f-895e-9e149a85f5ec could not be found. May 24 16:00:44.800904 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 16:00:44.800904 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 16:00:44.800904 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 16:00:44.800904 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 16:00:44.800904 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 16:00:44.800904 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 16:00:44.800904 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 16:00:44.800904 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 16:00:44.800904 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3cc6e5e-2474-474f-895e-9e149a85f5ec could not be found. May 24 16:00:44.800904 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 16:00:44.802058 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-52681e84-935c-4c38-9bbb-5a0cefa5a138 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Returning 404 to user: Instance f3cc6e5e-2474-474f-895e-9e149a85f5ec could not be found. {{(pid=117699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 16:00:44.802058 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-52681e84-935c-4c38-9bbb-5a0cefa5a138 tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] 10.222.0.45 "GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec" status: 404 len: 111 microversion: 2.1 time: 0.030077 May 24 16:00:44.802058 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1563/3137] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 16:00:44 2022] GET /compute/v2.1/servers/f3cc6e5e-2474-474f-895e-9e149a85f5ec => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 16:00:44.959908 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-2906c85d-26c3-4c39-ad83-3721fbf3372e tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] Calling method '.version_select at 0x7f2ddc0e1f70>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 16:00:44.963824 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2906c85d-26c3-4c39-ad83-3721fbf3372e tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] [5aebd939-39d2-4eea-9422-761c2eb5df8c] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 24 16:00:45.973890 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO oslo.messaging._drivers.impl_rabbit [None req-2906c85d-26c3-4c39-ad83-3721fbf3372e tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] [5aebd939-39d2-4eea-9422-761c2eb5df8c] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 59358. May 24 16:00:45.992594 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-2906c85d-26c3-4c39-ad83-3721fbf3372e tempest-TestShelveInstance-616833701 tempest-TestShelveInstance-616833701-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1086846441" status: 202 len: 0 microversion: 2.1 time: 1.036680 May 24 16:00:45.993421 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1575/3138] 10.222.0.45 () {58 vars in 1253 bytes} [Tue May 24 16:00:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1086846441 => generated 0 bytes in 1038 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 16:01:39.213142 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-afef578d-ea76-4d05-8c9e-5fd363514d2e tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-345647402", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-134503995", "security_groups": [{"name": "tempest-secgroup-smoke-233826205"}], "block_device_mapping_v2": [{"uuid": "b7083460-fc6e-4841-85ee-1653fae1bd9e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "37f84cbf-d4c2-49c4-ac9f-54724991334c"}]}} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 16:01:39.221225 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 16:01:39.221858 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 16:01:39.228428 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 16:01:39.228636 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Tue May 24 16:01:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.45) !!! May 24 16:01:39.330308 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.network.neutron [None req-afef578d-ea76-4d05-8c9e-5fd363514d2e tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] validate_networks() for [('37f84cbf-d4c2-49c4-ac9f-54724991334c', None, None, None, None, None)] {{(pid=117699) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 16:01:39.947209 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.virt.hardware [None req-afef578d-ea76-4d05-8c9e-5fd363514d2e tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Flavor limits 0:0:0 {{(pid=117699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 16:01:39.947665 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.virt.hardware [None req-afef578d-ea76-4d05-8c9e-5fd363514d2e tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Image limits 0:0:0 {{(pid=117699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 16:01:39.948139 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.virt.hardware [None req-afef578d-ea76-4d05-8c9e-5fd363514d2e tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Flavor pref 0:0:0 {{(pid=117699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 16:01:39.948570 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.virt.hardware [None req-afef578d-ea76-4d05-8c9e-5fd363514d2e tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Image pref 0:0:0 {{(pid=117699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 16:01:39.949346 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.virt.hardware [None req-afef578d-ea76-4d05-8c9e-5fd363514d2e tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 16:01:39.957767 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-afef578d-ea76-4d05-8c9e-5fd363514d2e tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:01:39.958212 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-afef578d-ea76-4d05-8c9e-5fd363514d2e tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:01:39.958999 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-afef578d-ea76-4d05-8c9e-5fd363514d2e tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:01:39.959427 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-afef578d-ea76-4d05-8c9e-5fd363514d2e tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:01:39.976408 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.quota [None req-afef578d-ea76-4d05-8c9e-5fd363514d2e tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Getting quotas for project f5b185a216134b4d828add9ebdcf89d2. Resources: {'instances', 'ram', 'cores'} {{(pid=117699) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 16:01:39.980268 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.quota [None req-afef578d-ea76-4d05-8c9e-5fd363514d2e tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Getting quotas for user 44b73e975868496fb800c68e2d007faa and project f5b185a216134b4d828add9ebdcf89d2. Resources: {'instances', 'ram', 'cores'} {{(pid=117699) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 16:01:40.041623 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-afef578d-ea76-4d05-8c9e-5fd363514d2e tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Going to run 1 instances... {{(pid=117699) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 16:01:40.044365 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-afef578d-ea76-4d05-8c9e-5fd363514d2e tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 58ca7f62-0644-4e93-a735-e2071cf40115] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b7083460-fc6e-4841-85ee-1653fae1bd9e',volume_size=None,volume_type=None)] {{(pid=117699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 16:01:40.185148 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-afef578d-ea76-4d05-8c9e-5fd363514d2e tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.975947 May 24 16:01:40.185990 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1564/3139] 10.222.0.45 () {60 vars in 1146 bytes} [Tue May 24 16:01:39 2022] POST /compute/v2.1/servers => generated 405 bytes in 977 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 16:01:40.203215 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e018e380-95b9-4a79-893f-123f211d0d37 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 16:01:40.203822 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e018e380-95b9-4a79-893f-123f211d0d37 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 58ca7f62-0644-4e93-a735-e2071cf40115] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 16:01:40.209043 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=22 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 16:01:40.209912 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 16:01:40.270862 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e018e380-95b9-4a79-893f-123f211d0d37 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 16:01:40.278349 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e018e380-95b9-4a79-893f-123f211d0d37 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/58ca7f62-0644-4e93-a735-e2071cf40115" status: 200 len: 1093 microversion: 2.1 time: 0.078825 May 24 16:01:40.279076 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1576/3140] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 16:01:40 2022] GET /compute/v2.1/servers/58ca7f62-0644-4e93-a735-e2071cf40115 => generated 1093 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 16:01:41.296071 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-8035b064-4456-4d42-8b65-1272d0c82870 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 16:01:41.296719 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-8035b064-4456-4d42-8b65-1272d0c82870 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 58ca7f62-0644-4e93-a735-e2071cf40115] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 16:01:41.302884 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8035b064-4456-4d42-8b65-1272d0c82870 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:01:41.303334 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8035b064-4456-4d42-8b65-1272d0c82870 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:01:41.304096 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8035b064-4456-4d42-8b65-1272d0c82870 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:01:41.304569 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-8035b064-4456-4d42-8b65-1272d0c82870 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:01:41.366760 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-8035b064-4456-4d42-8b65-1272d0c82870 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 16:01:41.375101 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-8035b064-4456-4d42-8b65-1272d0c82870 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/58ca7f62-0644-4e93-a735-e2071cf40115" status: 200 len: 1135 microversion: 2.1 time: 0.083954 May 24 16:01:41.375668 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1565/3141] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 16:01:41 2022] GET /compute/v2.1/servers/58ca7f62-0644-4e93-a735-e2071cf40115 => generated 1135 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 16:01:42.391538 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-c44a002c-a6f6-4c4b-b242-799b467a1f62 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 16:01:42.392150 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-c44a002c-a6f6-4c4b-b242-799b467a1f62 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 58ca7f62-0644-4e93-a735-e2071cf40115] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 16:01:42.398613 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c44a002c-a6f6-4c4b-b242-799b467a1f62 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:01:42.399065 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c44a002c-a6f6-4c4b-b242-799b467a1f62 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:01:42.399827 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c44a002c-a6f6-4c4b-b242-799b467a1f62 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:01:42.400263 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-c44a002c-a6f6-4c4b-b242-799b467a1f62 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:01:42.464776 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-c44a002c-a6f6-4c4b-b242-799b467a1f62 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 16:01:42.472811 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-c44a002c-a6f6-4c4b-b242-799b467a1f62 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/58ca7f62-0644-4e93-a735-e2071cf40115" status: 200 len: 1209 microversion: 2.1 time: 0.084831 May 24 16:01:42.473580 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1577/3142] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 16:01:42 2022] GET /compute/v2.1/servers/58ca7f62-0644-4e93-a735-e2071cf40115 => generated 1209 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 16:01:43.491102 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-2b534ea1-d9c4-4d03-a01c-2bf60b753ecc tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 16:01:43.492272 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-2b534ea1-d9c4-4d03-a01c-2bf60b753ecc tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 58ca7f62-0644-4e93-a735-e2071cf40115] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 16:01:43.499886 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2b534ea1-d9c4-4d03-a01c-2bf60b753ecc tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:01:43.500782 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2b534ea1-d9c4-4d03-a01c-2bf60b753ecc tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:01:43.501715 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2b534ea1-d9c4-4d03-a01c-2bf60b753ecc tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:01:43.502293 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2b534ea1-d9c4-4d03-a01c-2bf60b753ecc tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:01:43.693127 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [req-0488ae41-0dd8-4539-8bfd-4ea4c67ed1d1 req-7d9d21a8-98fa-42c0-b6ae-1062ab713bb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58ca7f62-0644-4e93-a735-e2071cf40115", "tag": "9be02f00-bd63-4aae-bb25-b4a13e883072"}]} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 16:01:43.707381 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-0488ae41-0dd8-4539-8bfd-4ea4c67ed1d1 req-7d9d21a8-98fa-42c0-b6ae-1062ab713bb3 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:01:43.707837 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-0488ae41-0dd8-4539-8bfd-4ea4c67ed1d1 req-7d9d21a8-98fa-42c0-b6ae-1062ab713bb3 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:01:43.723600 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.compute.server_external_events [req-0488ae41-0dd8-4539-8bfd-4ea4c67ed1d1 req-7d9d21a8-98fa-42c0-b6ae-1062ab713bb3 service nova] Creating event network-changed:9be02f00-bd63-4aae-bb25-b4a13e883072 for instance 58ca7f62-0644-4e93-a735-e2071cf40115 on hv-cinder-84315 May 24 16:01:43.728631 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [req-0488ae41-0dd8-4539-8bfd-4ea4c67ed1d1 req-7d9d21a8-98fa-42c0-b6ae-1062ab713bb3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039755 May 24 16:01:43.730056 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1578/3143] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 16:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 16:01:43.741616 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-2b534ea1-d9c4-4d03-a01c-2bf60b753ecc tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 16:01:43.751541 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-2b534ea1-d9c4-4d03-a01c-2bf60b753ecc tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/58ca7f62-0644-4e93-a735-e2071cf40115" status: 200 len: 1264 microversion: 2.1 time: 0.264632 May 24 16:01:43.752557 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1566/3144] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 16:01:43 2022] GET /compute/v2.1/servers/58ca7f62-0644-4e93-a735-e2071cf40115 => generated 1264 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 16:01:44.769620 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-3f282f6e-f4f5-4929-b72e-ded5d2ca2588 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 16:01:44.770323 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-3f282f6e-f4f5-4929-b72e-ded5d2ca2588 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 58ca7f62-0644-4e93-a735-e2071cf40115] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 16:01:44.776530 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3f282f6e-f4f5-4929-b72e-ded5d2ca2588 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:01:44.776982 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3f282f6e-f4f5-4929-b72e-ded5d2ca2588 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:01:44.778412 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3f282f6e-f4f5-4929-b72e-ded5d2ca2588 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:01:44.778850 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3f282f6e-f4f5-4929-b72e-ded5d2ca2588 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:01:44.908955 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-3f282f6e-f4f5-4929-b72e-ded5d2ca2588 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 16:01:44.916618 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-3f282f6e-f4f5-4929-b72e-ded5d2ca2588 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/58ca7f62-0644-4e93-a735-e2071cf40115" status: 200 len: 1264 microversion: 2.1 time: 0.151660 May 24 16:01:44.917191 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1579/3145] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 16:01:44 2022] GET /compute/v2.1/servers/58ca7f62-0644-4e93-a735-e2071cf40115 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 16:01:45.934827 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-54bdabde-b8ac-4fc7-8311-775750b7fcd8 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 16:01:45.935337 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-54bdabde-b8ac-4fc7-8311-775750b7fcd8 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 58ca7f62-0644-4e93-a735-e2071cf40115] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 16:01:45.941842 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-54bdabde-b8ac-4fc7-8311-775750b7fcd8 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:01:45.942280 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-54bdabde-b8ac-4fc7-8311-775750b7fcd8 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:01:45.943028 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-54bdabde-b8ac-4fc7-8311-775750b7fcd8 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:01:45.943457 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-54bdabde-b8ac-4fc7-8311-775750b7fcd8 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:01:46.074797 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-54bdabde-b8ac-4fc7-8311-775750b7fcd8 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 16:01:46.082398 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-54bdabde-b8ac-4fc7-8311-775750b7fcd8 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/58ca7f62-0644-4e93-a735-e2071cf40115" status: 200 len: 1264 microversion: 2.1 time: 0.151502 May 24 16:01:46.082957 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1567/3146] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 16:01:45 2022] GET /compute/v2.1/servers/58ca7f62-0644-4e93-a735-e2071cf40115 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 16:01:47.098968 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-828b4e17-e4d8-4297-b8b3-9aa224f88bb1 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 16:01:47.099581 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-828b4e17-e4d8-4297-b8b3-9aa224f88bb1 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 58ca7f62-0644-4e93-a735-e2071cf40115] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 16:01:47.106583 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-828b4e17-e4d8-4297-b8b3-9aa224f88bb1 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:01:47.107031 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-828b4e17-e4d8-4297-b8b3-9aa224f88bb1 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:01:47.107782 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-828b4e17-e4d8-4297-b8b3-9aa224f88bb1 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:01:47.108215 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-828b4e17-e4d8-4297-b8b3-9aa224f88bb1 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:01:47.239813 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-828b4e17-e4d8-4297-b8b3-9aa224f88bb1 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 16:01:47.248260 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-828b4e17-e4d8-4297-b8b3-9aa224f88bb1 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/58ca7f62-0644-4e93-a735-e2071cf40115" status: 200 len: 1264 microversion: 2.1 time: 0.153164 May 24 16:01:47.248856 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1580/3147] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 16:01:47 2022] GET /compute/v2.1/servers/58ca7f62-0644-4e93-a735-e2071cf40115 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 16:01:48.265440 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-05269237-edf5-4782-8e0e-dd48b1b24e89 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 16:01:48.266050 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-05269237-edf5-4782-8e0e-dd48b1b24e89 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 58ca7f62-0644-4e93-a735-e2071cf40115] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 16:01:48.272594 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-05269237-edf5-4782-8e0e-dd48b1b24e89 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:01:48.273036 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-05269237-edf5-4782-8e0e-dd48b1b24e89 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:01:48.273782 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-05269237-edf5-4782-8e0e-dd48b1b24e89 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:01:48.274212 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-05269237-edf5-4782-8e0e-dd48b1b24e89 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:01:48.400624 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-05269237-edf5-4782-8e0e-dd48b1b24e89 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 16:01:48.407950 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-05269237-edf5-4782-8e0e-dd48b1b24e89 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/58ca7f62-0644-4e93-a735-e2071cf40115" status: 200 len: 1264 microversion: 2.1 time: 0.147119 May 24 16:01:48.408539 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1568/3148] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 16:01:48 2022] GET /compute/v2.1/servers/58ca7f62-0644-4e93-a735-e2071cf40115 => generated 1264 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 16:01:49.423799 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d7a9030f-7e9e-4fcd-8692-d2790f9bcdd4 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 16:01:49.424430 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d7a9030f-7e9e-4fcd-8692-d2790f9bcdd4 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 58ca7f62-0644-4e93-a735-e2071cf40115] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 16:01:49.430773 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d7a9030f-7e9e-4fcd-8692-d2790f9bcdd4 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:01:49.431219 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d7a9030f-7e9e-4fcd-8692-d2790f9bcdd4 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:01:49.431970 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d7a9030f-7e9e-4fcd-8692-d2790f9bcdd4 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:01:49.432432 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d7a9030f-7e9e-4fcd-8692-d2790f9bcdd4 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:01:49.712130 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-d7a9030f-7e9e-4fcd-8692-d2790f9bcdd4 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 16:01:49.719484 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d7a9030f-7e9e-4fcd-8692-d2790f9bcdd4 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/58ca7f62-0644-4e93-a735-e2071cf40115" status: 200 len: 1264 microversion: 2.1 time: 0.299604 May 24 16:01:49.720035 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1581/3149] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 16:01:49 2022] GET /compute/v2.1/servers/58ca7f62-0644-4e93-a735-e2071cf40115 => generated 1264 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 16:01:50.736485 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-2f79e815-511a-4c9b-a54b-3ab6869505f5 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 16:01:50.737095 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-2f79e815-511a-4c9b-a54b-3ab6869505f5 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 58ca7f62-0644-4e93-a735-e2071cf40115] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 16:01:50.741483 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell0:SELECT=2 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 16:01:50.742407 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell0:SELECT=6 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 16:01:50.750843 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2f79e815-511a-4c9b-a54b-3ab6869505f5 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:01:50.751289 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2f79e815-511a-4c9b-a54b-3ab6869505f5 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:01:50.752257 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2f79e815-511a-4c9b-a54b-3ab6869505f5 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:01:50.753021 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2f79e815-511a-4c9b-a54b-3ab6869505f5 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:01:50.885518 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-2f79e815-511a-4c9b-a54b-3ab6869505f5 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 16:01:50.893444 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-2f79e815-511a-4c9b-a54b-3ab6869505f5 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/58ca7f62-0644-4e93-a735-e2071cf40115" status: 200 len: 1264 microversion: 2.1 time: 0.160933 May 24 16:01:50.893993 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1569/3150] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 16:01:50 2022] GET /compute/v2.1/servers/58ca7f62-0644-4e93-a735-e2071cf40115 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 16:01:51.910318 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-3635dce4-c402-4e48-991a-dbe695bcdca9 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 16:01:51.910888 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-3635dce4-c402-4e48-991a-dbe695bcdca9 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 58ca7f62-0644-4e93-a735-e2071cf40115] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 16:01:51.914003 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell0:SELECT=2 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 16:01:51.919043 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3635dce4-c402-4e48-991a-dbe695bcdca9 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:01:51.919506 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3635dce4-c402-4e48-991a-dbe695bcdca9 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:01:51.920268 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3635dce4-c402-4e48-991a-dbe695bcdca9 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:01:51.920727 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-3635dce4-c402-4e48-991a-dbe695bcdca9 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:01:52.049154 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-3635dce4-c402-4e48-991a-dbe695bcdca9 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 16:01:52.057452 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-3635dce4-c402-4e48-991a-dbe695bcdca9 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/58ca7f62-0644-4e93-a735-e2071cf40115" status: 200 len: 1264 microversion: 2.1 time: 0.151206 May 24 16:01:52.058359 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1582/3151] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 16:01:51 2022] GET /compute/v2.1/servers/58ca7f62-0644-4e93-a735-e2071cf40115 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 16:01:53.074897 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-c8790bf9-1198-4e39-a2b4-a1306e7bef64 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 16:01:53.075560 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-c8790bf9-1198-4e39-a2b4-a1306e7bef64 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 58ca7f62-0644-4e93-a735-e2071cf40115] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 16:01:53.082599 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c8790bf9-1198-4e39-a2b4-a1306e7bef64 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:01:53.083046 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c8790bf9-1198-4e39-a2b4-a1306e7bef64 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:01:53.083812 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c8790bf9-1198-4e39-a2b4-a1306e7bef64 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:01:53.084243 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c8790bf9-1198-4e39-a2b4-a1306e7bef64 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:01:53.213984 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-c8790bf9-1198-4e39-a2b4-a1306e7bef64 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 16:01:53.221671 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-c8790bf9-1198-4e39-a2b4-a1306e7bef64 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/58ca7f62-0644-4e93-a735-e2071cf40115" status: 200 len: 1264 microversion: 2.1 time: 0.150922 May 24 16:01:53.222231 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1570/3152] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 16:01:53 2022] GET /compute/v2.1/servers/58ca7f62-0644-4e93-a735-e2071cf40115 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 16:01:54.238840 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-da97b0be-0679-46d4-9f38-81cb03302a0c tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 16:01:54.239448 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-da97b0be-0679-46d4-9f38-81cb03302a0c tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 58ca7f62-0644-4e93-a735-e2071cf40115] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 16:01:54.246155 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-da97b0be-0679-46d4-9f38-81cb03302a0c tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:01:54.246603 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-da97b0be-0679-46d4-9f38-81cb03302a0c tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:01:54.247345 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-da97b0be-0679-46d4-9f38-81cb03302a0c tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:01:54.247770 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-da97b0be-0679-46d4-9f38-81cb03302a0c tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:01:54.377869 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-da97b0be-0679-46d4-9f38-81cb03302a0c tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 16:01:54.385214 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-da97b0be-0679-46d4-9f38-81cb03302a0c tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/58ca7f62-0644-4e93-a735-e2071cf40115" status: 200 len: 1264 microversion: 2.1 time: 0.150232 May 24 16:01:54.385762 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1583/3153] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 16:01:54 2022] GET /compute/v2.1/servers/58ca7f62-0644-4e93-a735-e2071cf40115 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 16:01:54.771186 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [req-cf4172c7-8713-49ba-ba26-5b1122a7b4f1 req-5a12eb4e-e74c-4ea8-8c7d-2eb251c0296b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58ca7f62-0644-4e93-a735-e2071cf40115", "name": "network-vif-plugged", "status": "completed", "tag": "9be02f00-bd63-4aae-bb25-b4a13e883072"}]} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 16:01:54.779845 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-cf4172c7-8713-49ba-ba26-5b1122a7b4f1 req-5a12eb4e-e74c-4ea8-8c7d-2eb251c0296b service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:01:54.780289 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-cf4172c7-8713-49ba-ba26-5b1122a7b4f1 req-5a12eb4e-e74c-4ea8-8c7d-2eb251c0296b service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:01:54.790874 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.compute.server_external_events [req-cf4172c7-8713-49ba-ba26-5b1122a7b4f1 req-5a12eb4e-e74c-4ea8-8c7d-2eb251c0296b service nova] Creating event network-vif-plugged:9be02f00-bd63-4aae-bb25-b4a13e883072 for instance 58ca7f62-0644-4e93-a735-e2071cf40115 on hv-cinder-84315 May 24 16:01:54.795910 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [req-cf4172c7-8713-49ba-ba26-5b1122a7b4f1 req-5a12eb4e-e74c-4ea8-8c7d-2eb251c0296b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149527 May 24 16:01:54.796511 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1571/3154] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 16:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 16:01:55.401884 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d20cef61-bfb8-4997-bd62-f52d78d69c5e tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 16:01:55.402410 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d20cef61-bfb8-4997-bd62-f52d78d69c5e tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 58ca7f62-0644-4e93-a735-e2071cf40115] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 16:01:55.408834 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d20cef61-bfb8-4997-bd62-f52d78d69c5e tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:01:55.409273 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d20cef61-bfb8-4997-bd62-f52d78d69c5e tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:01:55.410018 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d20cef61-bfb8-4997-bd62-f52d78d69c5e tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:01:55.410446 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d20cef61-bfb8-4997-bd62-f52d78d69c5e tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:01:55.536505 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-d20cef61-bfb8-4997-bd62-f52d78d69c5e tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 16:01:55.544371 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d20cef61-bfb8-4997-bd62-f52d78d69c5e tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/58ca7f62-0644-4e93-a735-e2071cf40115" status: 200 len: 1264 microversion: 2.1 time: 0.146410 May 24 16:01:55.544917 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1584/3155] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 16:01:55 2022] GET /compute/v2.1/servers/58ca7f62-0644-4e93-a735-e2071cf40115 => generated 1264 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 16:01:56.236700 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 16:01:56.237252 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Tue May 24 16:01:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 16:01:56.562801 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-4936d89a-67f1-4911-a002-0a9e1f8ca43d tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 16:01:56.563504 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-4936d89a-67f1-4911-a002-0a9e1f8ca43d tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 58ca7f62-0644-4e93-a735-e2071cf40115] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 16:01:56.569827 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4936d89a-67f1-4911-a002-0a9e1f8ca43d tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:01:56.570278 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4936d89a-67f1-4911-a002-0a9e1f8ca43d tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:01:56.571051 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4936d89a-67f1-4911-a002-0a9e1f8ca43d tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:01:56.571495 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-4936d89a-67f1-4911-a002-0a9e1f8ca43d tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:01:56.707939 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-4936d89a-67f1-4911-a002-0a9e1f8ca43d tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 16:01:56.715869 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-4936d89a-67f1-4911-a002-0a9e1f8ca43d tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/58ca7f62-0644-4e93-a735-e2071cf40115" status: 200 len: 1264 microversion: 2.1 time: 0.158296 May 24 16:01:56.716472 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1572/3156] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 16:01:56 2022] GET /compute/v2.1/servers/58ca7f62-0644-4e93-a735-e2071cf40115 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 16:01:57.731857 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-733095f6-fa9e-4263-a8c7-2bf40b646b6d tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 16:01:57.732564 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-733095f6-fa9e-4263-a8c7-2bf40b646b6d tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 58ca7f62-0644-4e93-a735-e2071cf40115] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 16:01:57.739419 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-733095f6-fa9e-4263-a8c7-2bf40b646b6d tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:01:57.739862 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-733095f6-fa9e-4263-a8c7-2bf40b646b6d tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:01:57.740631 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-733095f6-fa9e-4263-a8c7-2bf40b646b6d tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:01:57.741066 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-733095f6-fa9e-4263-a8c7-2bf40b646b6d tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:01:57.873348 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-733095f6-fa9e-4263-a8c7-2bf40b646b6d tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 16:01:57.880818 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-733095f6-fa9e-4263-a8c7-2bf40b646b6d tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/58ca7f62-0644-4e93-a735-e2071cf40115" status: 200 len: 1451 microversion: 2.1 time: 0.152882 May 24 16:01:57.881381 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1585/3157] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 16:01:57 2022] GET /compute/v2.1/servers/58ca7f62-0644-4e93-a735-e2071cf40115 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 16:01:57.897706 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-2662af7e-3fb9-417a-957c-c0b87d1ebe7d tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 16:01:57.898315 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-2662af7e-3fb9-417a-957c-c0b87d1ebe7d tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 58ca7f62-0644-4e93-a735-e2071cf40115] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 16:01:57.904841 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2662af7e-3fb9-417a-957c-c0b87d1ebe7d tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:01:57.905290 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2662af7e-3fb9-417a-957c-c0b87d1ebe7d tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:01:57.906046 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2662af7e-3fb9-417a-957c-c0b87d1ebe7d tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:01:57.906479 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-2662af7e-3fb9-417a-957c-c0b87d1ebe7d tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:01:58.034422 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-2662af7e-3fb9-417a-957c-c0b87d1ebe7d tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 16:01:58.041969 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-2662af7e-3fb9-417a-957c-c0b87d1ebe7d tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/58ca7f62-0644-4e93-a735-e2071cf40115" status: 200 len: 1451 microversion: 2.1 time: 0.148082 May 24 16:01:58.042526 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1573/3158] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 16:01:57 2022] GET /compute/v2.1/servers/58ca7f62-0644-4e93-a735-e2071cf40115 => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 16:01:59.864447 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [req-2231b003-22d8-43be-a400-2150a2163fac req-db375a1e-3fe8-4ff7-9193-7a03830e10b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58ca7f62-0644-4e93-a735-e2071cf40115", "tag": "9be02f00-bd63-4aae-bb25-b4a13e883072"}]} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 16:01:59.873171 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-2231b003-22d8-43be-a400-2150a2163fac req-db375a1e-3fe8-4ff7-9193-7a03830e10b6 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:01:59.873613 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-2231b003-22d8-43be-a400-2150a2163fac req-db375a1e-3fe8-4ff7-9193-7a03830e10b6 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:01:59.885886 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.compute.server_external_events [req-2231b003-22d8-43be-a400-2150a2163fac req-db375a1e-3fe8-4ff7-9193-7a03830e10b6 service nova] Creating event network-changed:9be02f00-bd63-4aae-bb25-b4a13e883072 for instance 58ca7f62-0644-4e93-a735-e2071cf40115 on hv-cinder-84315 May 24 16:01:59.891713 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [req-2231b003-22d8-43be-a400-2150a2163fac req-db375a1e-3fe8-4ff7-9193-7a03830e10b6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030995 May 24 16:01:59.892318 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1586/3159] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 16:01:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 16:02:06.317127 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 16:02:06.317727 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Tue May 24 16:02:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 16:03:30.216106 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_api:SELECT=24 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 16:03:30.216885 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG dbcounter [-] [117698] Writing DB stats nova_cell1:SELECT=52 {{(pid=117698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 16:03:30.220814 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [req-753a803a-7b2a-4370-9803-18bdbfa80de9 req-0e8e34b0-80c7-4cf4-bf56-ded6b0c50de6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58ca7f62-0644-4e93-a735-e2071cf40115", "tag": "9be02f00-bd63-4aae-bb25-b4a13e883072"}]} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 16:03:30.223914 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 16:03:30.224754 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG dbcounter [-] [117699] Writing DB stats nova_cell1:SELECT=52 {{(pid=117699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 16:03:30.228657 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d03e1bd5-9c06-4240-92e7-c006b854547d tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 16:03:30.229158 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d03e1bd5-9c06-4240-92e7-c006b854547d tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 58ca7f62-0644-4e93-a735-e2071cf40115] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 16:03:30.236217 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d03e1bd5-9c06-4240-92e7-c006b854547d tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:03:30.236703 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d03e1bd5-9c06-4240-92e7-c006b854547d tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:03:30.237477 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d03e1bd5-9c06-4240-92e7-c006b854547d tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:03:30.238223 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d03e1bd5-9c06-4240-92e7-c006b854547d tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:03:30.243443 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-753a803a-7b2a-4370-9803-18bdbfa80de9 req-0e8e34b0-80c7-4cf4-bf56-ded6b0c50de6 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:03:30.243676 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-753a803a-7b2a-4370-9803-18bdbfa80de9 req-0e8e34b0-80c7-4cf4-bf56-ded6b0c50de6 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:03:30.255333 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.compute.server_external_events [req-753a803a-7b2a-4370-9803-18bdbfa80de9 req-0e8e34b0-80c7-4cf4-bf56-ded6b0c50de6 service nova] Creating event network-changed:9be02f00-bd63-4aae-bb25-b4a13e883072 for instance 58ca7f62-0644-4e93-a735-e2071cf40115 on hv-cinder-84315 May 24 16:03:30.260546 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [req-753a803a-7b2a-4370-9803-18bdbfa80de9 req-0e8e34b0-80c7-4cf4-bf56-ded6b0c50de6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046155 May 24 16:03:30.261340 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1587/3160] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 16:03:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 16:03:30.263972 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d03e1bd5-9c06-4240-92e7-c006b854547d tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 58ca7f62-0644-4e93-a735-e2071cf40115] Going to try to terminate instance {{(pid=117699) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 16:03:30.350308 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d03e1bd5-9c06-4240-92e7-c006b854547d tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "DELETE /compute/v2.1/servers/58ca7f62-0644-4e93-a735-e2071cf40115" status: 204 len: 0 microversion: 2.1 time: 0.138425 May 24 16:03:30.354082 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1574/3161] 10.222.0.45 () {58 vars in 1238 bytes} [Tue May 24 16:03:30 2022] DELETE /compute/v2.1/servers/58ca7f62-0644-4e93-a735-e2071cf40115 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 16:03:30.359634 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d8989a70-e6eb-4cef-a777-d60c302e3f3a tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 16:03:30.361113 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d8989a70-e6eb-4cef-a777-d60c302e3f3a tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 58ca7f62-0644-4e93-a735-e2071cf40115] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 16:03:30.367446 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d8989a70-e6eb-4cef-a777-d60c302e3f3a tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:03:30.367894 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d8989a70-e6eb-4cef-a777-d60c302e3f3a tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:03:30.368759 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d8989a70-e6eb-4cef-a777-d60c302e3f3a tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:03:30.369216 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d8989a70-e6eb-4cef-a777-d60c302e3f3a tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:03:30.509413 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-d8989a70-e6eb-4cef-a777-d60c302e3f3a tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 16:03:30.516951 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d8989a70-e6eb-4cef-a777-d60c302e3f3a tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/58ca7f62-0644-4e93-a735-e2071cf40115" status: 200 len: 1575 microversion: 2.1 time: 0.161472 May 24 16:03:30.517515 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1588/3162] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 16:03:30 2022] GET /compute/v2.1/servers/58ca7f62-0644-4e93-a735-e2071cf40115 => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 16:03:31.535219 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-7e727265-aa65-411d-9a5f-faf36ecc5cf5 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 16:03:31.535919 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-7e727265-aa65-411d-9a5f-faf36ecc5cf5 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 58ca7f62-0644-4e93-a735-e2071cf40115] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 16:03:31.542581 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7e727265-aa65-411d-9a5f-faf36ecc5cf5 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:03:31.543030 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7e727265-aa65-411d-9a5f-faf36ecc5cf5 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:03:31.543790 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7e727265-aa65-411d-9a5f-faf36ecc5cf5 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:03:31.544222 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-7e727265-aa65-411d-9a5f-faf36ecc5cf5 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:03:31.672385 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-7e727265-aa65-411d-9a5f-faf36ecc5cf5 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 16:03:31.680424 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-7e727265-aa65-411d-9a5f-faf36ecc5cf5 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/58ca7f62-0644-4e93-a735-e2071cf40115" status: 200 len: 1575 microversion: 2.1 time: 0.149921 May 24 16:03:31.680990 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1575/3163] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 16:03:31 2022] GET /compute/v2.1/servers/58ca7f62-0644-4e93-a735-e2071cf40115 => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 16:03:32.697520 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-e1ca4c07-4c0f-4919-8cea-b5c40e6fa6a4 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 16:03:32.698167 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-e1ca4c07-4c0f-4919-8cea-b5c40e6fa6a4 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 58ca7f62-0644-4e93-a735-e2071cf40115] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 16:03:32.704726 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e1ca4c07-4c0f-4919-8cea-b5c40e6fa6a4 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:03:32.705175 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e1ca4c07-4c0f-4919-8cea-b5c40e6fa6a4 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:03:32.705942 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e1ca4c07-4c0f-4919-8cea-b5c40e6fa6a4 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:03:32.706376 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-e1ca4c07-4c0f-4919-8cea-b5c40e6fa6a4 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:03:32.779271 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-e1ca4c07-4c0f-4919-8cea-b5c40e6fa6a4 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 16:03:32.786832 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-e1ca4c07-4c0f-4919-8cea-b5c40e6fa6a4 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/58ca7f62-0644-4e93-a735-e2071cf40115" status: 200 len: 1390 microversion: 2.1 time: 0.093187 May 24 16:03:32.787392 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1589/3164] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 16:03:32 2022] GET /compute/v2.1/servers/58ca7f62-0644-4e93-a735-e2071cf40115 => generated 1390 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 16:03:32.856713 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [req-8c48a228-d76b-4024-862e-b472e37cfa7d req-d62a0557-1b84-4a3d-84ad-a652dab016fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58ca7f62-0644-4e93-a735-e2071cf40115", "name": "network-vif-deleted", "tag": "9be02f00-bd63-4aae-bb25-b4a13e883072"}]} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 16:03:32.866100 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-8c48a228-d76b-4024-862e-b472e37cfa7d req-d62a0557-1b84-4a3d-84ad-a652dab016fd service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:03:32.866547 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-8c48a228-d76b-4024-862e-b472e37cfa7d req-d62a0557-1b84-4a3d-84ad-a652dab016fd service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:03:32.878555 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.compute.server_external_events [req-8c48a228-d76b-4024-862e-b472e37cfa7d req-d62a0557-1b84-4a3d-84ad-a652dab016fd service nova] Creating event network-vif-deleted:9be02f00-bd63-4aae-bb25-b4a13e883072 for instance 58ca7f62-0644-4e93-a735-e2071cf40115 on hv-cinder-84315 May 24 16:03:32.883399 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [req-8c48a228-d76b-4024-862e-b472e37cfa7d req-d62a0557-1b84-4a3d-84ad-a652dab016fd service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030674 May 24 16:03:32.883992 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1576/3165] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 16:03:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 16:03:33.805161 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-5bdd70e6-c38b-4413-a515-b6fd640a5995 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 16:03:33.805926 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-5bdd70e6-c38b-4413-a515-b6fd640a5995 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 58ca7f62-0644-4e93-a735-e2071cf40115] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 16:03:33.812260 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5bdd70e6-c38b-4413-a515-b6fd640a5995 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:03:33.812732 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5bdd70e6-c38b-4413-a515-b6fd640a5995 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:03:33.813476 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5bdd70e6-c38b-4413-a515-b6fd640a5995 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:03:33.813913 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5bdd70e6-c38b-4413-a515-b6fd640a5995 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:03:33.844013 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5bdd70e6-c38b-4413-a515-b6fd640a5995 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:03:33.844498 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-5bdd70e6-c38b-4413-a515-b6fd640a5995 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:03:33.845441 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.objects.instance [None req-5bdd70e6-c38b-4413-a515-b6fd640a5995 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lazy-loading 'fault' on Instance uuid 58ca7f62-0644-4e93-a735-e2071cf40115 {{(pid=117698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 16:03:33.887368 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-5bdd70e6-c38b-4413-a515-b6fd640a5995 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 16:03:33.894541 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-5bdd70e6-c38b-4413-a515-b6fd640a5995 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/58ca7f62-0644-4e93-a735-e2071cf40115" status: 200 len: 1183 microversion: 2.1 time: 0.093313 May 24 16:03:33.895096 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1590/3166] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 16:03:33 2022] GET /compute/v2.1/servers/58ca7f62-0644-4e93-a735-e2071cf40115 => generated 1183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 16:03:34.911891 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-eb9dd8f7-b8f7-4d17-811f-9c6817e82a3c tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 16:03:34.912607 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-eb9dd8f7-b8f7-4d17-811f-9c6817e82a3c tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 58ca7f62-0644-4e93-a735-e2071cf40115] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 16:03:34.918877 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-eb9dd8f7-b8f7-4d17-811f-9c6817e82a3c tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:03:34.919317 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-eb9dd8f7-b8f7-4d17-811f-9c6817e82a3c tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:03:34.920089 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-eb9dd8f7-b8f7-4d17-811f-9c6817e82a3c tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:03:34.920552 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-eb9dd8f7-b8f7-4d17-811f-9c6817e82a3c tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:03:34.933753 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.wsgi [None req-eb9dd8f7-b8f7-4d17-811f-9c6817e82a3c tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] HTTP exception thrown: Instance 58ca7f62-0644-4e93-a735-e2071cf40115 could not be found. May 24 16:03:34.935331 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-eb9dd8f7-b8f7-4d17-811f-9c6817e82a3c tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Request method failure captured: May 24 16:03:34.935331 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: request: GET /compute/v2.1/servers/58ca7f62-0644-4e93-a735-e2071cf40115 HTTP/1.1 May 24 16:03:34.935331 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Accept: application/json May 24 16:03:34.935331 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Accept-Encoding: identity May 24 16:03:34.935331 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Connection: close May 24 16:03:34.935331 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Content-Length: 0 May 24 16:03:34.935331 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Content-Type: application/json May 24 16:03:34.935331 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Host: 10.222.0.45 May 24 16:03:34.935331 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Openstack-System-Scope: None May 24 16:03:34.935331 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: User-Agent: python-urllib3/1.26.9 May 24 16:03:34.935331 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Auth-Token: gAAAAABijQA0nb7kn_QyIsYfbbxxLfmqpFmi4xm6J04GUDFrN1mcfIP3hwvMyDM0VEHMa1BaJ9iedqnptd9UFn7k3Az__2jwtNGmvANjC9AE07eNbnj69WHR9mmTBIwa3n4PH3VdwZu0jD8bMcic0058__Vb5hKGjXkz12j3saF0PWsZNvHsjFE May 24 16:03:34.935331 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Domain-Id: None May 24 16:03:34.935331 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Domain-Name: None May 24 16:03:34.935331 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Identity-Status: Confirmed May 24 16:03:34.935331 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Is-Admin-Project: True May 24 16:03:34.935331 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Domain-Id: default May 24 16:03:34.935331 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Domain-Name: Default May 24 16:03:34.935331 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Id: f5b185a216134b4d828add9ebdcf89d2 May 24 16:03:34.935331 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Name: tempest-TestVolumeBootPattern-1195006381 May 24 16:03:34.935331 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Role: reader,member May 24 16:03:34.935331 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Roles: reader,member May 24 16:03:34.936759 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f5b185a216134b4d828add9ebdcf89d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f5b185a216134b4d828add9ebdcf89d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f5b185a216134b4d828add9ebdcf89d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f5b185a216134b4d828add9ebdcf89d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 24 16:03:34.936759 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant: tempest-TestVolumeBootPattern-1195006381 May 24 16:03:34.936759 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant-Id: f5b185a216134b4d828add9ebdcf89d2 May 24 16:03:34.936759 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant-Name: tempest-TestVolumeBootPattern-1195006381 May 24 16:03:34.936759 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User: tempest-TestVolumeBootPattern-1195006381-project May 24 16:03:34.936759 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Domain-Id: default May 24 16:03:34.936759 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Domain-Name: Default May 24 16:03:34.936759 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Id: 44b73e975868496fb800c68e2d007faa May 24 16:03:34.936759 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Name: tempest-TestVolumeBootPattern-1195006381-project May 24 16:03:34.936759 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: method: > May 24 16:03:34.936759 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: exception: Instance 58ca7f62-0644-4e93-a735-e2071cf40115 could not be found. May 24 16:03:34.936759 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: action_args: {'id': '58ca7f62-0644-4e93-a735-e2071cf40115'} May 24 16:03:34.937563 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 16:03:34.937563 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 16:03:34.937563 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 16:03:34.937563 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 16:03:34.937563 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 16:03:34.937563 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 16:03:34.937563 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 16:03:34.937563 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 16:03:34.937563 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 16:03:34.937563 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 16:03:34.937563 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58ca7f62-0644-4e93-a735-e2071cf40115 could not be found. May 24 16:03:34.937563 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 16:03:34.937563 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 16:03:34.937563 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 16:03:34.937563 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 16:03:34.937563 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 16:03:34.937563 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 16:03:34.937563 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 16:03:34.937563 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 16:03:34.937563 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 16:03:34.939544 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 16:03:34.939544 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 16:03:34.939544 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 16:03:34.939544 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 16:03:34.939544 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 16:03:34.939544 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 16:03:34.939544 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 16:03:34.939544 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58ca7f62-0644-4e93-a735-e2071cf40115 could not be found. May 24 16:03:34.939544 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 16:03:34.939544 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 16:03:34.939544 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 16:03:34.939544 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 16:03:34.939544 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 16:03:34.939544 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 16:03:34.939544 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 16:03:34.939544 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 16:03:34.939544 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58ca7f62-0644-4e93-a735-e2071cf40115 could not be found. May 24 16:03:34.939544 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 16:03:34.940997 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-eb9dd8f7-b8f7-4d17-811f-9c6817e82a3c tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Returning 404 to user: Instance 58ca7f62-0644-4e93-a735-e2071cf40115 could not be found. {{(pid=117699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 16:03:34.940997 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-eb9dd8f7-b8f7-4d17-811f-9c6817e82a3c tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/58ca7f62-0644-4e93-a735-e2071cf40115" status: 404 len: 111 microversion: 2.1 time: 0.029504 May 24 16:03:34.940997 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1577/3167] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 16:03:34 2022] GET /compute/v2.1/servers/58ca7f62-0644-4e93-a735-e2071cf40115 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 16:03:38.222244 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-bb0c7783-781b-4b34-ba71-0c5ff92b539e tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 16:03:38.222722 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-bb0c7783-781b-4b34-ba71-0c5ff92b539e tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 40d5900f-06cc-46a0-bb7e-58a4359e777f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 16:03:38.229318 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bb0c7783-781b-4b34-ba71-0c5ff92b539e tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:03:38.229998 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bb0c7783-781b-4b34-ba71-0c5ff92b539e tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:03:38.230594 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [req-aeec6361-d57b-4876-b216-71436ded1575 req-3e4e52fa-bdef-4f63-a4f5-fded044daa25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40d5900f-06cc-46a0-bb7e-58a4359e777f", "tag": "35e770cc-bb73-4d65-95f9-dfd950c7e216"}]} {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 16:03:38.231010 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bb0c7783-781b-4b34-ba71-0c5ff92b539e tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:03:38.231211 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-bb0c7783-781b-4b34-ba71-0c5ff92b539e tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:03:38.238757 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-aeec6361-d57b-4876-b216-71436ded1575 req-3e4e52fa-bdef-4f63-a4f5-fded044daa25 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:03:38.239197 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [req-aeec6361-d57b-4876-b216-71436ded1575 req-3e4e52fa-bdef-4f63-a4f5-fded044daa25 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:03:38.250978 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.compute.server_external_events [req-aeec6361-d57b-4876-b216-71436ded1575 req-3e4e52fa-bdef-4f63-a4f5-fded044daa25 service nova] Creating event network-changed:35e770cc-bb73-4d65-95f9-dfd950c7e216 for instance 40d5900f-06cc-46a0-bb7e-58a4359e777f on hv-cinder-84315 May 24 16:03:38.256572 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [req-aeec6361-d57b-4876-b216-71436ded1575 req-3e4e52fa-bdef-4f63-a4f5-fded044daa25 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029437 May 24 16:03:38.257159 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1578/3168] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 16:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 16:03:38.261256 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-bb0c7783-781b-4b34-ba71-0c5ff92b539e tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 40d5900f-06cc-46a0-bb7e-58a4359e777f] Going to try to terminate instance {{(pid=117698) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 16:03:38.347415 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-bb0c7783-781b-4b34-ba71-0c5ff92b539e tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "DELETE /compute/v2.1/servers/40d5900f-06cc-46a0-bb7e-58a4359e777f" status: 204 len: 0 microversion: 2.1 time: 0.129247 May 24 16:03:38.351443 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1591/3169] 10.222.0.45 () {58 vars in 1238 bytes} [Tue May 24 16:03:38 2022] DELETE /compute/v2.1/servers/40d5900f-06cc-46a0-bb7e-58a4359e777f => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 16:03:38.357810 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-541dc1b6-89c8-4b5d-8b33-bb45ec68be1f tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 16:03:38.358845 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-541dc1b6-89c8-4b5d-8b33-bb45ec68be1f tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 40d5900f-06cc-46a0-bb7e-58a4359e777f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 16:03:38.366000 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-541dc1b6-89c8-4b5d-8b33-bb45ec68be1f tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:03:38.366788 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-541dc1b6-89c8-4b5d-8b33-bb45ec68be1f tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:03:38.367622 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-541dc1b6-89c8-4b5d-8b33-bb45ec68be1f tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:03:38.368051 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-541dc1b6-89c8-4b5d-8b33-bb45ec68be1f tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:03:38.502500 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-541dc1b6-89c8-4b5d-8b33-bb45ec68be1f tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 16:03:38.509983 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-541dc1b6-89c8-4b5d-8b33-bb45ec68be1f tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/40d5900f-06cc-46a0-bb7e-58a4359e777f" status: 200 len: 1573 microversion: 2.1 time: 0.156849 May 24 16:03:38.510544 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1579/3170] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 16:03:38 2022] GET /compute/v2.1/servers/40d5900f-06cc-46a0-bb7e-58a4359e777f => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 16:03:39.528817 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-d728c852-fd87-4524-be8a-82365b2a5f72 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 16:03:39.529552 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-d728c852-fd87-4524-be8a-82365b2a5f72 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 40d5900f-06cc-46a0-bb7e-58a4359e777f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 16:03:39.536558 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d728c852-fd87-4524-be8a-82365b2a5f72 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:03:39.537009 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d728c852-fd87-4524-be8a-82365b2a5f72 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:03:39.537763 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d728c852-fd87-4524-be8a-82365b2a5f72 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:03:39.538198 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-d728c852-fd87-4524-be8a-82365b2a5f72 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:03:39.667199 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.policy [None req-d728c852-fd87-4524-be8a-82365b2a5f72 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117698) authorize /opt/stack/nova/nova/policy.py:199}} May 24 16:03:39.675449 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-d728c852-fd87-4524-be8a-82365b2a5f72 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/40d5900f-06cc-46a0-bb7e-58a4359e777f" status: 200 len: 1573 microversion: 2.1 time: 0.150798 May 24 16:03:39.676366 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1592/3171] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 16:03:39 2022] GET /compute/v2.1/servers/40d5900f-06cc-46a0-bb7e-58a4359e777f => generated 1573 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 16:03:40.692918 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-65dcc952-5d4c-44c8-a262-0289ec10c2a5 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 16:03:40.693582 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-65dcc952-5d4c-44c8-a262-0289ec10c2a5 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 40d5900f-06cc-46a0-bb7e-58a4359e777f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 16:03:40.700332 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-65dcc952-5d4c-44c8-a262-0289ec10c2a5 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:03:40.700785 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-65dcc952-5d4c-44c8-a262-0289ec10c2a5 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:03:40.701551 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-65dcc952-5d4c-44c8-a262-0289ec10c2a5 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:03:40.701982 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-65dcc952-5d4c-44c8-a262-0289ec10c2a5 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:03:40.788677 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-65dcc952-5d4c-44c8-a262-0289ec10c2a5 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 16:03:40.796237 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-65dcc952-5d4c-44c8-a262-0289ec10c2a5 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/40d5900f-06cc-46a0-bb7e-58a4359e777f" status: 200 len: 1388 microversion: 2.1 time: 0.107351 May 24 16:03:40.796834 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1580/3172] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 16:03:40 2022] GET /compute/v2.1/servers/40d5900f-06cc-46a0-bb7e-58a4359e777f => generated 1388 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 16:03:40.821071 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [req-a305a7a4-5913-4e23-9850-60e6d15d5b12 req-65eb1110-080d-4d32-8796-708ec3e774c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40d5900f-06cc-46a0-bb7e-58a4359e777f", "name": "network-vif-deleted", "tag": "35e770cc-bb73-4d65-95f9-dfd950c7e216"}]} {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 16:03:40.832476 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-a305a7a4-5913-4e23-9850-60e6d15d5b12 req-65eb1110-080d-4d32-8796-708ec3e774c8 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:03:40.832921 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [req-a305a7a4-5913-4e23-9850-60e6d15d5b12 req-65eb1110-080d-4d32-8796-708ec3e774c8 service nova] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:03:40.845457 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.compute.server_external_events [req-a305a7a4-5913-4e23-9850-60e6d15d5b12 req-65eb1110-080d-4d32-8796-708ec3e774c8 service nova] Creating event network-vif-deleted:35e770cc-bb73-4d65-95f9-dfd950c7e216 for instance 40d5900f-06cc-46a0-bb7e-58a4359e777f on hv-cinder-84315 May 24 16:03:40.851518 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [req-a305a7a4-5913-4e23-9850-60e6d15d5b12 req-65eb1110-080d-4d32-8796-708ec3e774c8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033607 May 24 16:03:40.852323 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1593/3173] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 16:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 16:03:41.813730 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-d1395b27-a674-41cb-8b2b-d0b833b80c10 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 16:03:41.814939 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-d1395b27-a674-41cb-8b2b-d0b833b80c10 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 40d5900f-06cc-46a0-bb7e-58a4359e777f] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 16:03:41.821500 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d1395b27-a674-41cb-8b2b-d0b833b80c10 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:03:41.821948 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d1395b27-a674-41cb-8b2b-d0b833b80c10 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:03:41.822706 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d1395b27-a674-41cb-8b2b-d0b833b80c10 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:03:41.823145 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d1395b27-a674-41cb-8b2b-d0b833b80c10 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:03:41.855923 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d1395b27-a674-41cb-8b2b-d0b833b80c10 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:03:41.856408 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-d1395b27-a674-41cb-8b2b-d0b833b80c10 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:03:41.856860 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.objects.instance [None req-d1395b27-a674-41cb-8b2b-d0b833b80c10 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lazy-loading 'fault' on Instance uuid 40d5900f-06cc-46a0-bb7e-58a4359e777f {{(pid=117699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 16:03:41.904351 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.policy [None req-d1395b27-a674-41cb-8b2b-d0b833b80c10 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b73e975868496fb800c68e2d007faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b185a216134b4d828add9ebdcf89d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117699) authorize /opt/stack/nova/nova/policy.py:199}} May 24 16:03:41.912807 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-d1395b27-a674-41cb-8b2b-d0b833b80c10 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/40d5900f-06cc-46a0-bb7e-58a4359e777f" status: 200 len: 1228 microversion: 2.1 time: 0.102858 May 24 16:03:41.913369 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1581/3174] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 16:03:41 2022] GET /compute/v2.1/servers/40d5900f-06cc-46a0-bb7e-58a4359e777f => generated 1228 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 16:03:42.930274 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-4939cf1b-daea-47ec-a927-a3fde4cca76f tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 16:03:42.930964 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-4939cf1b-daea-47ec-a927-a3fde4cca76f tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 40d5900f-06cc-46a0-bb7e-58a4359e777f] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 16:03:42.937612 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4939cf1b-daea-47ec-a927-a3fde4cca76f tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:03:42.938053 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4939cf1b-daea-47ec-a927-a3fde4cca76f tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:03:42.939317 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4939cf1b-daea-47ec-a927-a3fde4cca76f tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:03:42.939724 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-4939cf1b-daea-47ec-a927-a3fde4cca76f tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:03:42.952483 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.wsgi [None req-4939cf1b-daea-47ec-a927-a3fde4cca76f tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] HTTP exception thrown: Instance 40d5900f-06cc-46a0-bb7e-58a4359e777f could not be found. May 24 16:03:42.954061 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-4939cf1b-daea-47ec-a927-a3fde4cca76f tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Request method failure captured: May 24 16:03:42.954061 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: request: GET /compute/v2.1/servers/40d5900f-06cc-46a0-bb7e-58a4359e777f HTTP/1.1 May 24 16:03:42.954061 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Accept: application/json May 24 16:03:42.954061 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Accept-Encoding: identity May 24 16:03:42.954061 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Connection: close May 24 16:03:42.954061 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Content-Length: 0 May 24 16:03:42.954061 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Content-Type: application/json May 24 16:03:42.954061 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Host: 10.222.0.45 May 24 16:03:42.954061 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Openstack-System-Scope: None May 24 16:03:42.954061 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: User-Agent: python-urllib3/1.26.9 May 24 16:03:42.954061 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Auth-Token: gAAAAABijQA0nb7kn_QyIsYfbbxxLfmqpFmi4xm6J04GUDFrN1mcfIP3hwvMyDM0VEHMa1BaJ9iedqnptd9UFn7k3Az__2jwtNGmvANjC9AE07eNbnj69WHR9mmTBIwa3n4PH3VdwZu0jD8bMcic0058__Vb5hKGjXkz12j3saF0PWsZNvHsjFE May 24 16:03:42.954061 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Domain-Id: None May 24 16:03:42.954061 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Domain-Name: None May 24 16:03:42.954061 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Identity-Status: Confirmed May 24 16:03:42.954061 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Is-Admin-Project: True May 24 16:03:42.954061 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Domain-Id: default May 24 16:03:42.954061 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Domain-Name: Default May 24 16:03:42.954061 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Id: f5b185a216134b4d828add9ebdcf89d2 May 24 16:03:42.954061 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Name: tempest-TestVolumeBootPattern-1195006381 May 24 16:03:42.954061 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Role: reader,member May 24 16:03:42.954061 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Roles: reader,member May 24 16:03:42.956111 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f5b185a216134b4d828add9ebdcf89d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f5b185a216134b4d828add9ebdcf89d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f5b185a216134b4d828add9ebdcf89d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f5b185a216134b4d828add9ebdcf89d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 24 16:03:42.956111 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Tenant: tempest-TestVolumeBootPattern-1195006381 May 24 16:03:42.956111 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Tenant-Id: f5b185a216134b4d828add9ebdcf89d2 May 24 16:03:42.956111 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Tenant-Name: tempest-TestVolumeBootPattern-1195006381 May 24 16:03:42.956111 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User: tempest-TestVolumeBootPattern-1195006381-project May 24 16:03:42.956111 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Domain-Id: default May 24 16:03:42.956111 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Domain-Name: Default May 24 16:03:42.956111 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Id: 44b73e975868496fb800c68e2d007faa May 24 16:03:42.956111 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Name: tempest-TestVolumeBootPattern-1195006381-project May 24 16:03:42.956111 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: method: > May 24 16:03:42.956111 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: exception: Instance 40d5900f-06cc-46a0-bb7e-58a4359e777f could not be found. May 24 16:03:42.956111 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: action_args: {'id': '40d5900f-06cc-46a0-bb7e-58a4359e777f'} May 24 16:03:42.957254 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 16:03:42.957254 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 16:03:42.957254 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 16:03:42.957254 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 16:03:42.957254 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 16:03:42.957254 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 16:03:42.957254 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 16:03:42.957254 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 16:03:42.957254 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 16:03:42.957254 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 16:03:42.957254 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40d5900f-06cc-46a0-bb7e-58a4359e777f could not be found. May 24 16:03:42.957254 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 16:03:42.957254 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 16:03:42.957254 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 16:03:42.957254 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 16:03:42.957254 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 16:03:42.957254 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 16:03:42.957254 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 16:03:42.957254 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 16:03:42.957254 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 16:03:42.958515 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 16:03:42.958515 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 16:03:42.958515 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 16:03:42.958515 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 16:03:42.958515 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 16:03:42.958515 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 16:03:42.958515 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 16:03:42.958515 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40d5900f-06cc-46a0-bb7e-58a4359e777f could not be found. May 24 16:03:42.958515 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 16:03:42.958515 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 16:03:42.958515 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 16:03:42.958515 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 16:03:42.958515 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 16:03:42.958515 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 16:03:42.958515 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 16:03:42.958515 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 16:03:42.958515 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40d5900f-06cc-46a0-bb7e-58a4359e777f could not be found. May 24 16:03:42.958515 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 16:03:42.959950 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-4939cf1b-daea-47ec-a927-a3fde4cca76f tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Returning 404 to user: Instance 40d5900f-06cc-46a0-bb7e-58a4359e777f could not be found. {{(pid=117698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 16:03:42.959950 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-4939cf1b-daea-47ec-a927-a3fde4cca76f tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/40d5900f-06cc-46a0-bb7e-58a4359e777f" status: 404 len: 111 microversion: 2.1 time: 0.029960 May 24 16:03:42.959950 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1594/3175] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 16:03:42 2022] GET /compute/v2.1/servers/40d5900f-06cc-46a0-bb7e-58a4359e777f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 16:03:43.384252 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-c98f4d00-6f0c-4a93-a4ef-0339c604172f tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 16:03:43.384933 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.compute.api [None req-c98f4d00-6f0c-4a93-a4ef-0339c604172f tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 449da4bb-d801-4e7d-b677-d375b68062a6] Fetching instance by UUID {{(pid=117699) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 16:03:43.391361 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c98f4d00-6f0c-4a93-a4ef-0339c604172f tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:03:43.391812 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c98f4d00-6f0c-4a93-a4ef-0339c604172f tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:03:43.392631 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c98f4d00-6f0c-4a93-a4ef-0339c604172f tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:03:43.393073 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG oslo_concurrency.lockutils [None req-c98f4d00-6f0c-4a93-a4ef-0339c604172f tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:03:43.406137 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.wsgi [None req-c98f4d00-6f0c-4a93-a4ef-0339c604172f tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] HTTP exception thrown: Instance 449da4bb-d801-4e7d-b677-d375b68062a6 could not be found. May 24 16:03:43.407778 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-c98f4d00-6f0c-4a93-a4ef-0339c604172f tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Request method failure captured: May 24 16:03:43.407778 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: request: DELETE /compute/v2.1/servers/449da4bb-d801-4e7d-b677-d375b68062a6 HTTP/1.1 May 24 16:03:43.407778 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Accept: application/json May 24 16:03:43.407778 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Accept-Encoding: identity May 24 16:03:43.407778 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Connection: close May 24 16:03:43.407778 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Content-Length: 0 May 24 16:03:43.407778 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Content-Type: application/json May 24 16:03:43.407778 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Host: 10.222.0.45 May 24 16:03:43.407778 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Openstack-System-Scope: None May 24 16:03:43.407778 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: User-Agent: python-urllib3/1.26.9 May 24 16:03:43.407778 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Auth-Token: gAAAAABijQA0nb7kn_QyIsYfbbxxLfmqpFmi4xm6J04GUDFrN1mcfIP3hwvMyDM0VEHMa1BaJ9iedqnptd9UFn7k3Az__2jwtNGmvANjC9AE07eNbnj69WHR9mmTBIwa3n4PH3VdwZu0jD8bMcic0058__Vb5hKGjXkz12j3saF0PWsZNvHsjFE May 24 16:03:43.407778 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Domain-Id: None May 24 16:03:43.407778 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Domain-Name: None May 24 16:03:43.407778 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Identity-Status: Confirmed May 24 16:03:43.407778 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Is-Admin-Project: True May 24 16:03:43.407778 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Domain-Id: default May 24 16:03:43.407778 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Domain-Name: Default May 24 16:03:43.407778 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Id: f5b185a216134b4d828add9ebdcf89d2 May 24 16:03:43.407778 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Project-Name: tempest-TestVolumeBootPattern-1195006381 May 24 16:03:43.407778 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Role: reader,member May 24 16:03:43.407778 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Roles: reader,member May 24 16:03:43.409219 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f5b185a216134b4d828add9ebdcf89d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f5b185a216134b4d828add9ebdcf89d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f5b185a216134b4d828add9ebdcf89d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f5b185a216134b4d828add9ebdcf89d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 24 16:03:43.409219 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant: tempest-TestVolumeBootPattern-1195006381 May 24 16:03:43.409219 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant-Id: f5b185a216134b4d828add9ebdcf89d2 May 24 16:03:43.409219 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-Tenant-Name: tempest-TestVolumeBootPattern-1195006381 May 24 16:03:43.409219 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User: tempest-TestVolumeBootPattern-1195006381-project May 24 16:03:43.409219 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Domain-Id: default May 24 16:03:43.409219 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Domain-Name: Default May 24 16:03:43.409219 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Id: 44b73e975868496fb800c68e2d007faa May 24 16:03:43.409219 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: X-User-Name: tempest-TestVolumeBootPattern-1195006381-project May 24 16:03:43.409219 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: method: > May 24 16:03:43.409219 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: exception: Instance 449da4bb-d801-4e7d-b677-d375b68062a6 could not be found. May 24 16:03:43.409219 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: action_args: {'id': '449da4bb-d801-4e7d-b677-d375b68062a6'} May 24 16:03:43.409987 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 16:03:43.409987 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 16:03:43.409987 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 16:03:43.409987 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 16:03:43.409987 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 16:03:43.409987 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 16:03:43.409987 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 16:03:43.409987 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 16:03:43.409987 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 16:03:43.409987 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 16:03:43.409987 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 449da4bb-d801-4e7d-b677-d375b68062a6 could not be found. May 24 16:03:43.409987 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 16:03:43.409987 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 16:03:43.409987 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 16:03:43.409987 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 16:03:43.409987 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 16:03:43.409987 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 16:03:43.409987 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 16:03:43.409987 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 16:03:43.409987 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 16:03:43.411147 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 16:03:43.411147 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 24 16:03:43.411147 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 24 16:03:43.411147 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 24 16:03:43.411147 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 24 16:03:43.411147 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 16:03:43.411147 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 16:03:43.411147 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 16:03:43.411147 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 16:03:43.411147 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 449da4bb-d801-4e7d-b677-d375b68062a6 could not be found. May 24 16:03:43.411147 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 16:03:43.411147 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 16:03:43.411147 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 16:03:43.411147 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 16:03:43.411147 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 16:03:43.411147 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 16:03:43.411147 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 16:03:43.411147 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 16:03:43.411147 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 449da4bb-d801-4e7d-b677-d375b68062a6 could not be found. May 24 16:03:43.411147 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: ERROR nova.api.openstack.wsgi May 24 16:03:43.412194 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-c98f4d00-6f0c-4a93-a4ef-0339c604172f tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Returning 404 to user: Instance 449da4bb-d801-4e7d-b677-d375b68062a6 could not be found. {{(pid=117699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 16:03:43.412194 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-c98f4d00-6f0c-4a93-a4ef-0339c604172f tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "DELETE /compute/v2.1/servers/449da4bb-d801-4e7d-b677-d375b68062a6" status: 404 len: 111 microversion: 2.1 time: 0.028928 May 24 16:03:43.412194 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1582/3176] 10.222.0.45 () {58 vars in 1238 bytes} [Tue May 24 16:03:43 2022] DELETE /compute/v2.1/servers/449da4bb-d801-4e7d-b677-d375b68062a6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 16:03:43.417736 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-51210462-7c6e-4dd3-a4bb-4ed984b2627b tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '>' {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 16:03:43.418350 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.compute.api [None req-51210462-7c6e-4dd3-a4bb-4ed984b2627b tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] [instance: 449da4bb-d801-4e7d-b677-d375b68062a6] Fetching instance by UUID {{(pid=117698) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 16:03:43.425320 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-51210462-7c6e-4dd3-a4bb-4ed984b2627b tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:03:43.425951 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-51210462-7c6e-4dd3-a4bb-4ed984b2627b tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:03:43.427006 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-51210462-7c6e-4dd3-a4bb-4ed984b2627b tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 16:03:43.427478 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG oslo_concurrency.lockutils [None req-51210462-7c6e-4dd3-a4bb-4ed984b2627b tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Lock "4d042716-ec3d-4081-835a-0e5e9de595c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 16:03:43.444653 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.wsgi [None req-51210462-7c6e-4dd3-a4bb-4ed984b2627b tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] HTTP exception thrown: Instance 449da4bb-d801-4e7d-b677-d375b68062a6 could not be found. May 24 16:03:43.446150 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-51210462-7c6e-4dd3-a4bb-4ed984b2627b tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Request method failure captured: May 24 16:03:43.446150 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: request: GET /compute/v2.1/servers/449da4bb-d801-4e7d-b677-d375b68062a6 HTTP/1.1 May 24 16:03:43.446150 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Accept: application/json May 24 16:03:43.446150 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Accept-Encoding: identity May 24 16:03:43.446150 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Connection: close May 24 16:03:43.446150 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Content-Length: 0 May 24 16:03:43.446150 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Content-Type: application/json May 24 16:03:43.446150 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Host: 10.222.0.45 May 24 16:03:43.446150 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Openstack-System-Scope: None May 24 16:03:43.446150 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: User-Agent: python-urllib3/1.26.9 May 24 16:03:43.446150 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Auth-Token: gAAAAABijQA0nb7kn_QyIsYfbbxxLfmqpFmi4xm6J04GUDFrN1mcfIP3hwvMyDM0VEHMa1BaJ9iedqnptd9UFn7k3Az__2jwtNGmvANjC9AE07eNbnj69WHR9mmTBIwa3n4PH3VdwZu0jD8bMcic0058__Vb5hKGjXkz12j3saF0PWsZNvHsjFE May 24 16:03:43.446150 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Domain-Id: None May 24 16:03:43.446150 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Domain-Name: None May 24 16:03:43.446150 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Identity-Status: Confirmed May 24 16:03:43.446150 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Is-Admin-Project: True May 24 16:03:43.446150 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Domain-Id: default May 24 16:03:43.446150 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Domain-Name: Default May 24 16:03:43.446150 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Id: f5b185a216134b4d828add9ebdcf89d2 May 24 16:03:43.446150 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Project-Name: tempest-TestVolumeBootPattern-1195006381 May 24 16:03:43.446150 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Role: reader,member May 24 16:03:43.446150 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Roles: reader,member May 24 16:03:43.447744 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f5b185a216134b4d828add9ebdcf89d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f5b185a216134b4d828add9ebdcf89d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f5b185a216134b4d828add9ebdcf89d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f5b185a216134b4d828add9ebdcf89d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 24 16:03:43.447744 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Tenant: tempest-TestVolumeBootPattern-1195006381 May 24 16:03:43.447744 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Tenant-Id: f5b185a216134b4d828add9ebdcf89d2 May 24 16:03:43.447744 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-Tenant-Name: tempest-TestVolumeBootPattern-1195006381 May 24 16:03:43.447744 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User: tempest-TestVolumeBootPattern-1195006381-project May 24 16:03:43.447744 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Domain-Id: default May 24 16:03:43.447744 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Domain-Name: Default May 24 16:03:43.447744 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Id: 44b73e975868496fb800c68e2d007faa May 24 16:03:43.447744 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: X-User-Name: tempest-TestVolumeBootPattern-1195006381-project May 24 16:03:43.447744 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: method: > May 24 16:03:43.447744 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: exception: Instance 449da4bb-d801-4e7d-b677-d375b68062a6 could not be found. May 24 16:03:43.447744 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: action_args: {'id': '449da4bb-d801-4e7d-b677-d375b68062a6'} May 24 16:03:43.448661 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: {{(pid=117698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 16:03:43.448661 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 16:03:43.448661 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 16:03:43.448661 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 16:03:43.448661 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 16:03:43.448661 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 16:03:43.448661 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 16:03:43.448661 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 16:03:43.448661 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 16:03:43.448661 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 16:03:43.448661 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 449da4bb-d801-4e7d-b677-d375b68062a6 could not be found. May 24 16:03:43.448661 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 16:03:43.448661 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 16:03:43.448661 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 16:03:43.448661 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 16:03:43.448661 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 16:03:43.448661 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 16:03:43.448661 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 16:03:43.448661 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 16:03:43.448661 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 16:03:43.449946 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 16:03:43.449946 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 16:03:43.449946 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 16:03:43.449946 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 16:03:43.449946 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 16:03:43.449946 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 16:03:43.449946 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 16:03:43.449946 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 449da4bb-d801-4e7d-b677-d375b68062a6 could not be found. May 24 16:03:43.449946 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 16:03:43.449946 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 16:03:43.449946 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 16:03:43.449946 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 16:03:43.449946 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 16:03:43.449946 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 16:03:43.449946 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 16:03:43.449946 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 16:03:43.449946 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 449da4bb-d801-4e7d-b677-d375b68062a6 could not be found. May 24 16:03:43.449946 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: ERROR nova.api.openstack.wsgi May 24 16:03:43.451060 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: DEBUG nova.api.openstack.wsgi [None req-51210462-7c6e-4dd3-a4bb-4ed984b2627b tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Returning 404 to user: Instance 449da4bb-d801-4e7d-b677-d375b68062a6 could not be found. {{(pid=117698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 16:03:43.451060 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO nova.api.openstack.requestlog [None req-51210462-7c6e-4dd3-a4bb-4ed984b2627b tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "GET /compute/v2.1/servers/449da4bb-d801-4e7d-b677-d375b68062a6" status: 404 len: 111 microversion: 2.1 time: 0.033674 May 24 16:03:43.451060 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: [pid: 117698|app: 0|req: 1595/3177] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 16:03:43 2022] GET /compute/v2.1/servers/449da4bb-d801-4e7d-b677-d375b68062a6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 24 16:03:44.731386 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: DEBUG nova.api.openstack.wsgi [None req-82505cb2-b6e0-4df9-86cd-39bf68911523 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] Calling method '.version_select at 0x7f2dd2bccf70>' {{(pid=117699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 16:03:44.754105 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO nova.api.openstack.requestlog [None req-82505cb2-b6e0-4df9-86cd-39bf68911523 tempest-TestVolumeBootPattern-1195006381 tempest-TestVolumeBootPattern-1195006381-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-134503995" status: 202 len: 0 microversion: 2.1 time: 0.026513 May 24 16:03:44.759529 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: [pid: 117699|app: 0|req: 1583/3178] 10.222.0.45 () {58 vars in 1259 bytes} [Tue May 24 16:03:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-134503995 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 16:04:59.245018 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 16:04:59.245694 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Tue May 24 16:04:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 16:05:26.324931 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 16:05:26.325460 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Tue May 24 16:05:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 16:06:50.148665 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 16:06:50.149208 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Tue May 24 16:06:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 16:06:56.245750 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 16:06:56.246285 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Tue May 24 16:06:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 16:08:19.253907 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 16:08:19.254488 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Tue May 24 16:08:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 16:08:41.875712 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 16:08:41.876199 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Tue May 24 16:08:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 16:08:44.067085 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 16:08:44.067610 dv-cinder-843151-1-iscsi devstack@n-api.service[117699]: Tue May 24 16:08:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 16:08:46.333039 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 16:08:46.333524 dv-cinder-843151-1-iscsi devstack@n-api.service[117698]: Tue May 24 16:08:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!